2024-05-09T02:07:09.687 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T02:07:09.687 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} --verbose --archive /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997 -- /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/orig.config.yaml 2024-05-09T02:07:09.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T02:07:09.834 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997 branch: wip-pdonnell-testing-20240508.183908-debug description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698997' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240508.183908-debug ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 kclient: client.0: cephfs_name: a client.1: cephfs_name: b selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.183908-debug sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1722 sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.183908-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzYvgvuXpKbJkOthZRTB8rBBqv3KHYVtapdY792gY/PK1disAQaBZBwlFefz30hMpcJYd/PUGoEZ6Q0krsiNJw= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTngSoeAMgziRmEokVEmaHIQs6AefBZ8OhVQZiSut0L3a4j9GlQaEB3Knc+nGf/cSIlPPkLikGkqAxc6IOBL1g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mds_thrash: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_22:06:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T02:07:09.835 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa; will attempt to use it 2024-05-09T02:07:09.836 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks 2024-05-09T02:07:09.836 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T02:07:09.838 INFO:teuthology.task.internal:Checking packages... 2024-05-09T02:07:09.866 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c9da4049f638c0f84bdd9b4e33c42e86046ac554' 2024-05-09T02:07:09.867 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T02:07:09.867 INFO:teuthology.packaging:ref: None 2024-05-09T02:07:09.867 INFO:teuthology.packaging:tag: None 2024-05-09T02:07:09.867 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.183908-debug 2024-05-09T02:07:09.867 INFO:teuthology.packaging:sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:07:09.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240508.183908-debug 2024-05-09T02:07:10.091 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3594.gc9da4049 2024-05-09T02:07:10.092 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T02:07:10.104 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T02:07:10.104 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T02:07:10.199 INFO:teuthology.task.internal:Saving configuration 2024-05-09T02:07:10.217 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T02:07:10.229 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T02:07:10.254 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 02:01:37.546930', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzYvgvuXpKbJkOthZRTB8rBBqv3KHYVtapdY792gY/PK1disAQaBZBwlFefz30hMpcJYd/PUGoEZ6Q0krsiNJw='} 2024-05-09T02:07:10.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 02:01:37.548286', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTngSoeAMgziRmEokVEmaHIQs6AefBZ8OhVQZiSut0L3a4j9GlQaEB3Knc+nGf/cSIlPPkLikGkqAxc6IOBL1g='} 2024-05-09T02:07:10.274 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T02:07:10.303 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-09T02:07:10.303 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-05-09T02:07:10.303 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T02:07:10.387 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f20c379eee0>, signals=[15]) 2024-05-09T02:07:10.387 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T02:07:10.398 INFO:teuthology.task.internal:Opening connections... 2024-05-09T02:07:10.398 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:07:10.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:07:10.478 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:07:10.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:07:10.550 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T02:07:10.561 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-05-09T02:07:10.580 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-05-09T02:07:10.580 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-05-09T02:07:10.637 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-05-09T02:07:10.637 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-05-09T02:07:10.637 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T02:07:10.638 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T02:07:10.639 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-05-09T02:07:10.658 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-05-09T02:07:10.675 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-05-09T02:07:10.676 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T02:07:10.733 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T02:07:10.734 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-05-09T02:07:10.757 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T02:07:10.771 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T02:07:10.782 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T02:07:10.782 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-05-09T02:07:10.785 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-05-09T02:07:10.801 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T02:07:10.811 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T02:07:10.811 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-05-09T02:07:10.842 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-05-09T02:07:10.873 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T02:07:10.964 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T02:07:11.018 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T02:07:11.018 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T02:07:11.018 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T02:07:11.019 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T02:07:11.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:07:11.036 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-05-09T02:07:11.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:07:11.037 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-09T02:07:11.093 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-437.el9.x86_64 2024-05-09T02:07:11.094 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-437.el9.x86_64 2024-05-09T02:07:11.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-05-09T02:07:11.095 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-437.el9.x86_64 2024-05-09T02:07:11.095 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-437.el9.x86_64 2024-05-09T02:07:11.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-05-09T02:07:13.495 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-09T02:07:14.160 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.1 MB 00:01 2024-05-09T02:07:15.246 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-05-09T02:07:18.386 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 19 MB 00:03 2024-05-09T02:07:19.522 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-09T02:07:21.090 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-05-09T02:07:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.2 MB 00:00 2024-05-09T02:07:23.135 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-09T02:07:24.612 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-05-09T02:07:26.607 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-09T02:07:28.416 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-09T02:07:30.489 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T02:07:30.489 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T02:07:30.579 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-05-09T02:07:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:07:30.590 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 78 M 2024-05-09T02:07:30.590 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 123 M 2024-05-09T02:07:30.590 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T02:07:30.951 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.2 MB/s | 484 kB 00:00 2024-05-09T02:07:31.384 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 24 MB/s | 15 MB 00:00 2024-05-09T02:07:31.762 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-09T02:07:31.959 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 28 MB/s | 34 MB 00:01 2024-05-09T02:07:32.468 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 18 MB/s | 28 MB 00:01 2024-05-09T02:07:32.468 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T02:07:32.468 INFO:teuthology.orchestra.run.smithi046.stdout:Total 41 MB/s | 78 MB 00:01 2024-05-09T02:07:33.177 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T02:07:33.635 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T02:07:33.635 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T02:07:33.760 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T02:07:33.760 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T02:07:33.851 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T02:07:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 78 M 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 123 M 2024-05-09T02:07:33.860 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-05-09T02:07:34.609 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T02:07:34.609 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T02:07:35.213 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 368 kB/s | 484 kB 00:01 2024-05-09T02:07:37.164 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T02:07:37.538 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-modules-core-5.14.0-444.el9.x86_6 12 MB/s | 28 MB 00:02 2024-05-09T02:07:37.824 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T02:07:37.909 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T02:07:39.971 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-core-5.14.0-444.el9.x86_64.rpm 2.5 MB/s | 15 MB 00:06 2024-05-09T02:07:40.715 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T02:07:40.859 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T02:07:42.163 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 4.1 MB/s | 34 MB 00:08 2024-05-09T02:07:42.163 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-09T02:07:42.163 INFO:teuthology.orchestra.run.smithi107.stdout:Total 9.4 MB/s | 78 MB 00:08 2024-05-09T02:07:42.846 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-05-09T02:07:43.211 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-05-09T02:07:43.211 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-05-09T02:07:44.149 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-05-09T02:07:44.149 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-05-09T02:07:45.931 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T02:07:45.970 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:07:46.564 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-05-09T02:07:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T02:07:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T02:07:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T02:07:50.125 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T02:07:51.056 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:07:54.861 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T02:07:54.910 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:07:59.682 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:21.965 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:22.005 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T02:08:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T02:08:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T02:08:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:08:23.202 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T02:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T02:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T02:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T02:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T02:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:08:23.203 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T02:08:23.528 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T02:08:23.603 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T02:08:23.604 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T02:08:23.604 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T02:08:23.604 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T02:08:23.604 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T02:08:23.604 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T02:08:23.604 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T02:08:23.604 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T02:08:23.655 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T02:08:23.656 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T02:08:23.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T02:08:23.687 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:08:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T02:08:23.689 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T02:08:23.689 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-444.el9.x86_64 2024-05-09T02:08:23.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T02:08:24.271 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-05-09T02:08:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T02:08:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-05-09T02:08:25.639 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-05-09T02:08:25.655 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.yN8ao1Y6dN 2024-05-09T02:08:25.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yN8ao1Y6dN 2024-05-09T02:08:25.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.yN8ao1Y6dN 2024-05-09T02:08:25.862 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.yN8ao1Y6dN is 6KB 2024-05-09T02:08:25.883 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.yN8ao1Y6dN 2024-05-09T02:08:25.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T02:08:25.959 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T02:08:25.960 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T02:08:25.960 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T02:08:25.960 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T02:08:25.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T02:08:26.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-05-09T02:08:28.999 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:29.037 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T02:08:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T02:08:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T02:08:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T02:08:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:08:30.140 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-05-09T02:08:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T02:08:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T02:08:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T02:08:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T02:08:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:08:30.141 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-09T02:08:30.502 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T02:08:30.577 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T02:08:30.577 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T02:08:30.577 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T02:08:30.577 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T02:08:30.578 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T02:08:30.578 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-09T02:08:30.578 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T02:08:30.578 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T02:08:30.627 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T02:08:30.627 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T02:08:30.627 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-05-09T02:08:30.657 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-05-09T02:08:30.657 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-05-09T02:08:30.657 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-05-09T02:08:30.657 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2024-05-09T02:08:30.657 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-05-09T02:08:30.657 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-05-09T02:08:30.658 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:08:30.659 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T02:08:30.659 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T02:08:30.659 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T02:08:30.659 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-05-09T02:08:30.659 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:08:30.659 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T02:08:30.660 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T02:08:30.660 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-444.el9.x86_64 2024-05-09T02:08:30.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T02:08:31.257 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-05-09T02:08:32.737 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T02:08:32.766 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-05-09T02:08:32.776 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-09T02:08:32.792 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.dsESYi7UKF 2024-05-09T02:08:32.792 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dsESYi7UKF 2024-05-09T02:08:32.857 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.dsESYi7UKF 2024-05-09T02:08:32.994 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.dsESYi7UKF is 6KB 2024-05-09T02:08:33.013 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.dsESYi7UKF 2024-05-09T02:08:33.027 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T02:08:33.088 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T02:08:33.089 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T02:08:33.089 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T02:08:33.089 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T02:08:33.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T02:08:33.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-05-09T02:08:56.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T02:08:56.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:08:56.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:09:03.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-09T02:09:03.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:09:03.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:09:14.527 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-05-09T02:09:21.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-09T02:09:23.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:09:23.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:09:26.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-05-09T02:09:30.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:09:30.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:09:33.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-09T02:09:38.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:09:38.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:09:45.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:09:45.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:10:38.651 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T02:10:45.771 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T02:10:53.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:10:53.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:10:54.069 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-05-09T02:10:54.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:10:54.436 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-09T02:10:54.437 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-05-09T02:10:54.454 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-444.el9.x86_64 2024-05-09T02:10:54.455 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T02:10:54.455 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T02:10:54.455 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T02:10:55.456 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T02:10:55.456 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T02:10:55.530 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-05-09T02:10:55.572 DEBUG:teuthology.parallel:result is None 2024-05-09T02:11:00.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:11:00.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:11:01.200 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-09T02:11:01.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:11:01.568 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-444.el9.x86_64"... 2024-05-09T02:11:01.569 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-09T02:11:01.584 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-444.el9.x86_64 2024-05-09T02:11:01.584 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T02:11:01.584 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T02:11:01.584 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T02:11:02.585 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-09T02:11:02.586 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T02:11:02.659 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-05-09T02:11:02.692 DEBUG:teuthology.parallel:result is None 2024-05-09T02:11:02.693 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T02:11:02.700 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T02:11:02.700 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T02:11:02.703 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T02:11:02.721 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T02:11:02.733 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T02:11:02.741 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T02:11:02.741 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T02:11:02.762 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T02:11:02.809 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T02:11:02.817 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T02:11:02.817 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T02:11:02.833 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T02:11:02.867 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T02:11:02.877 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T02:11:02.879 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T02:11:02.888 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T02:11:02.890 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T02:11:02.898 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T02:11:02.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T02:11:02.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T02:11:02.957 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T02:11:02.967 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T02:11:02.967 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T02:11:02.994 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T02:11:03.013 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T02:11:03.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T02:11:03.139 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T02:11:03.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T02:11:03.267 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:11:03.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T02:11:03.334 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T02:11:03.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T02:11:03.437 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T02:11:03.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T02:11:03.563 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:11:03.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T02:11:03.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-05-09T02:11:03.632 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-05-09T02:11:03.671 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T02:11:03.706 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T02:11:04.203 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T02:11:04.211 INFO:teuthology.task.internal:Starting timer... 2024-05-09T02:11:04.211 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T02:11:04.224 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T02:11:04.233 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-09T02:11:04.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-05-09T02:11:04.290 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-05-09T02:11:04.292 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-05-09T02:11:04.341 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-05-09T02:11:04.343 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T02:11:04.343 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-05-09T02:11:04.379 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-05-09T02:11:04.379 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-05-09T02:11:04.411 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-05-09T02:11:04.412 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-05-09T02:11:04.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T02:11:04.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:11:04.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T02:11:04.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:11:04.477 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T02:11:04.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-05-09T02:11:04.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-05-09T02:11:04.544 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T02:11:04.553 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T02:11:04.558 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T02:11:04.693 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T02:11:04.709 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T02:11:04.711 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T02:15:06.249 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-05-09T02:15:06.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:15:06.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:15:06.331 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-05-09T02:15:06.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T02:15:06.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:15:06.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T02:15:06.489 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-09T02:15:06.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-09T02:15:06.571 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T02:15:06.584 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T02:15:06.585 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T02:15:06.586 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T02:15:06.588 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T02:15:06.588 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T02:15:06.619 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T02:15:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T02:15:06.640 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T02:15:06.654 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T02:15:06.662 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-05-09T02:15:06.674 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-05-09T02:15:06.679 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-05-09T02:15:06.689 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T02:15:06.690 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-05-09T02:15:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T02:15:06.704 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T02:15:06.718 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T02:15:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-05-09T02:15:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T02:15:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-05-09T02:15:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.772 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.773 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-05-09T02:15:06.776 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T02:15:06.776 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-05-09T02:15:06.776 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:15:06.778 INFO:teuthology.run_tasks:Running task install... 2024-05-09T02:15:06.787 DEBUG:teuthology.task.install:project ceph 2024-05-09T02:15:06.787 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}} 2024-05-09T02:15:06.787 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'} 2024-05-09T02:15:06.787 INFO:teuthology.task.install:Using flavor: default 2024-05-09T02:15:06.793 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T02:15:06.793 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T02:15:06.793 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T02:15:06.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:15:06.796 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T02:15:06.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:15:06.939 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T02:15:06.940 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T02:15:06.948 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T02:15:06.949 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T02:15:07.089 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T02:15:07.089 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:15:07.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T02:15:07.116 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T02:15:07.117 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T02:15:07.183 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T02:15:07.258 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T02:15:07.322 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-05-09T02:15:07.323 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-05-09T02:15:07.553 INFO:teuthology.orchestra.run.smithi107.stdout:54 files removed 2024-05-09T02:15:07.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T02:15:08.072 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T02:15:08.072 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:15:08.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T02:15:08.103 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T02:15:08.104 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T02:15:08.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T02:15:08.257 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T02:15:08.325 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-05-09T02:15:08.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-05-09T02:15:08.552 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 120 kB/s | 84 kB 00:00 2024-05-09T02:15:08.572 INFO:teuthology.orchestra.run.smithi046.stdout:54 files removed 2024-05-09T02:15:08.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T02:15:09.078 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-05-09T02:15:09.354 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 179 kB/s | 84 kB 00:00 2024-05-09T02:15:09.395 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-05-09T02:15:09.954 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 22 kB/s | 12 kB 00:00 2024-05-09T02:15:10.079 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-09T02:15:10.538 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2024-05-09T02:15:12.739 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.1 MB 00:02 2024-05-09T02:15:15.006 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-05-09T02:15:19.532 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.2 MB 00:00 2024-05-09T02:15:21.208 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-05-09T02:15:28.005 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-09T02:15:33.545 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:01 2024-05-09T02:15:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 21 MB 00:13 2024-05-09T02:15:35.362 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-09T02:15:36.513 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-05-09T02:15:40.125 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-09T02:15:41.688 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-09T02:15:42.553 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T02:15:42.553 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T02:15:42.564 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T02:15:42.565 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T02:15:42.566 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T02:15:42.567 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T02:15:42.568 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T02:15:42.571 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T02:15:42.572 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T02:15:42.636 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T02:15:42.656 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-05-09T02:15:42.656 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T02:15:42.656 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-05-09T02:15:42.656 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T02:15:42.657 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T02:15:42.658 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-05-09T02:15:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T02:15:42.660 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T02:15:42.661 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T02:15:42.662 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T02:15:42.663 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T02:15:42.664 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T02:15:42.665 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T02:15:42.666 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T02:15:42.667 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:15:42.668 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T02:15:42.669 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-05-09T02:15:42.669 INFO:teuthology.orchestra.run.smithi046.stdout:Install 148 Packages 2024-05-09T02:15:42.669 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 8 Packages 2024-05-09T02:15:42.669 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:15:42.669 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 219 M 2024-05-09T02:15:42.669 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T02:15:43.668 INFO:teuthology.orchestra.run.smithi046.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-05-09T02:15:43.869 INFO:teuthology.orchestra.run.smithi046.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 4.2 MB/s | 863 kB 00:00 2024-05-09T02:15:43.919 INFO:teuthology.orchestra.run.smithi046.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 2.9 MB/s | 147 kB 00:00 2024-05-09T02:15:44.006 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T02:15:44.007 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T02:15:44.018 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T02:15:44.019 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T02:15:44.020 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T02:15:44.020 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T02:15:44.022 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T02:15:44.024 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T02:15:44.025 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T02:15:44.085 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-09T02:15:44.096 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-05-09T02:15:44.096 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-05-09T02:15:44.096 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-05-09T02:15:44.096 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-05-09T02:15:44.096 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T02:15:44.097 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T02:15:44.098 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T02:15:44.099 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T02:15:44.100 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T02:15:44.101 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T02:15:44.102 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T02:15:44.103 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T02:15:44.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T02:15:44.105 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T02:15:44.106 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T02:15:44.107 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T02:15:44.108 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout:Install 148 Packages 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 8 Packages 2024-05-09T02:15:44.109 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:15:44.110 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 219 M 2024-05-09T02:15:44.110 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-05-09T02:15:44.421 INFO:teuthology.orchestra.run.smithi046.stdout:(4/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 4.5 MB/s | 2.3 MB 00:00 2024-05-09T02:15:44.495 INFO:teuthology.orchestra.run.smithi046.stdout:(5/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 5.4 MB/s | 5.4 MB 00:01 2024-05-09T02:15:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-05-09T02:15:44.995 INFO:teuthology.orchestra.run.smithi046.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 9.8 MB/s | 4.9 MB 00:00 2024-05-09T02:15:45.456 INFO:teuthology.orchestra.run.smithi107.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-05-09T02:15:45.837 INFO:teuthology.orchestra.run.smithi046.stdout:(8/156): ceph-common-19.0.0-3594.gc9da4049.el9. 8.3 MB/s | 20 MB 00:02 2024-05-09T02:15:46.029 INFO:teuthology.orchestra.run.smithi046.stdout:(9/156): ceph-radosgw-19.0.0-3594.gc9da4049.el9 9.8 MB/s | 10 MB 00:01 2024-05-09T02:15:46.063 INFO:teuthology.orchestra.run.smithi046.stdout:(10/156): ceph-selinux-19.0.0-3594.gc9da4049.el 111 kB/s | 25 kB 00:00 2024-05-09T02:15:46.090 INFO:teuthology.orchestra.run.smithi107.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 1.3 MB/s | 863 kB 00:00 2024-05-09T02:15:46.521 INFO:teuthology.orchestra.run.smithi046.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 489 kB/s | 224 kB 00:00 2024-05-09T02:15:46.638 INFO:teuthology.orchestra.run.smithi046.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 232 kB/s | 27 kB 00:00 2024-05-09T02:15:46.747 INFO:teuthology.orchestra.run.smithi046.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 293 kB/s | 32 kB 00:00 2024-05-09T02:15:46.973 INFO:teuthology.orchestra.run.smithi107.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 166 kB/s | 147 kB 00:00 2024-05-09T02:15:47.039 INFO:teuthology.orchestra.run.smithi046.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 2.5 MB/s | 756 kB 00:00 2024-05-09T02:15:47.124 INFO:teuthology.orchestra.run.smithi107.stdout:(4/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 2.4 MB/s | 5.4 MB 00:02 2024-05-09T02:15:47.139 INFO:teuthology.orchestra.run.smithi046.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 1.5 MB/s | 158 kB 00:00 2024-05-09T02:15:47.240 INFO:teuthology.orchestra.run.smithi046.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.2 MB/s | 127 kB 00:00 2024-05-09T02:15:47.499 INFO:teuthology.orchestra.run.smithi107.stdout:(5/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-05-09T02:15:47.515 INFO:teuthology.orchestra.run.smithi046.stdout:(17/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 6.3 MB/s | 18 MB 00:02 2024-05-09T02:15:47.548 INFO:teuthology.orchestra.run.smithi046.stdout:(18/156): libradosstriper1-19.0.0-3594.gc9da404 1.6 MB/s | 497 kB 00:00 2024-05-09T02:15:47.890 INFO:teuthology.orchestra.run.smithi107.stdout:(6/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 2.5 MB/s | 2.3 MB 00:00 2024-05-09T02:15:47.915 INFO:teuthology.orchestra.run.smithi046.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 123 kB/s | 45 kB 00:00 2024-05-09T02:15:48.032 INFO:teuthology.orchestra.run.smithi046.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 1.1 MB/s | 135 kB 00:00 2024-05-09T02:15:48.141 INFO:teuthology.orchestra.run.smithi046.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.5 MB/s | 162 kB 00:00 2024-05-09T02:15:48.249 INFO:teuthology.orchestra.run.smithi046.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 2.9 MB/s | 321 kB 00:00 2024-05-09T02:15:48.349 INFO:teuthology.orchestra.run.smithi107.stdout:(7/156): ceph-common-19.0.0-3594.gc9da4049.el9. 5.7 MB/s | 20 MB 00:03 2024-05-09T02:15:48.350 INFO:teuthology.orchestra.run.smithi046.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.9 MB/s | 301 kB 00:00 2024-05-09T02:15:48.467 INFO:teuthology.orchestra.run.smithi046.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 850 kB/s | 99 kB 00:00 2024-05-09T02:15:48.575 INFO:teuthology.orchestra.run.smithi046.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 793 kB/s | 86 kB 00:00 2024-05-09T02:15:48.624 INFO:teuthology.orchestra.run.smithi107.stdout:(8/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 4.3 MB/s | 4.9 MB 00:01 2024-05-09T02:15:48.667 INFO:teuthology.orchestra.run.smithi046.stdout:(26/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 4.5 MB/s | 5.2 MB 00:01 2024-05-09T02:15:48.708 INFO:teuthology.orchestra.run.smithi107.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 302 kB/s | 25 kB 00:00 2024-05-09T02:15:48.751 INFO:teuthology.orchestra.run.smithi046.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-09T02:15:48.843 INFO:teuthology.orchestra.run.smithi046.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 373 kB/s | 34 kB 00:00 2024-05-09T02:15:48.935 INFO:teuthology.orchestra.run.smithi046.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.5 MB/s | 142 kB 00:00 2024-05-09T02:15:49.352 INFO:teuthology.orchestra.run.smithi046.stdout:(30/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 3.9 MB/s | 3.0 MB 00:00 2024-05-09T02:15:49.769 INFO:teuthology.orchestra.run.smithi046.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 4.2 MB/s | 3.5 MB 00:00 2024-05-09T02:15:49.861 INFO:teuthology.orchestra.run.smithi046.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.9 MB/s | 274 kB 00:00 2024-05-09T02:15:49.936 INFO:teuthology.orchestra.run.smithi046.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 658 kB/s | 49 kB 00:00 2024-05-09T02:15:49.994 INFO:teuthology.orchestra.run.smithi046.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 282 kB/s | 16 kB 00:00 2024-05-09T02:15:50.053 INFO:teuthology.orchestra.run.smithi046.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 4.6 MB/s | 273 kB 00:00 2024-05-09T02:15:50.204 INFO:teuthology.orchestra.run.smithi046.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 5.0 MB/s | 763 kB 00:00 2024-05-09T02:15:50.216 INFO:teuthology.orchestra.run.smithi107.stdout:(10/156): ceph-radosgw-19.0.0-3594.gc9da4049.el 5.4 MB/s | 10 MB 00:01 2024-05-09T02:15:50.254 INFO:teuthology.orchestra.run.smithi046.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 366 kB/s | 18 kB 00:00 2024-05-09T02:15:50.358 INFO:teuthology.orchestra.run.smithi107.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 1.5 MB/s | 224 kB 00:00 2024-05-09T02:15:50.433 INFO:teuthology.orchestra.run.smithi107.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 360 kB/s | 27 kB 00:00 2024-05-09T02:15:50.454 INFO:teuthology.orchestra.run.smithi046.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-05-09T02:15:50.500 INFO:teuthology.orchestra.run.smithi107.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 476 kB/s | 32 kB 00:00 2024-05-09T02:15:50.617 INFO:teuthology.orchestra.run.smithi107.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 6.3 MB/s | 756 kB 00:00 2024-05-09T02:15:50.692 INFO:teuthology.orchestra.run.smithi107.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 2.1 MB/s | 158 kB 00:00 2024-05-09T02:15:50.759 INFO:teuthology.orchestra.run.smithi107.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.9 MB/s | 127 kB 00:00 2024-05-09T02:15:50.863 INFO:teuthology.orchestra.run.smithi046.stdout:(39/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 8.9 MB/s | 43 MB 00:04 2024-05-09T02:15:50.868 INFO:teuthology.orchestra.run.smithi107.stdout:(17/156): libradosstriper1-19.0.0-3594.gc9da404 4.5 MB/s | 497 kB 00:00 2024-05-09T02:15:50.988 INFO:teuthology.orchestra.run.smithi046.stdout:(40/156): ceph-mgr-diskprediction-local-19.0.0- 4.5 MB/s | 7.4 MB 00:01 2024-05-09T02:15:51.030 INFO:teuthology.orchestra.run.smithi046.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-05-09T02:15:51.155 INFO:teuthology.orchestra.run.smithi046.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 669 kB/s | 195 kB 00:00 2024-05-09T02:15:51.214 INFO:teuthology.orchestra.run.smithi046.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-05-09T02:15:51.239 INFO:teuthology.orchestra.run.smithi046.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-05-09T02:15:51.273 INFO:teuthology.orchestra.run.smithi046.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-05-09T02:15:51.298 INFO:teuthology.orchestra.run.smithi046.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-09T02:15:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-09T02:15:51.349 INFO:teuthology.orchestra.run.smithi046.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-05-09T02:15:51.435 INFO:teuthology.orchestra.run.smithi107.stdout:(18/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 9.1 MB/s | 5.2 MB 00:00 2024-05-09T02:15:51.490 INFO:teuthology.orchestra.run.smithi046.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-05-09T02:15:51.527 INFO:teuthology.orchestra.run.smithi107.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 492 kB/s | 45 kB 00:00 2024-05-09T02:15:51.549 INFO:teuthology.orchestra.run.smithi046.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 370 kB/s | 21 kB 00:00 2024-05-09T02:15:51.594 INFO:teuthology.orchestra.run.smithi107.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 2.0 MB/s | 135 kB 00:00 2024-05-09T02:15:51.649 INFO:teuthology.orchestra.run.smithi046.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-05-09T02:15:51.661 INFO:teuthology.orchestra.run.smithi107.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 2.4 MB/s | 162 kB 00:00 2024-05-09T02:15:51.700 INFO:teuthology.orchestra.run.smithi046.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-05-09T02:15:51.725 INFO:teuthology.orchestra.run.smithi046.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-05-09T02:15:51.736 INFO:teuthology.orchestra.run.smithi107.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 4.2 MB/s | 321 kB 00:00 2024-05-09T02:15:51.750 INFO:teuthology.orchestra.run.smithi046.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-05-09T02:15:51.775 INFO:teuthology.orchestra.run.smithi046.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-05-09T02:15:51.809 INFO:teuthology.orchestra.run.smithi046.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-05-09T02:15:51.862 INFO:teuthology.orchestra.run.smithi107.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.3 MB/s | 301 kB 00:00 2024-05-09T02:15:51.893 INFO:teuthology.orchestra.run.smithi046.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-05-09T02:15:51.926 INFO:teuthology.orchestra.run.smithi046.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-05-09T02:15:51.970 INFO:teuthology.orchestra.run.smithi107.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 915 kB/s | 99 kB 00:00 2024-05-09T02:15:52.029 INFO:teuthology.orchestra.run.smithi107.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.4 MB/s | 86 kB 00:00 2024-05-09T02:15:52.135 INFO:teuthology.orchestra.run.smithi046.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-05-09T02:15:52.169 INFO:teuthology.orchestra.run.smithi046.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 2.3 MB/s | 582 kB 00:00 2024-05-09T02:15:52.252 INFO:teuthology.orchestra.run.smithi046.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 569 kB/s | 47 kB 00:00 2024-05-09T02:15:52.377 INFO:teuthology.orchestra.run.smithi046.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-09T02:15:52.503 INFO:teuthology.orchestra.run.smithi046.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-09T02:15:52.529 INFO:teuthology.orchestra.run.smithi107.stdout:(26/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 6.1 MB/s | 3.0 MB 00:00 2024-05-09T02:15:52.553 INFO:teuthology.orchestra.run.smithi046.stdout:(64/156): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-05-09T02:15:52.604 INFO:teuthology.orchestra.run.smithi107.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.2 MB/s | 169 kB 00:00 2024-05-09T02:15:52.663 INFO:teuthology.orchestra.run.smithi107.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 586 kB/s | 34 kB 00:00 2024-05-09T02:15:52.670 INFO:teuthology.orchestra.run.smithi046.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2024-05-09T02:15:52.695 INFO:teuthology.orchestra.run.smithi046.stdout:(66/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 45 kB/s | 25 kB 00:00 2024-05-09T02:15:52.730 INFO:teuthology.orchestra.run.smithi107.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 2.1 MB/s | 142 kB 00:00 2024-05-09T02:15:53.062 INFO:teuthology.orchestra.run.smithi046.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-05-09T02:15:53.114 INFO:teuthology.orchestra.run.smithi107.stdout:(30/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 3.4 MB/s | 18 MB 00:05 2024-05-09T02:15:53.279 INFO:teuthology.orchestra.run.smithi046.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 4.1 MB/s | 911 kB 00:00 2024-05-09T02:15:53.344 INFO:teuthology.orchestra.run.smithi046.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-09T02:15:53.356 INFO:teuthology.orchestra.run.smithi107.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 5.7 MB/s | 3.5 MB 00:00 2024-05-09T02:15:53.431 INFO:teuthology.orchestra.run.smithi107.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 3.6 MB/s | 274 kB 00:00 2024-05-09T02:15:53.498 INFO:teuthology.orchestra.run.smithi107.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 739 kB/s | 49 kB 00:00 2024-05-09T02:15:53.556 INFO:teuthology.orchestra.run.smithi107.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 281 kB/s | 16 kB 00:00 2024-05-09T02:15:53.574 INFO:teuthology.orchestra.run.smithi046.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.7 MB/s | 4.7 MB 00:01 2024-05-09T02:15:53.635 INFO:teuthology.orchestra.run.smithi107.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 3.6 MB/s | 273 kB 00:00 2024-05-09T02:15:53.764 INFO:teuthology.orchestra.run.smithi046.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-05-09T02:15:53.799 INFO:teuthology.orchestra.run.smithi107.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-09T02:15:53.822 INFO:teuthology.orchestra.run.smithi046.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-09T02:15:53.867 INFO:teuthology.orchestra.run.smithi107.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 274 kB/s | 18 kB 00:00 2024-05-09T02:15:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:(73/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-05-09T02:15:54.024 INFO:teuthology.orchestra.run.smithi107.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-05-09T02:15:54.073 INFO:teuthology.orchestra.run.smithi046.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-09T02:15:54.156 INFO:teuthology.orchestra.run.smithi046.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-05-09T02:15:54.207 INFO:teuthology.orchestra.run.smithi046.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-05-09T02:15:54.258 INFO:teuthology.orchestra.run.smithi107.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-05-09T02:15:54.265 INFO:teuthology.orchestra.run.smithi046.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-05-09T02:15:54.332 INFO:teuthology.orchestra.run.smithi046.stdout:(78/156): postgresql-server-13.14-1.el9.x86_64. 5.8 MB/s | 5.8 MB 00:00 2024-05-09T02:15:54.341 INFO:teuthology.orchestra.run.smithi107.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-05-09T02:15:54.357 INFO:teuthology.orchestra.run.smithi046.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-05-09T02:15:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-05-09T02:15:54.425 INFO:teuthology.orchestra.run.smithi107.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-09T02:15:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-09T02:15:54.508 INFO:teuthology.orchestra.run.smithi046.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-05-09T02:15:54.567 INFO:teuthology.orchestra.run.smithi046.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-09T02:15:54.642 INFO:teuthology.orchestra.run.smithi046.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 42 kB 00:00 2024-05-09T02:15:54.717 INFO:teuthology.orchestra.run.smithi046.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.7 MB/s | 6.0 MB 00:00 2024-05-09T02:15:54.742 INFO:teuthology.orchestra.run.smithi107.stdout:(42/156): ceph-mgr-diskprediction-local-19.0.0- 4.6 MB/s | 7.4 MB 00:01 2024-05-09T02:15:54.767 INFO:teuthology.orchestra.run.smithi046.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-05-09T02:15:54.793 INFO:teuthology.orchestra.run.smithi046.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-09T02:15:54.809 INFO:teuthology.orchestra.run.smithi107.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-05-09T02:15:54.843 INFO:teuthology.orchestra.run.smithi046.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-09T02:15:54.868 INFO:teuthology.orchestra.run.smithi107.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-09T02:15:54.869 INFO:teuthology.orchestra.run.smithi046.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-05-09T02:15:54.894 INFO:teuthology.orchestra.run.smithi046.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-09T02:15:54.926 INFO:teuthology.orchestra.run.smithi107.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-09T02:15:54.944 INFO:teuthology.orchestra.run.smithi046.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-05-09T02:15:54.951 INFO:teuthology.orchestra.run.smithi107.stdout:(46/156): python3-ply-3.11-14.el9.noarch.rpm 509 kB/s | 106 kB 00:00 2024-05-09T02:15:55.002 INFO:teuthology.orchestra.run.smithi046.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-05-09T02:15:55.010 INFO:teuthology.orchestra.run.smithi107.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-09T02:15:55.103 INFO:teuthology.orchestra.run.smithi046.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.8 MB/s | 5.1 MB 00:00 2024-05-09T02:15:55.128 INFO:teuthology.orchestra.run.smithi046.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-05-09T02:15:55.162 INFO:teuthology.orchestra.run.smithi046.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-05-09T02:15:55.212 INFO:teuthology.orchestra.run.smithi046.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-05-09T02:15:55.271 INFO:teuthology.orchestra.run.smithi046.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-05-09T02:15:55.296 INFO:teuthology.orchestra.run.smithi046.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-05-09T02:15:55.330 INFO:teuthology.orchestra.run.smithi046.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-09T02:15:55.355 INFO:teuthology.orchestra.run.smithi046.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-09T02:15:55.389 INFO:teuthology.orchestra.run.smithi046.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-05-09T02:15:55.531 INFO:teuthology.orchestra.run.smithi046.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-05-09T02:15:55.623 INFO:teuthology.orchestra.run.smithi046.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-05-09T02:15:55.710 INFO:teuthology.orchestra.run.smithi107.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 908 kB/s | 689 kB 00:00 2024-05-09T02:15:56.203 INFO:teuthology.orchestra.run.smithi107.stdout:(49/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 5.8 MB/s | 43 MB 00:07 2024-05-09T02:15:56.228 INFO:teuthology.orchestra.run.smithi107.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 207 kB/s | 107 kB 00:00 2024-05-09T02:15:56.239 INFO:teuthology.orchestra.run.smithi046.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 774 kB/s | 548 kB 00:00 2024-05-09T02:15:56.261 INFO:teuthology.orchestra.run.smithi107.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 754 kB/s | 943 kB 00:01 2024-05-09T02:15:56.337 INFO:teuthology.orchestra.run.smithi107.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-09T02:15:56.353 INFO:teuthology.orchestra.run.smithi107.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-05-09T02:15:56.440 INFO:teuthology.orchestra.run.smithi046.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 392 kB/s | 309 kB 00:00 2024-05-09T02:15:56.454 INFO:teuthology.orchestra.run.smithi107.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-05-09T02:15:56.465 INFO:teuthology.orchestra.run.smithi046.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 86 kB/s | 19 kB 00:00 2024-05-09T02:15:56.479 INFO:teuthology.orchestra.run.smithi107.stdout:(55/156): elfutils-libelf-devel-0.190-2.el9.x86 78 kB/s | 21 kB 00:00 2024-05-09T02:15:56.554 INFO:teuthology.orchestra.run.smithi107.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-05-09T02:15:56.640 INFO:teuthology.orchestra.run.smithi046.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 148 kB/s | 26 kB 00:00 2024-05-09T02:15:56.654 INFO:teuthology.orchestra.run.smithi107.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-05-09T02:15:56.721 INFO:teuthology.orchestra.run.smithi107.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.8 MB/s | 3.0 MB 00:00 2024-05-09T02:15:56.838 INFO:teuthology.orchestra.run.smithi107.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 446 kB/s | 160 kB 00:00 2024-05-09T02:15:56.872 INFO:teuthology.orchestra.run.smithi107.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-05-09T02:15:56.874 INFO:teuthology.orchestra.run.smithi046.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-05-09T02:15:56.899 INFO:teuthology.orchestra.run.smithi046.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 189 kB/s | 49 kB 00:00 2024-05-09T02:15:56.931 INFO:teuthology.orchestra.run.smithi107.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-05-09T02:15:56.956 INFO:teuthology.orchestra.run.smithi107.stdout:(62/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 217 kB/s | 25 kB 00:00 2024-05-09T02:15:56.974 INFO:teuthology.orchestra.run.smithi046.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 674 kB/s | 67 kB 00:00 2024-05-09T02:15:56.981 INFO:teuthology.orchestra.run.smithi107.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-05-09T02:15:57.040 INFO:teuthology.orchestra.run.smithi107.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-09T02:15:57.049 INFO:teuthology.orchestra.run.smithi046.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-05-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi107.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 352 kB/s | 35 kB 00:00 2024-05-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi046.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-05-09T02:15:57.140 INFO:teuthology.orchestra.run.smithi107.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-05-09T02:15:57.200 INFO:teuthology.orchestra.run.smithi046.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-05-09T02:15:57.225 INFO:teuthology.orchestra.run.smithi046.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 325 kB/s | 43 kB 00:00 2024-05-09T02:15:57.418 INFO:teuthology.orchestra.run.smithi046.stdout:(115/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-05-09T02:15:57.443 INFO:teuthology.orchestra.run.smithi046.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 133 kB/s | 32 kB 00:00 2024-05-09T02:15:57.468 INFO:teuthology.orchestra.run.smithi046.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 62 kB/s | 15 kB 00:00 2024-05-09T02:15:57.507 INFO:teuthology.orchestra.run.smithi107.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-05-09T02:15:57.526 INFO:teuthology.orchestra.run.smithi046.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-05-09T02:15:57.585 INFO:teuthology.orchestra.run.smithi046.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-05-09T02:15:57.610 INFO:teuthology.orchestra.run.smithi046.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-05-09T02:15:57.624 INFO:teuthology.orchestra.run.smithi107.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-05-09T02:15:57.644 INFO:teuthology.orchestra.run.smithi046.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 301 kB/s | 35 kB 00:00 2024-05-09T02:15:57.694 INFO:teuthology.orchestra.run.smithi046.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-05-09T02:15:57.733 INFO:teuthology.orchestra.run.smithi107.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-09T02:15:57.761 INFO:teuthology.orchestra.run.smithi046.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-09T02:15:57.786 INFO:teuthology.orchestra.run.smithi046.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-05-09T02:15:57.845 INFO:teuthology.orchestra.run.smithi046.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 72 kB/s | 11 kB 00:00 2024-05-09T02:15:57.987 INFO:teuthology.orchestra.run.smithi046.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 78 kB/s | 18 kB 00:00 2024-05-09T02:15:58.012 INFO:teuthology.orchestra.run.smithi046.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 102 kB/s | 23 kB 00:00 2024-05-09T02:15:58.029 INFO:teuthology.orchestra.run.smithi046.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 106 kB/s | 19 kB 00:00 2024-05-09T02:15:58.080 INFO:teuthology.orchestra.run.smithi046.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-05-09T02:15:58.155 INFO:teuthology.orchestra.run.smithi046.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-05-09T02:15:58.180 INFO:teuthology.orchestra.run.smithi046.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-05-09T02:15:58.205 INFO:teuthology.orchestra.run.smithi046.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 628 kB/s | 79 kB 00:00 2024-05-09T02:15:58.256 INFO:teuthology.orchestra.run.smithi046.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-05-09T02:15:58.314 INFO:teuthology.orchestra.run.smithi046.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-09T02:15:58.339 INFO:teuthology.orchestra.run.smithi046.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2024-05-09T02:15:58.365 INFO:teuthology.orchestra.run.smithi046.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-05-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi046.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-05-09T02:15:58.440 INFO:teuthology.orchestra.run.smithi046.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-05-09T02:15:58.465 INFO:teuthology.orchestra.run.smithi046.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-09T02:15:58.518 INFO:teuthology.orchestra.run.smithi046.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-05-09T02:15:58.541 INFO:teuthology.orchestra.run.smithi046.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-05-09T02:15:58.566 INFO:teuthology.orchestra.run.smithi046.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 506 kB/s | 51 kB 00:00 2024-05-09T02:15:58.625 INFO:teuthology.orchestra.run.smithi046.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-09T02:15:58.650 INFO:teuthology.orchestra.run.smithi046.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-05-09T02:15:58.675 INFO:teuthology.orchestra.run.smithi046.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-05-09T02:15:58.726 INFO:teuthology.orchestra.run.smithi046.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-05-09T02:15:58.759 INFO:teuthology.orchestra.run.smithi046.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-05-09T02:15:58.818 INFO:teuthology.orchestra.run.smithi046.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-09T02:15:59.193 INFO:teuthology.orchestra.run.smithi046.stdout:(149/156): librados2-19.0.0-3594.gc9da4049.el9. 7.1 MB/s | 3.3 MB 00:00 2024-05-09T02:15:59.285 INFO:teuthology.orchestra.run.smithi046.stdout:(150/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 5.9 MB/s | 3.1 MB 00:00 2024-05-09T02:15:59.327 INFO:teuthology.orchestra.run.smithi046.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 4.5 MB/s | 2.3 MB 00:00 2024-05-09T02:15:59.386 INFO:teuthology.orchestra.run.smithi046.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-09T02:15:59.411 INFO:teuthology.orchestra.run.smithi046.stdout:(153/156): NetworkManager-team-1.47.5-1.el9.x86 333 kB/s | 42 kB 00:00 2024-05-09T02:15:59.524 INFO:teuthology.orchestra.run.smithi107.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.9 MB/s | 4.7 MB 00:02 2024-05-09T02:15:59.594 INFO:teuthology.orchestra.run.smithi046.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 1.3 MB 00:00 2024-05-09T02:15:59.636 INFO:teuthology.orchestra.run.smithi046.stdout:(155/156): NetworkManager-libnm-1.47.5-1.el9.x8 4.1 MB/s | 1.8 MB 00:00 2024-05-09T02:15:59.828 INFO:teuthology.orchestra.run.smithi046.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.7 MB/s | 2.4 MB 00:00 2024-05-09T02:15:59.833 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T02:15:59.834 INFO:teuthology.orchestra.run.smithi046.stdout:Total 13 MB/s | 219 MB 00:17 2024-05-09T02:16:00.916 INFO:teuthology.orchestra.run.smithi107.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 743 kB/s | 1.0 MB 00:01 2024-05-09T02:16:01.059 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T02:16:01.100 INFO:teuthology.orchestra.run.smithi107.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-05-09T02:16:01.226 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T02:16:01.226 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T02:16:03.041 INFO:teuthology.orchestra.run.smithi107.stdout:(73/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 760 kB/s | 4.4 MB 00:05 2024-05-09T02:16:03.158 INFO:teuthology.orchestra.run.smithi107.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-09T02:16:03.442 INFO:teuthology.orchestra.run.smithi107.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-05-09T02:16:03.457 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T02:16:03.458 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T02:16:03.468 INFO:teuthology.orchestra.run.smithi107.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 802 kB/s | 248 kB 00:00 2024-05-09T02:16:03.560 INFO:teuthology.orchestra.run.smithi107.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-05-09T02:16:03.593 INFO:teuthology.orchestra.run.smithi107.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-05-09T02:16:03.671 INFO:teuthology.orchestra.run.smithi107.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-05-09T02:16:03.694 INFO:teuthology.orchestra.run.smithi107.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-05-09T02:16:04.061 INFO:teuthology.orchestra.run.smithi107.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 684 kB/s | 250 kB 00:00 2024-05-09T02:16:04.403 INFO:teuthology.orchestra.run.smithi107.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 650 kB/s | 222 kB 00:00 2024-05-09T02:16:04.595 INFO:teuthology.orchestra.run.smithi107.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 403 kB/s | 77 kB 00:00 2024-05-09T02:16:04.703 INFO:teuthology.orchestra.run.smithi107.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-05-09T02:16:04.920 INFO:teuthology.orchestra.run.smithi107.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 1.2 MB/s | 269 kB 00:00 2024-05-09T02:16:05.029 INFO:teuthology.orchestra.run.smithi107.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-09T02:16:05.354 INFO:teuthology.orchestra.run.smithi107.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 858 kB/s | 279 kB 00:00 2024-05-09T02:16:05.463 INFO:teuthology.orchestra.run.smithi107.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-05-09T02:16:05.571 INFO:teuthology.orchestra.run.smithi107.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-05-09T02:16:08.288 INFO:teuthology.orchestra.run.smithi107.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-05-09T02:16:08.522 INFO:teuthology.orchestra.run.smithi107.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 178 kB/s | 42 kB 00:00 2024-05-09T02:16:08.597 INFO:teuthology.orchestra.run.smithi107.stdout:(92/156): python3-babel-2.9.1-2.el9.noarch.rpm 814 kB/s | 6.0 MB 00:07 2024-05-09T02:16:08.614 INFO:teuthology.orchestra.run.smithi107.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 480 kB/s | 44 kB 00:00 2024-05-09T02:16:08.723 INFO:teuthology.orchestra.run.smithi107.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-05-09T02:16:08.824 INFO:teuthology.orchestra.run.smithi107.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 475 kB/s | 47 kB 00:00 2024-05-09T02:16:08.957 INFO:teuthology.orchestra.run.smithi107.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 615 kB/s | 221 kB 00:00 2024-05-09T02:16:09.057 INFO:teuthology.orchestra.run.smithi107.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 577 kB/s | 58 kB 00:00 2024-05-09T02:16:09.241 INFO:teuthology.orchestra.run.smithi107.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 511 kB/s | 94 kB 00:00 2024-05-09T02:16:09.266 INFO:teuthology.orchestra.run.smithi107.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 689 kB/s | 305 kB 00:00 2024-05-09T02:16:09.366 INFO:teuthology.orchestra.run.smithi107.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-05-09T02:16:09.417 INFO:teuthology.orchestra.run.smithi107.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 448 kB/s | 22 kB 00:00 2024-05-09T02:16:09.442 INFO:teuthology.orchestra.run.smithi107.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 317 kB/s | 64 kB 00:00 2024-05-09T02:16:09.527 INFO:teuthology.orchestra.run.smithi107.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-05-09T02:16:09.615 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T02:16:09.709 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T02:16:09.734 INFO:teuthology.orchestra.run.smithi107.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-05-09T02:16:09.755 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T02:16:09.777 INFO:teuthology.orchestra.run.smithi107.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 466 kB/s | 19 kB 00:00 2024-05-09T02:16:09.838 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T02:16:09.876 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T02:16:09.901 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T02:16:09.955 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T02:16:10.318 INFO:teuthology.orchestra.run.smithi107.stdout:(106/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-05-09T02:16:10.352 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T02:16:10.360 INFO:teuthology.orchestra.run.smithi107.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-05-09T02:16:10.402 INFO:teuthology.orchestra.run.smithi107.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 352 kB/s | 309 kB 00:00 2024-05-09T02:16:10.418 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T02:16:10.427 INFO:teuthology.orchestra.run.smithi107.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-05-09T02:16:10.469 INFO:teuthology.orchestra.run.smithi107.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-05-09T02:16:10.611 INFO:teuthology.orchestra.run.smithi107.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-05-09T02:16:10.678 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T02:16:10.702 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T02:16:10.703 INFO:teuthology.orchestra.run.smithi107.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-05-09T02:16:10.728 INFO:teuthology.orchestra.run.smithi107.stdout:(113/156): libunwind-1.6.2-1.el9.x86_64.rpm 207 kB/s | 67 kB 00:00 2024-05-09T02:16:10.753 INFO:teuthology.orchestra.run.smithi107.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-05-09T02:16:10.795 INFO:teuthology.orchestra.run.smithi107.stdout:(115/156): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-05-09T02:16:10.804 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T02:16:10.833 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T02:16:10.837 INFO:teuthology.orchestra.run.smithi107.stdout:(116/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-05-09T02:16:10.904 INFO:teuthology.orchestra.run.smithi107.stdout:(117/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-05-09T02:16:10.971 INFO:teuthology.orchestra.run.smithi107.stdout:(118/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-05-09T02:16:11.030 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T02:16:11.038 INFO:teuthology.orchestra.run.smithi107.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 529 kB/s | 35 kB 00:00 2024-05-09T02:16:11.090 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T02:16:11.097 INFO:teuthology.orchestra.run.smithi107.stdout:(120/156): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-05-09T02:16:11.115 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T02:16:11.229 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T02:16:11.257 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T02:16:11.305 INFO:teuthology.orchestra.run.smithi107.stdout:(121/156): python3-cachetools-4.2.4-1.el9.noarc 56 kB/s | 32 kB 00:00 2024-05-09T02:16:11.312 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T02:16:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T02:16:11.366 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T02:16:11.381 INFO:teuthology.orchestra.run.smithi107.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.2 MB/s | 2.0 MB 00:00 2024-05-09T02:16:11.423 INFO:teuthology.orchestra.run.smithi107.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-05-09T02:16:11.465 INFO:teuthology.orchestra.run.smithi107.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 426 kB/s | 18 kB 00:00 2024-05-09T02:16:11.507 INFO:teuthology.orchestra.run.smithi107.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 556 kB/s | 23 kB 00:00 2024-05-09T02:16:11.549 INFO:teuthology.orchestra.run.smithi107.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 467 kB/s | 19 kB 00:00 2024-05-09T02:16:11.569 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T02:16:11.591 INFO:teuthology.orchestra.run.smithi107.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 472 kB/s | 20 kB 00:00 2024-05-09T02:16:11.699 INFO:teuthology.orchestra.run.smithi107.stdout:(128/156): python3-grpcio-tools-1.46.7-10.el9.x 367 kB/s | 144 kB 00:00 2024-05-09T02:16:11.736 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T02:16:11.758 INFO:teuthology.orchestra.run.smithi107.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-05-09T02:16:11.800 INFO:teuthology.orchestra.run.smithi107.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-05-09T02:16:11.851 INFO:teuthology.orchestra.run.smithi107.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-09T02:16:11.872 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T02:16:11.909 INFO:teuthology.orchestra.run.smithi107.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-05-09T02:16:11.926 INFO:teuthology.orchestra.run.smithi107.stdout:(133/156): python3-logutils-0.3.5-21.el9.noarch 204 kB/s | 46 kB 00:00 2024-05-09T02:16:11.932 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T02:16:11.943 INFO:teuthology.orchestra.run.smithi107.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 489 kB/s | 16 kB 00:00 2024-05-09T02:16:11.976 INFO:teuthology.orchestra.run.smithi107.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 849 kB/s | 28 kB 00:00 2024-05-09T02:16:12.010 INFO:teuthology.orchestra.run.smithi107.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 925 kB/s | 31 kB 00:00 2024-05-09T02:16:12.052 INFO:teuthology.orchestra.run.smithi107.stdout:(137/156): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-05-09T02:16:12.052 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T02:16:12.094 INFO:teuthology.orchestra.run.smithi107.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-05-09T02:16:12.117 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T02:16:12.127 INFO:teuthology.orchestra.run.smithi107.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-05-09T02:16:12.169 INFO:teuthology.orchestra.run.smithi107.stdout:(140/156): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-05-09T02:16:12.320 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T02:16:12.328 INFO:teuthology.orchestra.run.smithi107.stdout:(141/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 224 kB/s | 90 kB 00:00 2024-05-09T02:16:12.362 INFO:teuthology.orchestra.run.smithi107.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-05-09T02:16:12.437 INFO:teuthology.orchestra.run.smithi107.stdout:(143/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-05-09T02:16:12.446 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T02:16:12.479 INFO:teuthology.orchestra.run.smithi107.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 481 kB/s | 20 kB 00:00 2024-05-09T02:16:12.537 INFO:teuthology.orchestra.run.smithi107.stdout:(145/156): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-09T02:16:12.616 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T02:16:12.657 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T02:16:12.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T02:16:12.746 INFO:teuthology.orchestra.run.smithi107.stdout:(146/156): python3-websocket-client-1.2.3-2.el9 215 kB/s | 90 kB 00:00 2024-05-09T02:16:12.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T02:16:12.817 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T02:16:12.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T02:16:12.880 INFO:teuthology.orchestra.run.smithi107.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-05-09T02:16:12.885 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T02:16:12.958 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T02:16:13.008 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T02:16:13.037 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T02:16:13.082 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T02:16:13.160 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T02:16:13.192 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T02:16:13.236 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T02:16:13.264 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T02:16:13.338 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T02:16:13.388 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T02:16:13.466 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T02:16:13.610 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T02:16:13.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T02:16:13.813 INFO:teuthology.orchestra.run.smithi107.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:08 2024-05-09T02:16:13.989 INFO:teuthology.orchestra.run.smithi107.stdout:(149/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 2.8 MB/s | 3.1 MB 00:01 2024-05-09T02:16:14.081 INFO:teuthology.orchestra.run.smithi107.stdout:(150/156): librados2-19.0.0-3594.gc9da4049.el9. 2.5 MB/s | 3.3 MB 00:01 2024-05-09T02:16:14.206 INFO:teuthology.orchestra.run.smithi107.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-05-09T02:16:14.264 INFO:teuthology.orchestra.run.smithi107.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 278 kB/s | 42 kB 00:00 2024-05-09T02:16:14.265 INFO:teuthology.orchestra.run.smithi107.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-09T02:16:14.317 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi107.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-05-09T02:16:14.413 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T02:16:14.447 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T02:16:14.491 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T02:16:14.571 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T02:16:14.607 INFO:teuthology.orchestra.run.smithi107.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 1.3 MB 00:00 2024-05-09T02:16:14.657 INFO:teuthology.orchestra.run.smithi107.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.1 MB/s | 2.4 MB 00:00 2024-05-09T02:16:14.660 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-09T02:16:14.660 INFO:teuthology.orchestra.run.smithi107.stdout:Total 7.2 MB/s | 219 MB 00:30 2024-05-09T02:16:14.743 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T02:16:14.790 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T02:16:14.885 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T02:16:14.947 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T02:16:15.021 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T02:16:15.057 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T02:16:15.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T02:16:15.362 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T02:16:15.395 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T02:16:15.439 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T02:16:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T02:16:15.627 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T02:16:15.676 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T02:16:15.706 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T02:16:15.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T02:16:15.845 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T02:16:15.880 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-05-09T02:16:15.881 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T02:16:15.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T02:16:15.955 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T02:16:15.979 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T02:16:16.032 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-05-09T02:16:16.032 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-05-09T02:16:16.098 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T02:16:16.235 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T02:16:16.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T02:16:16.299 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T02:16:16.333 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T02:16:16.372 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T02:16:16.403 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T02:16:16.433 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T02:16:16.468 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T02:16:16.501 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T02:16:16.546 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T02:16:16.577 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T02:16:16.676 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T02:16:16.725 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T02:16:16.755 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T02:16:16.802 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T02:16:16.903 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T02:16:16.957 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T02:16:17.716 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T02:16:17.762 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T02:16:17.795 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T02:16:17.897 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T02:16:17.962 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T02:16:18.052 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T02:16:18.089 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T02:16:18.148 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-05-09T02:16:18.148 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-05-09T02:16:18.273 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T02:16:18.303 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T02:16:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T02:16:19.074 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T02:16:19.188 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T02:16:20.508 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T02:16:20.589 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T02:16:20.617 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T02:16:20.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T02:16:20.984 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T02:16:21.030 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T02:16:21.121 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T02:16:21.151 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T02:16:21.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T02:16:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T02:16:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T02:16:21.788 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T02:16:21.818 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T02:16:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T02:16:24.180 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T02:16:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-05-09T02:16:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T02:16:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T02:16:24.430 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T02:16:24.470 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T02:16:24.504 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T02:16:24.555 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T02:16:24.771 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T02:16:24.809 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T02:16:24.918 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T02:16:24.918 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T02:16:24.918 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T02:16:24.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:24.963 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T02:16:24.968 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T02:16:25.030 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T02:16:25.139 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T02:16:25.164 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T02:16:25.238 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T02:16:25.269 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T02:16:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T02:16:25.499 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T02:16:25.526 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T02:16:25.640 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T02:16:25.669 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T02:16:25.732 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T02:16:25.762 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T02:16:25.785 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T02:16:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T02:16:26.101 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T02:16:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T02:16:26.328 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T02:16:26.450 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T02:16:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T02:16:26.731 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T02:16:26.843 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T02:16:26.899 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T02:16:26.935 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T02:16:26.999 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T02:16:27.035 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T02:16:27.078 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T02:16:27.111 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T02:16:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T02:16:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T02:16:27.260 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T02:16:27.292 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T02:16:27.335 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T02:16:27.411 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T02:16:27.446 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T02:16:27.489 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T02:16:27.518 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T02:16:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T02:16:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T02:16:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T02:16:27.838 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T02:16:27.885 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T02:16:28.404 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T02:16:28.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T02:16:28.510 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T02:16:28.537 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T02:16:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T02:16:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T02:16:28.801 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T02:16:28.860 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T02:16:28.952 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T02:16:29.025 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T02:16:29.097 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T02:16:29.128 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T02:16:29.166 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T02:16:29.212 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T02:16:29.248 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T02:16:29.291 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T02:16:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T02:16:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T02:16:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T02:16:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T02:16:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T02:16:29.681 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T02:16:29.721 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T02:16:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T02:16:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T02:16:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T02:16:29.897 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T02:16:30.028 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T02:16:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T02:16:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T02:16:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T02:16:30.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T02:16:30.208 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T02:16:30.238 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T02:16:30.273 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T02:16:30.306 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T02:16:30.347 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T02:16:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T02:16:30.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T02:16:30.725 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T02:16:30.827 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T02:16:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T02:16:30.971 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T02:16:31.037 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T02:16:31.746 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T02:16:31.793 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T02:16:31.826 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T02:16:31.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T02:16:31.975 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T02:16:32.062 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T02:16:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T02:16:32.270 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T02:16:32.294 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T02:16:32.381 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T02:16:33.022 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T02:16:33.132 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T02:16:34.372 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T02:16:34.447 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T02:16:34.474 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T02:16:34.508 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T02:16:34.822 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T02:16:34.862 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T02:16:34.953 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T02:16:34.984 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T02:16:35.026 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T02:16:35.514 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T02:16:35.541 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T02:16:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T02:16:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-05-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-05-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-05-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-05-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-05-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-05-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-05-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:37.033 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T02:16:37.050 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T02:16:37.051 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:37.051 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T02:16:37.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:37.909 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T02:16:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T02:16:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T02:16:38.641 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T02:16:38.641 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T02:16:38.642 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T02:16:38.642 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:38.677 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T02:16:38.703 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T02:16:38.731 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T02:16:38.732 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:38.732 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T02:16:38.732 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T02:16:38.732 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T02:16:38.732 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:39.471 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T02:16:39.496 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T02:16:39.496 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:39.496 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T02:16:39.496 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T02:16:39.496 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T02:16:39.497 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:39.602 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T02:16:39.660 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T02:16:39.723 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T02:16:39.916 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T02:16:39.964 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T02:16:40.043 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T02:16:40.133 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T02:16:40.274 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T02:16:40.320 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T02:16:40.354 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T02:16:40.381 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T02:16:40.852 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T02:16:40.879 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T02:16:40.912 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T02:16:40.976 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T02:16:41.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T02:16:42.094 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T02:16:42.121 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T02:16:43.137 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T02:16:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T02:16:43.307 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T02:16:43.480 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T02:16:43.506 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T02:16:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T02:16:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T02:16:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T02:16:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T02:16:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:43.582 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T02:16:43.594 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T02:16:43.696 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T02:16:43.754 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T02:16:44.859 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T02:16:44.859 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:44.859 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T02:16:44.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:44.911 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T02:16:44.936 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T02:16:44.936 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:44.936 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T02:16:44.936 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T02:16:44.936 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T02:16:44.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:45.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T02:16:45.286 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T02:16:45.286 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:45.287 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T02:16:45.287 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T02:16:45.287 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T02:16:45.287 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:16:49.807 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T02:16:49.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T02:16:50.184 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T02:16:50.236 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T02:16:50.274 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T02:16:50.304 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-05-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T02:16:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T02:16:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T02:16:50.532 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:50.532 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T02:16:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:50.979 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T02:16:51.024 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T02:16:51.044 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T02:16:51.934 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T02:16:52.027 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T02:16:52.075 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T02:16:52.118 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T02:16:52.146 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T02:16:52.146 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:52.146 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T02:16:52.146 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T02:16:52.146 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T02:16:52.146 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:52.172 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T02:16:52.205 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T02:16:52.231 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T02:16:52.231 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T02:16:52.315 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T02:16:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T02:16:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T02:16:52.377 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T02:16:52.401 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T02:16:52.401 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:52.401 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T02:16:52.401 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T02:16:52.401 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T02:16:52.401 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:52.433 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T02:16:52.457 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T02:16:52.468 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T02:16:52.468 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T02:16:52.660 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T02:16:52.660 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T02:16:52.744 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T02:16:52.812 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T02:16:52.861 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T02:16:52.885 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T02:16:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T02:16:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T02:16:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T02:16:52.886 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:52.993 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T02:16:53.050 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T02:16:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T02:16:53.291 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T02:16:53.339 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T02:16:53.416 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T02:16:53.505 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T02:16:53.644 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T02:16:53.698 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T02:16:53.729 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T02:16:53.757 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T02:16:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T02:16:54.205 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T02:16:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T02:16:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T02:16:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T02:16:55.365 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T02:16:55.396 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T02:16:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T02:16:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T02:16:56.489 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T02:16:56.655 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T02:16:56.682 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T02:16:56.706 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T02:16:56.706 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:56.706 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T02:16:56.707 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T02:16:56.707 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T02:16:56.707 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:56.766 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T02:16:56.778 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T02:16:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T02:16:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T02:16:57.868 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T02:16:57.902 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T02:16:57.925 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T02:16:57.925 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:57.926 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T02:16:57.926 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T02:16:57.926 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T02:16:57.926 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:57.969 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:58.044 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T02:16:58.068 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T02:16:58.068 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:58.068 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T02:16:58.068 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T02:16:58.068 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T02:16:58.068 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T02:16:58.362 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T02:16:58.363 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T02:16:58.364 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T02:16:58.364 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T02:16:58.364 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T02:16:58.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T02:16:58.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T02:16:58.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T02:16:58.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T02:16:58.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T02:16:58.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T02:16:58.379 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T02:16:58.380 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T02:16:58.381 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T02:16:58.382 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T02:16:58.383 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T02:16:58.384 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T02:16:58.385 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T02:16:58.386 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T02:16:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T02:16:58.402 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T02:16:58.402 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T02:16:58.403 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T02:16:58.403 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T02:16:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:01.247 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T02:17:01.247 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:01.247 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-05-09T02:17:01.247 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T02:17:01.248 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.249 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.250 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T02:17:01.251 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T02:17:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T02:17:01.253 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T02:17:01.254 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T02:17:01.255 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T02:17:01.256 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T02:17:01.256 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T02:17:01.256 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T02:17:01.256 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.256 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.256 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T02:17:01.257 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T02:17:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T02:17:01.259 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T02:17:01.260 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T02:17:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T02:17:01.262 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T02:17:01.263 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T02:17:01.264 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T02:17:01.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:01.264 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T02:17:01.639 DEBUG:teuthology.parallel:result is None 2024-05-09T02:17:02.690 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T02:17:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T02:17:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T02:17:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T02:17:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T02:17:03.029 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T02:17:03.077 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T02:17:03.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T02:17:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T02:17:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T02:17:03.756 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T02:17:03.798 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T02:17:03.818 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T02:17:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T02:17:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T02:17:04.794 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T02:17:04.889 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T02:17:04.921 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T02:17:04.947 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T02:17:04.947 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T02:17:05.015 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T02:17:05.056 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T02:17:05.056 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T02:17:05.149 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T02:17:05.174 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T02:17:05.197 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T02:17:05.197 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T02:17:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T02:17:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T02:17:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T02:17:05.509 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T02:17:11.278 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T02:17:11.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T02:17:11.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T02:17:11.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T02:17:11.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T02:17:11.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T02:17:11.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T02:17:11.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T02:17:11.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T02:17:11.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T02:17:11.284 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T02:17:11.285 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T02:17:11.286 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T02:17:11.287 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T02:17:11.288 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T02:17:11.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T02:17:11.290 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T02:17:11.291 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T02:17:11.291 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T02:17:11.291 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T02:17:11.291 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T02:17:11.291 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T02:17:13.735 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.736 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.737 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T02:17:13.738 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T02:17:13.740 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T02:17:13.741 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T02:17:13.742 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T02:17:13.743 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T02:17:13.744 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T02:17:13.745 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.746 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T02:17:13.747 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:13.748 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-09T02:17:14.123 DEBUG:teuthology.parallel:result is None 2024-05-09T02:17:14.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:17:14.271 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T02:17:14.299 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T02:17:14.300 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T02:17:14.300 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T02:17:14.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:17:14.518 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T02:17:14.541 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T02:17:14.541 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T02:17:14.542 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T02:17:14.543 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T02:17:14.544 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:14.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T02:17:14.578 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:14.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T02:17:14.610 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T02:17:14.610 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:14.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T02:17:14.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T02:17:14.719 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:14.719 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T02:17:14.745 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T02:17:14.810 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T02:17:14.810 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:14.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T02:17:14.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T02:17:14.902 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:14.902 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T02:17:14.927 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T02:17:14.992 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T02:17:14.992 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:14.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T02:17:15.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T02:17:15.084 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:15.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T02:17:15.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T02:17:15.174 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T02:17:15.259 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T02:17:15.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-05-09T02:17:15.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-05-09T02:17:15.287 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T02:17:15.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T02:17:15.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T02:17:15.352 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T02:17:15.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T02:17:15.394 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T02:17:15.424 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T02:17:15.424 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T02:17:15.425 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T02:17:15.425 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:15.425 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T02:17:15.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T02:17:15.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T02:17:15.614 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:15.614 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T02:17:15.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T02:17:15.741 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T02:17:15.785 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T02:17:15.785 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T02:17:15.785 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997', 'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698997', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.183908-debug'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1722, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.183908-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzYvgvuXpKbJkOthZRTB8rBBqv3KHYVtapdY792gY/PK1disAQaBZBwlFefz30hMpcJYd/PUGoEZ6Q0krsiNJw=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTngSoeAMgziRmEokVEmaHIQs6AefBZ8OhVQZiSut0L3a4j9GlQaEB3Knc+nGf/cSIlPPkLikGkqAxc6IOBL1g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_22:06:20', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T02:17:15.786 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T02:17:15.788 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T02:17:15.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T02:17:15.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T02:17:15.901 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:15.901 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T02:17:15.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T02:17:15.926 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-05-09T02:17:15.982 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T02:17:15.982 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-09T02:17:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 02:16:53.173890556 +0000 2024-05-09T02:17:15.983 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 02:14:47.105336745 +0000 2024-05-09T02:17:15.983 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 02:14:47.105336745 +0000 2024-05-09T02:17:15.983 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 02:14:47.105336745 +0000 2024-05-09T02:17:15.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T02:17:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T02:17:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T02:17:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 8.6618e-05 s, 5.9 MB/s 2024-05-09T02:17:16.047 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T02:17:16.104 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 02:16:53.174890545 +0000 2024-05-09T02:17:16.160 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 02:14:47.463332776 +0000 2024-05-09T02:17:16.161 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 02:14:47.463332776 +0000 2024-05-09T02:17:16.161 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 02:14:47.463332776 +0000 2024-05-09T02:17:16.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T02:17:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T02:17:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T02:17:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.5259e-05 s, 5.4 MB/s 2024-05-09T02:17:16.225 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T02:17:16.282 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 02:16:53.174890545 +0000 2024-05-09T02:17:16.338 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 02:14:47.833328673 +0000 2024-05-09T02:17:16.339 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 02:14:47.833328673 +0000 2024-05-09T02:17:16.339 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 02:14:47.833328673 +0000 2024-05-09T02:17:16.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T02:17:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T02:17:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T02:17:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 8.6443e-05 s, 5.9 MB/s 2024-05-09T02:17:16.403 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T02:17:16.460 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-05-09T02:17:16.516 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T02:17:16.516 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:16.516 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-09T02:17:16.516 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:16.516 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:16.517 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 02:16:53.174890545 +0000 2024-05-09T02:17:16.517 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 02:14:48.169324948 +0000 2024-05-09T02:17:16.517 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 02:14:48.169324948 +0000 2024-05-09T02:17:16.517 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 02:14:48.169324948 +0000 2024-05-09T02:17:16.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.6886e-05 s, 5.3 MB/s 2024-05-09T02:17:16.582 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T02:17:16.639 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:16.639 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:16.639 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T02:17:16.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T02:17:16.658 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-05-09T02:17:16.715 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T02:17:16.715 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-09 02:17:05.848451965 +0000 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-09 02:14:45.430845747 +0000 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-09 02:14:45.430845747 +0000 2024-05-09T02:17:16.716 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-09 02:14:45.430845747 +0000 2024-05-09T02:17:16.716 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T02:17:16.782 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-09T02:17:16.782 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-09T02:17:16.782 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000197186 s, 2.6 MB/s 2024-05-09T02:17:16.783 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T02:17:16.841 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-09 02:17:05.848451965 +0000 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-09 02:14:45.767840271 +0000 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-09 02:14:45.767840271 +0000 2024-05-09T02:17:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-09 02:14:45.767840271 +0000 2024-05-09T02:17:16.899 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T02:17:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-09T02:17:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-09T02:17:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000191433 s, 2.7 MB/s 2024-05-09T02:17:16.964 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T02:17:17.021 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-09 02:17:05.849451949 +0000 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-09 02:14:46.098834892 +0000 2024-05-09T02:17:17.077 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-09 02:14:46.098834892 +0000 2024-05-09T02:17:17.078 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-09 02:14:46.098834892 +0000 2024-05-09T02:17:17.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T02:17:17.143 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-09T02:17:17.143 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-09T02:17:17.143 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000171876 s, 3.0 MB/s 2024-05-09T02:17:17.143 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T02:17:17.200 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-05-09T02:17:17.255 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-09 02:17:05.849451949 +0000 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-09 02:14:46.418829692 +0000 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-09 02:14:46.418829692 +0000 2024-05-09T02:17:17.256 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-09 02:14:46.418829692 +0000 2024-05-09T02:17:17.256 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T02:17:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-09T02:17:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-09T02:17:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000227488 s, 2.3 MB/s 2024-05-09T02:17:17.320 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T02:17:17.377 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:17.377 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T02:17:17.377 INFO:tasks.ceph:Generating config... 2024-05-09T02:17:17.379 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-09T02:17:17.379 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-09T02:17:17.379 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T02:17:17.379 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T02:17:17.379 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-09T02:17:17.379 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-09T02:17:17.379 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T02:17:17.379 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-09T02:17:17.379 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T02:17:17.379 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-09T02:17:17.379 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-09T02:17:17.379 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T02:17:17.380 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T02:17:17.381 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-09T02:17:17.381 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T02:17:17.381 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T02:17:17.382 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-09T02:17:17.382 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T02:17:17.382 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-09T02:17:17.382 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T02:17:17.382 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-09T02:17:17.382 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T02:17:17.382 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T02:17:17.460 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T02:17:17.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T02:17:17.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T02:17:17.551 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]')] 2024-05-09T02:17:17.551 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-09T02:17:17.552 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:17.552 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T02:17:17.608 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:17.707 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid fbf7bc7e-7778-49a9-881a-45aca90d45c0 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:fsid fbf7bc7e-7778-49a9-881a-45aca90d45c0 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-05-09T02:17:17.706529+0000 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T02:17:17.706529+0000 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-05-09T02:17:17.708 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T02:17:17.710 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T02:17:17.725 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fbf7bc7e-7778-49a9-881a-45aca90d45c0... 2024-05-09T02:17:17.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T02:17:17.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T02:17:17.810 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-05-09T02:17:17.810 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-05-09T02:17:17.810 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T02:17:17.810 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-05-09T02:17:17.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.810 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.811 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-05-09T02:17:17.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-05-09T02:17:17.813 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = fbf7bc7e-7778-49a9-881a-45aca90d45c0 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-05-09T02:17:17.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2024-05-09T02:17:17.816 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2024-05-09T02:17:17.817 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-05-09T02:17:17.817 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-05-09T02:17:17.817 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2024-05-09T02:17:17.817 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2024-05-09T02:17:17.817 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-09T02:17:17.817 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd blocked scrub grace period = 3600 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd max markdown count = 1000 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.818 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-05-09T02:17:17.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.820 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-05-09T02:17:17.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon down mkfs grace = 300 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T02:17:17.822 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-05-09T02:17:17.823 INFO:teuthology.orchestra.run.smithi046.stdout: client_shutdown_timeout = 120 2024-05-09T02:17:17.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-05-09T02:17:17.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-09T02:17:17.823 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-05-09T02:17:17.823 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-05-09T02:17:17.823 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: mds bal fragment size max = 10000 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: mds bal merge size = 5 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: mds bal split bits = 3 2024-05-09T02:17:17.824 INFO:teuthology.orchestra.run.smithi046.stdout: mds bal split size = 100 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-05-09T02:17:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-05-09T02:17:17.826 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-05-09T02:17:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-05-09T02:17:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.46,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = fbf7bc7e-7778-49a9-881a-45aca90d45c0 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-05-09T02:17:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-05-09T02:17:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: osd blocked scrub grace period = 3600 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: osd max markdown count = 1000 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-09T02:17:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-09T02:17:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: mon down mkfs grace = 300 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: client_shutdown_timeout = 120 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-09T02:17:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: mds bal fragment size max = 10000 2024-05-09T02:17:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: mds bal merge size = 5 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: mds bal split bits = 3 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: mds bal split size = 100 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-09T02:17:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-09T02:17:17.838 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T02:17:17.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T02:17:17.933 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T02:17:17.933 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:17.934 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T02:17:17.949 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:17.949 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T02:17:18.005 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:17:18.006 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:18.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T02:17:18.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T02:17:18.082 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:18.082 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:18.138 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:17:18.138 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:18.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T02:17:18.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T02:17:18.174 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:18.174 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:18.229 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T02:17:18.229 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T02:17:18.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T02:17:18.292 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T02:17:18.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T02:17:18.365 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T02:17:18.370 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T02:17:18.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T02:17:18.433 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T02:17:18.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T02:17:18.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T02:17:18.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-09T02:17:18.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T02:17:18.654 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T02:17:18.657 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T02:17:18.681 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T02:17:18.782 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T02:17:18.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-09T02:17:18.810 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T02:17:18.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T02:17:18.862 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T02:17:18.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T02:17:18.926 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-09T02:17:18.939 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T02:17:18.940 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T02:17:18.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T02:17:18.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:18.966 INFO:tasks.ceph:role: osd.0 2024-05-09T02:17:18.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:17:18.966 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T02:17:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:19.064 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-05-09T02:17:19.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-05-09T02:17:19.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T02:17:19.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T02:17:19.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T02:17:19.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:19.273 INFO:tasks.ceph:role: osd.1 2024-05-09T02:17:19.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:17:19.273 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T02:17:19.338 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:19.338 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:19.338 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:19.339 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-05-09T02:17:19.373 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-05-09T02:17:19.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T02:17:19.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T02:17:19.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T02:17:19.579 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:19.579 INFO:tasks.ceph:role: osd.2 2024-05-09T02:17:19.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:17:19.579 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T02:17:19.644 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:19.645 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:19.677 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-05-09T02:17:19.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-05-09T02:17:19.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T02:17:19.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T02:17:19.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T02:17:19.884 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:19.884 INFO:tasks.ceph:role: osd.3 2024-05-09T02:17:19.884 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:17:19.884 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T02:17:19.949 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:19.949 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:19.949 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:19.949 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:19.950 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:19.950 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:19.950 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:19.950 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:19.950 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:19.950 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:19.982 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-05-09T02:17:19.984 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-05-09T02:17:19.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T02:17:20.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T02:17:20.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:20.234+0000 7f5670022640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T02:17:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:20.234+0000 7f5670022640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T02:17:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:20.234+0000 7f5670022640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T02:17:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:20.234+0000 7f5670022640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T02:17:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:20.234+0000 7f5670022640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T02:17:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:20.234+0000 7f5670022640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T02:17:23.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T02:17:23.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:23.219+0000 7f6f2d3be640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T02:17:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:23.219+0000 7f6f2d3be640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T02:17:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:23.219+0000 7f6f2d3be640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T02:17:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:23.219+0000 7f6f2d3be640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T02:17:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:23.219+0000 7f6f2d3be640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T02:17:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:23.219+0000 7f6f2d3be640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T02:17:26.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T02:17:26.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:26.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:26.209+0000 7f6b3542e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T02:17:26.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:26.209+0000 7f6b3542e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T02:17:26.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:26.209+0000 7f6b3542e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T02:17:26.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:26.209+0000 7f6b3542e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T02:17:26.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:26.209+0000 7f6b3542e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T02:17:26.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:26.210+0000 7f6b3542e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T02:17:29.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T02:17:29.095 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:29.197+0000 7f916fa2d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T02:17:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:29.197+0000 7f916fa2d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T02:17:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:29.197+0000 7f916fa2d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T02:17:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:29.197+0000 7f916fa2d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T02:17:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:29.197+0000 7f916fa2d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T02:17:29.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:29.197+0000 7f916fa2d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T02:17:32.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T02:17:32.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T02:17:32.112 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:32.112 INFO:tasks.ceph:role: osd.4 2024-05-09T02:17:32.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:17:32.112 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:32.188 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:32.687 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-09T02:17:32.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-09T02:17:32.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T02:17:32.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T02:17:32.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T02:17:32.909 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:32.910 INFO:tasks.ceph:role: osd.5 2024-05-09T02:17:32.910 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:17:32.910 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T02:17:32.984 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:32.984 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:32.984 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:32.984 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:32.985 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:32.985 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:32.985 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:32.985 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:32.985 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:32.985 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:33.451 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-09T02:17:33.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-09T02:17:33.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T02:17:33.539 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T02:17:33.567 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T02:17:33.632 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:33.632 INFO:tasks.ceph:role: osd.6 2024-05-09T02:17:33.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:17:33.632 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T02:17:33.704 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:33.705 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:33.705 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:33.705 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:33.705 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:34.187 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-09T02:17:34.189 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-09T02:17:34.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T02:17:34.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T02:17:34.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T02:17:34.426 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T02:17:34.426 INFO:tasks.ceph:role: osd.7 2024-05-09T02:17:34.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:17:34.426 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T02:17:34.498 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T02:17:34.498 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T02:17:34.498 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T02:17:34.498 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T02:17:34.498 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T02:17:34.499 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-09T02:17:34.499 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T02:17:34.499 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T02:17:34.499 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T02:17:34.499 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T02:17:35.014 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-09T02:17:35.016 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-09T02:17:35.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T02:17:35.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T02:17:35.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:35.288+0000 7f6b77bdc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T02:17:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:35.288+0000 7f6b77bdc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T02:17:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:35.288+0000 7f6b77bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T02:17:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:35.288+0000 7f6b77bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T02:17:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:35.288+0000 7f6b77bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T02:17:35.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:35.289+0000 7f6b77bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T02:17:38.151 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T02:17:38.181 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:38.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:38.281+0000 7fed6d4f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T02:17:38.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:38.281+0000 7fed6d4f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T02:17:38.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:38.281+0000 7fed6d4f0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T02:17:38.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:38.281+0000 7fed6d4f0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T02:17:38.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:38.281+0000 7fed6d4f0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T02:17:38.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:38.282+0000 7fed6d4f0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T02:17:41.133 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T02:17:41.161 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:41.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:41.261+0000 7f4aab463640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T02:17:41.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:41.262+0000 7f4aab463640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T02:17:41.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:41.262+0000 7f4aab463640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T02:17:41.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:41.262+0000 7f4aab463640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T02:17:41.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:41.262+0000 7f4aab463640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T02:17:41.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:41.262+0000 7f4aab463640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T02:17:44.115 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T02:17:44.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:44.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:44.236+0000 7fe39dfb1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T02:17:44.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:44.236+0000 7fe39dfb1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T02:17:44.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:44.236+0000 7fe39dfb1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T02:17:44.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:44.236+0000 7fe39dfb1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T02:17:44.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:44.236+0000 7fe39dfb1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T02:17:44.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:44.237+0000 7fe39dfb1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T02:17:45.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:17:45.791 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:17:47.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T02:17:47.127 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T02:17:47.127 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T02:17:47.158 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T02:17:47.229 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.229 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-09T02:17:47.300 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T02:17:47.372 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T02:17:47.444 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T02:17:47.513 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:47.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T02:17:47.584 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.584 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T02:17:47.614 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.614 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T02:17:47.684 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.684 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-09T02:17:47.752 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T02:17:47.821 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.821 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T02:17:47.887 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.888 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T02:17:47.954 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:47.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T02:17:48.019 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:48.020 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T02:17:48.039 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:48.039 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-09T02:17:48.076 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T02:17:48.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T02:17:48.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T02:17:48.119 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-05-09T02:17:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxmLNRdERAAIfHQ2ADysDr1ij04g7lATg== 2024-05-09T02:17:48.119 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-05-09T02:17:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxmuEi9GRAAqxQlmoLp9Sau4HezYyxDeQ== 2024-05-09T02:17:48.119 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxmb1+UIRAAgXvBCwn1jgCSua2p7SagYA== 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAwMjxmRLgIDhAARJAIb37gVpsc8b7MziIwUg== 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAzMjxmb88lDRAA57UjhFOGS5nYC4UMUeHUGA== 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQA2MjxmdFmSDBAAh2n2CGvmy3/MzV4Q0boTaw== 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQA5MjxmX0zRCxAAf8YUhcq1NS3Ett+uE8nzYg== 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxm8ae1FRAAbFkWwvJTCySq7WJf3BwRAQ== 2024-05-09T02:17:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxmK+7pJhAAwSEYseMSwieuCwX7r/Uz8g== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxmAIeLLhAA/JDvvDyGvYPL5WtbEqKRCA== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQA/Mjxm2KdPERAAuQSSPZxL+sQP702xJwhPPw== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBCMjxmnPfjEBAAyPsprRwnT7ZPoZm3cony4Q== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBFMjxmJv6qDxAALC7ZYIPSb5670aK7Lv81rw== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBIMjxmEZ8oDhAAOgAvxNW4gvpazmJQ1Rmdrw== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxmXaxVMxAAgXmMtJq8PfjGuXogji9H7Q== 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2024-05-09T02:17:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAuMjxma7sgNxAAuqACKuZ1fCA4bUVSAVwGOg== 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxmLNRdERAAIfHQ2ADysDr1ij04g7lATg== 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxmuEi9GRAAqxQlmoLp9Sau4HezYyxDeQ== 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxmb1+UIRAAgXvBCwn1jgCSua2p7SagYA== 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAwMjxmRLgIDhAARJAIb37gVpsc8b7MziIwUg== 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-05-09T02:17:48.139 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAzMjxmb88lDRAA57UjhFOGS5nYC4UMUeHUGA== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQA2MjxmdFmSDBAAh2n2CGvmy3/MzV4Q0boTaw== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQA5MjxmX0zRCxAAf8YUhcq1NS3Ett+uE8nzYg== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxm8ae1FRAAbFkWwvJTCySq7WJf3BwRAQ== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxmK+7pJhAAwSEYseMSwieuCwX7r/Uz8g== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxmAIeLLhAA/JDvvDyGvYPL5WtbEqKRCA== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQA/Mjxm2KdPERAAuQSSPZxL+sQP702xJwhPPw== 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-05-09T02:17:48.140 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBCMjxmnPfjEBAAyPsprRwnT7ZPoZm3cony4Q== 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBFMjxmJv6qDxAALC7ZYIPSb5670aK7Lv81rw== 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBIMjxmEZ8oDhAAOgAvxNW4gvpazmJQ1Rmdrw== 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxmXaxVMxAAgXmMtJq8PfjGuXogji9H7Q== 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-05-09T02:17:48.141 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAuMjxma7sgNxAAuqACKuZ1fCA4bUVSAVwGOg== 2024-05-09T02:17:48.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T02:17:48.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T02:17:48.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.445 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.508 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T02:17:48.634 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T02:17:48.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.697 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T02:17:48.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.828 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.890 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:48.953 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:49.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:49.016 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T02:17:49.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T02:17:49.079 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T02:17:49.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T02:17:49.145 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T02:17:49.209 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T02:17:49.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T02:17:49.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T02:17:49.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T02:17:49.368 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T02:17:49.393 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T02:17:49.499 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T02:17:49.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T02:17:49.588 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T02:17:49.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T02:17:49.719 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:49.721 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T02:17:49.774 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T02:17:49.774 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T02:17:49.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T02:17:49.778 INFO:tasks.ceph.mon.a:Started 2024-05-09T02:17:49.779 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T02:17:49.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T02:17:49.816 INFO:tasks.ceph.mon.b:Started 2024-05-09T02:17:49.817 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T02:17:49.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T02:17:49.819 INFO:tasks.ceph.mon.c:Started 2024-05-09T02:17:49.819 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T02:17:49.819 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T02:17:49.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T02:17:49.822 INFO:tasks.ceph.mgr.y:Started 2024-05-09T02:17:49.822 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T02:17:49.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T02:17:49.824 INFO:tasks.ceph.mgr.x:Started 2024-05-09T02:17:49.824 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T02:17:49.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T02:17:49.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.939+0000 7f0eaee25640 1 Processor -- start 2024-05-09T02:17:49.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.939+0000 7f0eaee25640 1 -- start start 2024-05-09T02:17:49.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.940+0000 7f0eaee25640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 0x7f0ea8155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:49.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.940+0000 7f0eaee25640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 0x7f0ea815b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:49.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eaee25640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea80c3a80 con 0x7f0ea806c6c0 2024-05-09T02:17:49.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eaee25640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80c4370 con 0x7f0ea806cad0 2024-05-09T02:17:49.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eaee25640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80c3d20 con 0x7f0ea80ac690 2024-05-09T02:17:49.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 0x7f0ea815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 0x7f0ea815b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49296/0 (socket says 172.21.15.46:49296) 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 -- 172.21.15.46:0/3090330982 learned_addr learned my addr 172.21.15.46:0/3090330982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 -- 172.21.15.46:0/3090330982 >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 msgr2=0x7f0ea815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 -- 172.21.15.46:0/3090330982 >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 msgr2=0x7f0ea815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 0x7f0ea815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0ead3c2640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 0x7f0ea815b290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 0x7f0ea8155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eacbc1640 1 -- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 msgr2=0x7f0ea8155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eacbc1640 1 -- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 msgr2=0x7f0ea8155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 0x7f0ea8155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T02:17:49.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:49.941+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 0x7f0ea8155090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T02:17:50.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.103+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018521814 0 0) 0x7f0ea80c3a80 con 0x7f0ea806c6c0 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.103+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e94003520 con 0x7f0ea806c6c0 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2294091530 0 0) 0x7f0e94003520 con 0x7f0ea806c6c0 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 msgr2=0x7f0ea8155090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.107:3300/0 conn(0x7f0ea80ac690 0x7f0ea8155090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 msgr2=0x7f0ea815b290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 --2- 172.21.15.46:0/3090330982 >> v2:172.21.15.46:3300/0 conn(0x7f0ea806cad0 0x7f0ea815b290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80c4000 con 0x7f0ea806c6c0 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f0e98001710 con 0x7f0ea806c6c0 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 >> v1:172.21.15.107:6789/0 conn(0x7f0ea806c6c0 legacy=0x7f0ea8070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94003a50 0x7f0e94003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e94004800 0x7f0e94004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e940052c0 0x7f0e9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80c4370 con 0x7f0e94004800 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80c3d20 con 0x7f0e94003a50 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9400c2d0 con 0x7f0e940052c0 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea7fff640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e94004800 0x7f0e94004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ead3c2640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e940052c0 0x7f0e9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94003a50 0x7f0e94003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea7fff640 1 -- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e940052c0 msgr2=0x7f0e9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea7fff640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e940052c0 0x7f0e9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea7fff640 1 -- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94003a50 msgr2=0x7f0e94003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea7fff640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94003a50 0x7f0e94003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ea7fff640 1 -- 172.21.15.46:0/3090330982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e94003520 con 0x7f0e94004800 2024-05-09T02:17:50.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.104+0000 7f0ead3c2640 1 -- 172.21.15.46:0/3090330982 reap_dead start 2024-05-09T02:17:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.105+0000 7f0ea7fff640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e94004800 0x7f0e94004c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c160 tx=0x7f0e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f688550506f7f1c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.107+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98036070 con 0x7f0e94004800 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.107+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9802ae50 con 0x7f0e94004800 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.107+0000 7f0ea77fe640 1 -- 172.21.15.46:0/3090330982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98007c80 con 0x7f0e94004800 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 -- 172.21.15.46:0/3090330982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e94004800 msgr2=0x7f0e94004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e94004800 0x7f0e94004c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c160 tx=0x7f0e94005830 comp rx=0 tx=0).stop 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 -- 172.21.15.46:0/3090330982 shutdown_connections 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 --2- 172.21.15.46:0/3090330982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e94004800 0x7f0e94004c10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 -- 172.21.15.46:0/3090330982 >> 172.21.15.46:0/3090330982 conn(0x7f0ea806de00 msgr2=0x7f0ea80aba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 -- 172.21.15.46:0/3090330982 shutdown_connections 2024-05-09T02:17:50.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.108+0000 7f0eaee25640 1 -- 172.21.15.46:0/3090330982 wait complete. 2024-05-09T02:17:50.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.110+0000 7f0eaee25640 1 Processor -- start 2024-05-09T02:17:50.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.110+0000 7f0eaee25640 1 -- start start 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.111+0000 7f0eaee25640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 0x7f0ea80ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.111+0000 7f0eaee25640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea80a9c10 0x7f0ea81ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.111+0000 7f0eaee25640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0ea8152180 0x7f0ea81edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.111+0000 7f0eaee25640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea8155210 con 0x7f0ea80a9c10 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.111+0000 7f0eaee25640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea8155090 con 0x7f0e94004800 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.111+0000 7f0eaee25640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea8155390 con 0x7f0ea8152180 2024-05-09T02:17:50.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 0x7f0ea80ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea80a9c10 0x7f0ea81ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 0x7f0ea80ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:57376/0 (socket says 172.21.15.46:57376) 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 -- 172.21.15.46:0/116320980 learned_addr learned my addr 172.21.15.46:0/116320980 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0ead3c2640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0ea8152180 0x7f0ea81edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 -- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0ea8152180 msgr2=0x7f0ea81edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0ea8152180 0x7f0ea81edd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 -- 172.21.15.46:0/116320980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea80a9c10 msgr2=0x7f0ea81ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea80a9c10 0x7f0ea81ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 -- 172.21.15.46:0/116320980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea8158a50 con 0x7f0e94004800 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0ead3c2640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0ea8152180 0x7f0ea81edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0ea7fff640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea80a9c10 0x7f0ea81ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0eacbc1640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 0x7f0ea80ab250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000f560 tx=0x7f0e9000fa20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.112+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90019020 con 0x7f0e94004800 2024-05-09T02:17:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.113+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90014870 con 0x7f0e94004800 2024-05-09T02:17:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.113+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea8151e40 con 0x7f0e94004800 2024-05-09T02:17:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.113+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90014c60 con 0x7f0e94004800 2024-05-09T02:17:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.113+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea81ee2c0 con 0x7f0e94004800 2024-05-09T02:17:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.114+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e9001c020 con 0x7f0e94004800 2024-05-09T02:17:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.114+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e9001e440 con 0x7f0e94004800 2024-05-09T02:17:50.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.114+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea81ee520 con 0x7f0e94004800 2024-05-09T02:17:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.117+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0e90023020 con 0x7f0e94004800 2024-05-09T02:17:50.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.203+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0ea806a330 con 0x7f0e94004800 2024-05-09T02:17:50.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.206+0000 7f0ea57fa640 1 -- 172.21.15.46:0/116320980 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0e90015410 con 0x7f0e94004800 2024-05-09T02:17:50.209 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-05-09T02:17:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.207+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 msgr2=0x7f0ea80ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.207+0000 7f0eaee25640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 0x7f0ea80ab250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000f560 tx=0x7f0e9000fa20 comp rx=0 tx=0).stop 2024-05-09T02:17:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 shutdown_connections 2024-05-09T02:17:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0ea8152180 0x7f0ea81edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ea80a9c10 0x7f0ea81ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 --2- 172.21.15.46:0/116320980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e94004800 0x7f0ea80ab250 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 >> 172.21.15.46:0/116320980 conn(0x7f0ea806de00 msgr2=0x7f0ea8074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 shutdown_connections 2024-05-09T02:17:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:50.208+0000 7f0eaee25640 1 -- 172.21.15.46:0/116320980 wait complete. 2024-05-09T02:17:50.213 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:50.211+0000 7f46a7110040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T02:17:50.221 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T02:17:50.221 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T02:17:50.221 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:50.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T02:17:50.245 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:50.243+0000 7f2cea12f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T02:17:50.247 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:50.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T02:17:50.317 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:50.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T02:17:50.372 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:50.370+0000 7f46a7110040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T02:17:50.383 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:17:50.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T02:17:50.424 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:50.422+0000 7f46a7110040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T02:17:50.433 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:50.430+0000 7f2cea12f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T02:17:50.450 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:50.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T02:17:50.476 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:50.476 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T02:17:50.490 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:50.488+0000 7f2cea12f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T02:17:50.542 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:50.542 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T02:17:50.607 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:17:50.608 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T02:17:50.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01 0 2024-05-09T02:17:50.714 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:50.712+0000 7f46a7110040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T02:17:50.759 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:50.756+0000 7f2cea12f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T02:17:50.764 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:50.761+0000 7f46a7110040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T02:17:50.807 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:50.805+0000 7f2cea12f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T02:17:50.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.823+0000 7f574359e640 1 Processor -- start 2024-05-09T02:17:50.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.823+0000 7f574359e640 1 -- start start 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574359e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 0x7f57441582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574359e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f57440c2f00 0x7f57440c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574359e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57440c7c80 con 0x7f5744154d80 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574359e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5744070ec0 con 0x7f57440c2f00 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574359e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f57440c7f60 con 0x7f574406ff30 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 0x7f57441582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 0x7f57441582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:43850/0 (socket says 172.21.15.107:43850) 2024-05-09T02:17:50.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 -- 172.21.15.107:0/1944060332 learned_addr learned my addr 172.21.15.107:0/1944060332 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:50.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f5742d9d640 1 --2- 172.21.15.107:0/1944060332 >> v2:172.21.15.107:3300/0 conn(0x7f57440c2f00 0x7f57440c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 -- 172.21.15.107:0/1944060332 >> v2:172.21.15.107:3300/0 conn(0x7f57440c2f00 msgr2=0x7f57440c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:50.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 --2- 172.21.15.107:0/1944060332 >> v2:172.21.15.107:3300/0 conn(0x7f57440c2f00 0x7f57440c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 -- 172.21.15.107:0/1944060332 >> v1:172.21.15.46:6789/0 conn(0x7f5744154d80 legacy=0x7f5744071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.825+0000 7f574259c640 1 -- 172.21.15.107:0/1944060332 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5744070b50 con 0x7f574406ff30 2024-05-09T02:17:50.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.826+0000 7f574259c640 1 --2- 172.21.15.107:0/1944060332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 0x7f57441582f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5738009870 tx=0x7f573802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfe22fed7615a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:50.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.826+0000 7f574159a640 1 -- 172.21.15.107:0/1944060332 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738037070 con 0x7f574406ff30 2024-05-09T02:17:50.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.826+0000 7f574159a640 1 -- 172.21.15.107:0/1944060332 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738032440 con 0x7f574406ff30 2024-05-09T02:17:50.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.826+0000 7f574159a640 1 -- 172.21.15.107:0/1944060332 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738032810 con 0x7f574406ff30 2024-05-09T02:17:50.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 -- 172.21.15.107:0/1944060332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 msgr2=0x7f57441582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 --2- 172.21.15.107:0/1944060332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 0x7f57441582f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5738009870 tx=0x7f573802a270 comp rx=0 tx=0).stop 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 -- 172.21.15.107:0/1944060332 shutdown_connections 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 --2- 172.21.15.107:0/1944060332 >> v2:172.21.15.107:3300/0 conn(0x7f57440c2f00 0x7f57440c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 --2- 172.21.15.107:0/1944060332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f574406ff30 0x7f57441582f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 -- 172.21.15.107:0/1944060332 >> 172.21.15.107:0/1944060332 conn(0x7f57440ca560 msgr2=0x7f57440ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 -- 172.21.15.107:0/1944060332 shutdown_connections 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.827+0000 7f574359e640 1 -- 172.21.15.107:0/1944060332 wait complete. 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.829+0000 7f574359e640 1 Processor -- start 2024-05-09T02:17:50.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.829+0000 7f574359e640 1 -- start start 2024-05-09T02:17:50.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574406ff30 0x7f57441e2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574359e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 0x7f574415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574359e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5744154d80 0x7f57441f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:50.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574359e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5744155310 con 0x7f574406ff30 2024-05-09T02:17:50.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574359e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5744155190 con 0x7f5744154d80 2024-05-09T02:17:50.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574359e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5744073840 con 0x7f57440c2f00 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f5741d9b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 0x7f574415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f5741d9b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 0x7f574415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:43852/0 (socket says 172.21.15.107:43852) 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f5742d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5744154d80 0x7f57441f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f5741d9b640 1 -- 172.21.15.107:0/2134193589 learned_addr learned my addr 172.21.15.107:0/2134193589 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.830+0000 7f574259c640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574406ff30 0x7f57441e2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5741d9b640 1 -- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5744154d80 msgr2=0x7f57441f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5741d9b640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5744154d80 0x7f57441f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5741d9b640 1 -- 172.21.15.107:0/2134193589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574406ff30 msgr2=0x7f57441e2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5741d9b640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574406ff30 0x7f57441e2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5741d9b640 1 -- 172.21.15.107:0/2134193589 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57441e2030 con 0x7f57440c2f00 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f574259c640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574406ff30 0x7f57441e2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5742d9d640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5744154d80 0x7f57441f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:50.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5741d9b640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 0x7f574415b5e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f573400c3d0 tx=0x7f573400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734017070 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57340052d0 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734003830 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57441f1af0 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57440ad790 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f573401a070 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.831+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f573401c440 con 0x7f57440c2f00 2024-05-09T02:17:50.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.832+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5744050870 con 0x7f57440c2f00 2024-05-09T02:17:50.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.835+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5734021020 con 0x7f57440c2f00 2024-05-09T02:17:50.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.907+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01", "id": 0} v 0) -- 0x7f57440c4010 con 0x7f57440c2f00 2024-05-09T02:17:50.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.910+0000 7f5732ffd640 1 -- 172.21.15.107:0/2134193589 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5734011590 con 0x7f57440c2f00 2024-05-09T02:17:50.913 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 msgr2=0x7f574415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 0x7f574415b5e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f573400c3d0 tx=0x7f573400c890 comp rx=0 tx=0).stop 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 shutdown_connections 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5744154d80 0x7f57441f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57440c2f00 0x7f574415b5e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 --2- 172.21.15.107:0/2134193589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574406ff30 0x7f57441e2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 >> 172.21.15.107:0/2134193589 conn(0x7f57440ca560 msgr2=0x7f5744154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 shutdown_connections 2024-05-09T02:17:50.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:50.911+0000 7f574359e640 1 -- 172.21.15.107:0/2134193589 wait complete. 2024-05-09T02:17:50.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new a48a2414-1d40-4e17-b1e2-9c4a6f20d896 1 2024-05-09T02:17:51.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.032+0000 7f38470b8640 1 Processor -- start 2024-05-09T02:17:51.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.032+0000 7f38470b8640 1 -- start start 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f38470b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3840070a70 0x7f3840070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f38470b8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3840157b40 con 0x7f384015b0b0 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f38470b8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3840157e20 con 0x7f38400c5f90 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f38470b8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f38400c4190 con 0x7f3840070a70 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f383ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3840070a70 0x7f3840070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f3844e54640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f38400c5f90 0x7f38400c3a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40976/0 (socket says 172.21.15.107:40976) 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f383ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3840070a70 0x7f3840070e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39632/0 (socket says 172.21.15.107:39632) 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f3844e54640 1 -- 172.21.15.107:0/1830539365 learned_addr learned my addr 172.21.15.107:0/1830539365 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f383ffff640 1 -- 172.21.15.107:0/1830539365 >> v1:172.21.15.107:6789/0 conn(0x7f38400c5f90 legacy=0x7f38400c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f383ffff640 1 -- 172.21.15.107:0/1830539365 >> v1:172.21.15.46:6789/0 conn(0x7f384015b0b0 legacy=0x7f384015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.033+0000 7f383ffff640 1 -- 172.21.15.107:0/1830539365 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3840158100 con 0x7f3840070a70 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.034+0000 7f383ffff640 1 --2- 172.21.15.107:0/1830539365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840070e80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f382c0097a0 tx=0x7f382c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839c7cc99f19814a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.034+0000 7f383f7fe640 1 -- 172.21.15.107:0/1830539365 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c037070 con 0x7f3840070a70 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.034+0000 7f383f7fe640 1 -- 172.21.15.107:0/1830539365 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c032440 con 0x7f3840070a70 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.034+0000 7f383f7fe640 1 -- 172.21.15.107:0/1830539365 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c02ae60 con 0x7f3840070a70 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 -- 172.21.15.107:0/1830539365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 msgr2=0x7f3840070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 --2- 172.21.15.107:0/1830539365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840070e80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f382c0097a0 tx=0x7f382c02a110 comp rx=0 tx=0).stop 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 -- 172.21.15.107:0/1830539365 shutdown_connections 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 --2- 172.21.15.107:0/1830539365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840070e80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 -- 172.21.15.107:0/1830539365 >> 172.21.15.107:0/1830539365 conn(0x7f38400c9e50 msgr2=0x7f38400ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 -- 172.21.15.107:0/1830539365 shutdown_connections 2024-05-09T02:17:51.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.035+0000 7f38470b8640 1 -- 172.21.15.107:0/1830539365 wait complete. 2024-05-09T02:17:51.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.037+0000 7f38470b8640 1 Processor -- start 2024-05-09T02:17:51.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.037+0000 7f38470b8640 1 -- start start 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f38470b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f38470b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38400c5f90 0x7f38400ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f38470b8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f384015b0b0 0x7f38400ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f38470b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f38400c6520 con 0x7f38400c5f90 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f38470b8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f38400c63a0 con 0x7f3840070a70 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f38470b8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f384015bbd0 con 0x7f384015b0b0 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f3844e54640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f3844e54640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39644/0 (socket says 172.21.15.107:39644) 2024-05-09T02:17:51.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f3844e54640 1 -- 172.21.15.107:0/221281060 learned_addr learned my addr 172.21.15.107:0/221281060 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f383ffff640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38400c5f90 0x7f38400ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.038+0000 7f3845655640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f384015b0b0 0x7f38400ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f3844e54640 1 -- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f384015b0b0 msgr2=0x7f38400ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f3844e54640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f384015b0b0 0x7f38400ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f3844e54640 1 -- 172.21.15.107:0/221281060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38400c5f90 msgr2=0x7f38400ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f3844e54640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38400c5f90 0x7f38400ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f3844e54640 1 -- 172.21.15.107:0/221281060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38401540b0 con 0x7f3840070a70 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f3844e54640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840150a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f383400c3c0 tx=0x7f383400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834017070 con 0x7f3840070a70 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3834005ce0 con 0x7f3840070a70 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340072d0 con 0x7f3840070a70 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38400ace90 con 0x7f3840070a70 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3840152990 con 0x7f3840070a70 2024-05-09T02:17:51.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f383401a070 con 0x7f3840070a70 2024-05-09T02:17:51.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.039+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f38340127b0 con 0x7f3840070a70 2024-05-09T02:17:51.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.040+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3840154280 con 0x7f3840070a70 2024-05-09T02:17:51.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.042+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f383401ccf0 con 0x7f3840070a70 2024-05-09T02:17:51.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.113+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a48a2414-1d40-4e17-b1e2-9c4a6f20d896", "id": 1} v 0) -- 0x7f384006e8b0 con 0x7f3840070a70 2024-05-09T02:17:51.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.117+0000 7f383d7fa640 1 -- 172.21.15.107:0/221281060 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a48a2414-1d40-4e17-b1e2-9c4a6f20d896", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3834007470 con 0x7f3840070a70 2024-05-09T02:17:51.119 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-09T02:17:51.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 msgr2=0x7f3840150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840150a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f383400c3c0 tx=0x7f383400c880 comp rx=0 tx=0).stop 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 shutdown_connections 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f384015b0b0 0x7f38400ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38400c5f90 0x7f38400ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 --2- 172.21.15.107:0/221281060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3840070a70 0x7f3840150a90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 >> 172.21.15.107:0/221281060 conn(0x7f38400c9e50 msgr2=0x7f38400c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 shutdown_connections 2024-05-09T02:17:51.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.118+0000 7f38470b8640 1 -- 172.21.15.107:0/221281060 wait complete. 2024-05-09T02:17:51.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8cf9110d-8da1-4d1f-a8b2-7e889235fc01 2 2024-05-09T02:17:51.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.240+0000 7fc6b2219640 1 Processor -- start 2024-05-09T02:17:51.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.240+0000 7fc6b2219640 1 -- start start 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6b2219640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6ac0c97f0 0x7fc6ac156340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6b2219640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac074830 con 0x7fc6ac071520 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6b2219640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac155860 con 0x7fc6ac073e80 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6b2219640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac0745e0 con 0x7fc6ac0c97f0 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6ab7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6ac0c97f0 0x7fc6ac156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6a2ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc6ac073e80 0x7fc6ac158d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40980/0 (socket says 172.21.15.107:40980) 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6a2ffd640 1 -- 172.21.15.107:0/3559800033 learned_addr learned my addr 172.21.15.107:0/3559800033 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/3559800033 >> v1:172.21.15.107:6789/0 conn(0x7fc6ac073e80 legacy=0x7fc6ac158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/3559800033 >> v1:172.21.15.46:6789/0 conn(0x7fc6ac071520 legacy=0x7fc6ac0af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.241+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/3559800033 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac155b40 con 0x7fc6ac0c97f0 2024-05-09T02:17:51.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.242+0000 7fc6ab7fe640 1 --2- 172.21.15.107:0/3559800033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac0c97f0 0x7fc6ac156340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097a0 tx=0x7fc69c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0a21fb68555cf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.242+0000 7fc6aaffd640 1 -- 172.21.15.107:0/3559800033 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c037070 con 0x7fc6ac0c97f0 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.242+0000 7fc6aaffd640 1 -- 172.21.15.107:0/3559800033 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c032440 con 0x7fc6ac0c97f0 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.242+0000 7fc6aaffd640 1 -- 172.21.15.107:0/3559800033 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c032810 con 0x7fc6ac0c97f0 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 -- 172.21.15.107:0/3559800033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac0c97f0 msgr2=0x7fc6ac156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 --2- 172.21.15.107:0/3559800033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac0c97f0 0x7fc6ac156340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097a0 tx=0x7fc69c02a230 comp rx=0 tx=0).stop 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 -- 172.21.15.107:0/3559800033 shutdown_connections 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 --2- 172.21.15.107:0/3559800033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac0c97f0 0x7fc6ac156340 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 -- 172.21.15.107:0/3559800033 >> 172.21.15.107:0/3559800033 conn(0x7fc6ac0ac130 msgr2=0x7fc6ac0c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 -- 172.21.15.107:0/3559800033 shutdown_connections 2024-05-09T02:17:51.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.243+0000 7fc6b2219640 1 -- 172.21.15.107:0/3559800033 wait complete. 2024-05-09T02:17:51.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.245+0000 7fc6b2219640 1 Processor -- start 2024-05-09T02:17:51.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.245+0000 7fc6b2219640 1 -- start start 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6b2219640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 0x7fc6ac1df1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6b2219640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6ac073e80 0x7fc6ac157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6b2219640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc6ac14f820 0x7fc6ac140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6b2219640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac159450 con 0x7fc6ac073e80 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6b2219640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac155eb0 con 0x7fc6ac071520 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6b2219640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac071930 con 0x7fc6ac14f820 2024-05-09T02:17:51.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 0x7fc6ac1df1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 0x7fc6ac1df1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39662/0 (socket says 172.21.15.107:39662) 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/2901729260 learned_addr learned my addr 172.21.15.107:0/2901729260 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6abfff640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc6ac14f820 0x7fc6ac140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6a2ffd640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6ac073e80 0x7fc6ac157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc6ac14f820 msgr2=0x7fc6ac140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc6ac14f820 0x7fc6ac140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/2901729260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6ac073e80 msgr2=0x7fc6ac157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6ac073e80 0x7fc6ac157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 -- 172.21.15.107:0/2901729260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac1ebe20 con 0x7fc6ac071520 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.246+0000 7fc6ab7fe640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 0x7fc6ac1df1f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0098c0 tx=0x7fc69c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c037040 con 0x7fc6ac071520 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c030770 con 0x7fc6ac071520 2024-05-09T02:17:51.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac1ec100 con 0x7fc6ac071520 2024-05-09T02:17:51.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c030b40 con 0x7fc6ac071520 2024-05-09T02:17:51.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac158a90 con 0x7fc6ac071520 2024-05-09T02:17:51.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc69c044020 con 0x7fc6ac071520 2024-05-09T02:17:51.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc69c046830 con 0x7fc6ac071520 2024-05-09T02:17:51.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.247+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac06a330 con 0x7fc6ac071520 2024-05-09T02:17:51.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.250+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc69c032e20 con 0x7fc6ac071520 2024-05-09T02:17:51.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.322+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8cf9110d-8da1-4d1f-a8b2-7e889235fc01", "id": 2} v 0) -- 0x7fc6ac073c60 con 0x7fc6ac071520 2024-05-09T02:17:51.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.326+0000 7fc6a8ff9640 1 -- 172.21.15.107:0/2901729260 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8cf9110d-8da1-4d1f-a8b2-7e889235fc01", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc69c046410 con 0x7fc6ac071520 2024-05-09T02:17:51.329 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 msgr2=0x7fc6ac1df1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 0x7fc6ac1df1f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0098c0 tx=0x7fc69c0046c0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 shutdown_connections 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc6ac14f820 0x7fc6ac140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6ac073e80 0x7fc6ac157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 --2- 172.21.15.107:0/2901729260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6ac071520 0x7fc6ac1df1f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 >> 172.21.15.107:0/2901729260 conn(0x7fc6ac0ac130 msgr2=0x7fc6ac0c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 shutdown_connections 2024-05-09T02:17:51.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.327+0000 7fc6b2219640 1 -- 172.21.15.107:0/2901729260 wait complete. 2024-05-09T02:17:51.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8064c03c-129e-4631-a956-d4243b3de52d 3 2024-05-09T02:17:51.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.449+0000 7ff591a61640 1 Processor -- start 2024-05-09T02:17:51.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.449+0000 7ff591a61640 1 -- start start 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff591a61640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff58c154eb0 0x7ff58c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff591a61640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff58c158460 0x7ff58c1622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff591a61640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff58c157a70 con 0x7ff58c070860 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff591a61640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff58c071420 con 0x7ff58c158460 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff591a61640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff58c06d000 con 0x7ff58c154eb0 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff58affd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff58c070860 0x7ff58c0c9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40986/0 (socket says 172.21.15.107:40986) 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff58affd640 1 -- 172.21.15.107:0/1928248965 learned_addr learned my addr 172.21.15.107:0/1928248965 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.450+0000 7ff583fff640 1 --2- 172.21.15.107:0/1928248965 >> v2:172.21.15.107:3300/0 conn(0x7ff58c154eb0 0x7ff58c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff58b7fe640 1 --2- 172.21.15.107:0/1928248965 >> v2:172.21.15.46:3300/0 conn(0x7ff58c158460 0x7ff58c1622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1928248965 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615404435 0 0) 0x7ff58c157a70 con 0x7ff58c070860 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1928248965 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff578003520 con 0x7ff58c070860 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff583fff640 1 -- 172.21.15.107:0/1928248965 >> v2:172.21.15.46:3300/0 conn(0x7ff58c158460 msgr2=0x7ff58c1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff583fff640 1 --2- 172.21.15.107:0/1928248965 >> v2:172.21.15.46:3300/0 conn(0x7ff58c158460 0x7ff58c1622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff583fff640 1 -- 172.21.15.107:0/1928248965 >> v1:172.21.15.107:6789/0 conn(0x7ff58c070860 legacy=0x7ff58c0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.451+0000 7ff583fff640 1 -- 172.21.15.107:0/1928248965 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c070c70 con 0x7ff58c154eb0 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff583fff640 1 --2- 172.21.15.107:0/1928248965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c154eb0 0x7ff58c157f20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff58c06f830 tx=0x7ff57402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edaf881587641ca8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1928248965 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574037070 con 0x7ff58c154eb0 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1928248965 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57402add0 con 0x7ff58c154eb0 2024-05-09T02:17:51.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff58a7fc640 1 -- 172.21.15.107:0/1928248965 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574032660 con 0x7ff58c154eb0 2024-05-09T02:17:51.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff591a61640 1 -- 172.21.15.107:0/1928248965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c154eb0 msgr2=0x7ff58c157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff591a61640 1 --2- 172.21.15.107:0/1928248965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c154eb0 0x7ff58c157f20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff58c06f830 tx=0x7ff57402a080 comp rx=0 tx=0).stop 2024-05-09T02:17:51.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff591a61640 1 -- 172.21.15.107:0/1928248965 shutdown_connections 2024-05-09T02:17:51.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff591a61640 1 --2- 172.21.15.107:0/1928248965 >> v2:172.21.15.46:3300/0 conn(0x7ff58c158460 0x7ff58c1622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff591a61640 1 --2- 172.21.15.107:0/1928248965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c154eb0 0x7ff58c157f20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.452+0000 7ff591a61640 1 -- 172.21.15.107:0/1928248965 >> 172.21.15.107:0/1928248965 conn(0x7ff58c06d7d0 msgr2=0x7ff58c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.453+0000 7ff591a61640 1 -- 172.21.15.107:0/1928248965 shutdown_connections 2024-05-09T02:17:51.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.453+0000 7ff591a61640 1 -- 172.21.15.107:0/1928248965 wait complete. 2024-05-09T02:17:51.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.454+0000 7ff591a61640 1 Processor -- start 2024-05-09T02:17:51.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.454+0000 7ff591a61640 1 -- start start 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff591a61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c070860 0x7ff58c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff591a61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c154eb0 0x7ff58c1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff591a61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 0x7ff58c14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff591a61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0716c0 con 0x7ff58c154eb0 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff591a61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0c33c0 con 0x7ff58c158460 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff591a61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c0719a0 con 0x7ff58c070860 2024-05-09T02:17:51.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff58b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 0x7ff58c14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff58affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c070860 0x7ff58c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff58b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 0x7ff58c14a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39672/0 (socket says 172.21.15.107:39672) 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.455+0000 7ff58b7fe640 1 -- 172.21.15.107:0/1916822081 learned_addr learned my addr 172.21.15.107:0/1916822081 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff583fff640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c154eb0 0x7ff58c1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff58b7fe640 1 -- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c070860 msgr2=0x7ff58c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff58b7fe640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c070860 0x7ff58c156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff58b7fe640 1 -- 172.21.15.107:0/1916822081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c154eb0 msgr2=0x7ff58c1525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff58b7fe640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c154eb0 0x7ff58c1525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff58b7fe640 1 -- 172.21.15.107:0/1916822081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c157600 con 0x7ff58c158460 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff58b7fe640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 0x7ff58c14a3b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff58400efc0 tx=0x7ff58400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584018020 con 0x7ff58c158460 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff584014480 con 0x7ff58c158460 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584009e60 con 0x7ff58c158460 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c0adff0 con 0x7ff58c158460 2024-05-09T02:17:51.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c0ae5b0 con 0x7ff58c158460 2024-05-09T02:17:51.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff584005d10 con 0x7ff58c158460 2024-05-09T02:17:51.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.456+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff58401dd10 con 0x7ff58c158460 2024-05-09T02:17:51.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.457+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c06a330 con 0x7ff58c158460 2024-05-09T02:17:51.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.459+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff584022030 con 0x7ff58c158460 2024-05-09T02:17:51.529 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:51.526+0000 7f46a7110040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T02:17:51.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.532+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8064c03c-129e-4631-a956-d4243b3de52d", "id": 3} v 0) -- 0x7ff58c15bdf0 con 0x7ff58c158460 2024-05-09T02:17:51.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.535+0000 7ff588ff9640 1 -- 172.21.15.107:0/1916822081 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8064c03c-129e-4631-a956-d4243b3de52d", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff58c157600 con 0x7ff58c158460 2024-05-09T02:17:51.538 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 msgr2=0x7ff58c14a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 0x7ff58c14a3b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff58400efc0 tx=0x7ff58400c490 comp rx=0 tx=0).stop 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 shutdown_connections 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c158460 0x7ff58c14a3b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff58c154eb0 0x7ff58c1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 --2- 172.21.15.107:0/1916822081 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c070860 0x7ff58c156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 >> 172.21.15.107:0/1916822081 conn(0x7ff58c06d7d0 msgr2=0x7ff58c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 shutdown_connections 2024-05-09T02:17:51.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.536+0000 7ff591a61640 1 -- 172.21.15.107:0/1916822081 wait complete. 2024-05-09T02:17:51.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new b5c97e89-a607-4c89-b5c0-5c00e600d00a 4 2024-05-09T02:17:51.569 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:51.567+0000 7f2cea12f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T02:17:51.629 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:51.626+0000 7f46a7110040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T02:17:51.662 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:51.659+0000 7f2cea12f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T02:17:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.661+0000 7f30941be640 1 Processor -- start 2024-05-09T02:17:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.662+0000 7f30941be640 1 -- start start 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f30941be640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f308c1612a0 0x7f308c1636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f30941be640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308c070aa0 con 0x7f308c1551b0 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f30941be640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308c157cd0 con 0x7f308c15ba90 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f30941be640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f308c15bea0 con 0x7f308c1612a0 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f3091759640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f308c15ba90 0x7f308c0c6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40990/0 (socket says 172.21.15.107:40990) 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f3091759640 1 -- 172.21.15.107:0/1099346138 learned_addr learned my addr 172.21.15.107:0/1099346138 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f309275b640 1 --2- 172.21.15.107:0/1099346138 >> v2:172.21.15.46:3300/0 conn(0x7f308c1612a0 0x7f308c1636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f3090f58640 1 -- 172.21.15.107:0/1099346138 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222135952 0 0) 0x7f308c157cd0 con 0x7f308c15ba90 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f3090f58640 1 -- 172.21.15.107:0/1099346138 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3078003520 con 0x7f308c15ba90 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f309275b640 1 -- 172.21.15.107:0/1099346138 >> v1:172.21.15.107:6789/0 conn(0x7f308c15ba90 legacy=0x7f308c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f309275b640 1 -- 172.21.15.107:0/1099346138 >> v1:172.21.15.46:6789/0 conn(0x7f308c1551b0 legacy=0x7f308c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.663+0000 7f309275b640 1 -- 172.21.15.107:0/1099346138 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c15afb0 con 0x7f308c1612a0 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.664+0000 7f309275b640 1 --2- 172.21.15.107:0/1099346138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c1612a0 0x7f308c1636c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3084009d90 tx=0x7f308402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e9367be24d9822 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.664+0000 7f3090f58640 1 -- 172.21.15.107:0/1099346138 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084007740 con 0x7f308c1612a0 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.664+0000 7f3090f58640 1 -- 172.21.15.107:0/1099346138 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30840078e0 con 0x7f308c1612a0 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.664+0000 7f3090f58640 1 -- 172.21.15.107:0/1099346138 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084007c90 con 0x7f308c1612a0 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 -- 172.21.15.107:0/1099346138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c1612a0 msgr2=0x7f308c1636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 --2- 172.21.15.107:0/1099346138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c1612a0 0x7f308c1636c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3084009d90 tx=0x7f308402a660 comp rx=0 tx=0).stop 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 -- 172.21.15.107:0/1099346138 shutdown_connections 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 --2- 172.21.15.107:0/1099346138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c1612a0 0x7f308c1636c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 -- 172.21.15.107:0/1099346138 >> 172.21.15.107:0/1099346138 conn(0x7f308c06dbc0 msgr2=0x7f308c06dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 -- 172.21.15.107:0/1099346138 shutdown_connections 2024-05-09T02:17:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.665+0000 7f30941be640 1 -- 172.21.15.107:0/1099346138 wait complete. 2024-05-09T02:17:51.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.667+0000 7f30941be640 1 Processor -- start 2024-05-09T02:17:51.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.667+0000 7f30941be640 1 -- start start 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f30941be640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 0x7f308c153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f30941be640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c15ba90 0x7f308c1ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f30941be640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f308c1612a0 0x7f308c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f30941be640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f308c157980 con 0x7f308c15ba90 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f30941be640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f308c15b570 con 0x7f308c1551b0 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f30941be640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f308c0c3620 con 0x7f308c1612a0 2024-05-09T02:17:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f3091f5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 0x7f308c153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f3091f5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 0x7f308c153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39676/0 (socket says 172.21.15.107:39676) 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f3091f5a640 1 -- 172.21.15.107:0/635966152 learned_addr learned my addr 172.21.15.107:0/635966152 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f309275b640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f308c1612a0 0x7f308c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.668+0000 7f3091759640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c15ba90 0x7f308c1ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f3091f5a640 1 -- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f308c1612a0 msgr2=0x7f308c151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f3091f5a640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f308c1612a0 0x7f308c151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f3091f5a640 1 -- 172.21.15.107:0/635966152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c15ba90 msgr2=0x7f308c1ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f3091f5a640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c15ba90 0x7f308c1ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f3091f5a640 1 -- 172.21.15.107:0/635966152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c1f1810 con 0x7f308c1551b0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f3091f5a640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 0x7f308c153530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c430 tx=0x7f307c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c017070 con 0x7f308c1551b0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c0052d0 con 0x7f308c1551b0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308c15fcf0 con 0x7f308c1551b0 2024-05-09T02:17:51.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c003830 con 0x7f308c1551b0 2024-05-09T02:17:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f308c1ee2c0 con 0x7f308c1551b0 2024-05-09T02:17:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f307c01a070 con 0x7f308c1551b0 2024-05-09T02:17:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.669+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f307c011b30 con 0x7f308c1551b0 2024-05-09T02:17:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.670+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f308c0c78d0 con 0x7f308c1551b0 2024-05-09T02:17:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.672+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f308c0c78d0 con 0x7f308c1551b0 2024-05-09T02:17:51.674 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:51.673+0000 7f46a7110040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T02:17:51.707 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:51.705+0000 7f2cea12f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T02:17:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.744+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5c97e89-a607-4c89-b5c0-5c00e600d00a", "id": 4} v 0) -- 0x7f308c1ee520 con 0x7f308c1551b0 2024-05-09T02:17:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.748+0000 7f30827fc640 1 -- 172.21.15.107:0/635966152 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5c97e89-a607-4c89-b5c0-5c00e600d00a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f307c021070 con 0x7f308c1551b0 2024-05-09T02:17:51.750 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-05-09T02:17:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.748+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 msgr2=0x7f308c153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 0x7f308c153530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c430 tx=0x7f307c00c8f0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 shutdown_connections 2024-05-09T02:17:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f308c1612a0 0x7f308c151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308c15ba90 0x7f308c1ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 --2- 172.21.15.107:0/635966152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f308c1551b0 0x7f308c153530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 >> 172.21.15.107:0/635966152 conn(0x7f308c06dbc0 msgr2=0x7f308c0c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 shutdown_connections 2024-05-09T02:17:51.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.749+0000 7f30941be640 1 -- 172.21.15.107:0/635966152 wait complete. 2024-05-09T02:17:51.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8630b698-09f3-4bbf-ab11-bacfa6d25a5e 5 2024-05-09T02:17:51.851 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:51.849+0000 7f46a7110040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T02:17:51.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.869+0000 7fdf2bc2b640 1 Processor -- start 2024-05-09T02:17:51.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.870+0000 7fdf2bc2b640 1 -- start start 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf2bc2b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 0x7fdf24155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf2bc2b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf241561d0 con 0x7fdf240ca600 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf2bc2b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf241564b0 con 0x7fdf24072380 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf2bc2b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdf24071c10 con 0x7fdf240c8b40 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf299c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 0x7fdf24155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf2a1c8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fdf24072380 0x7fdf24152dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41002/0 (socket says 172.21.15.107:41002) 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf2a1c8640 1 -- 172.21.15.107:0/787851251 learned_addr learned my addr 172.21.15.107:0/787851251 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf299c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 0x7fdf24155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:43886/0 (socket says 172.21.15.107:43886) 2024-05-09T02:17:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf289c5640 1 -- 172.21.15.107:0/787851251 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455229532 0 0) 0x7fdf241564b0 con 0x7fdf24072380 2024-05-09T02:17:51.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf299c7640 1 -- 172.21.15.107:0/787851251 >> v1:172.21.15.107:6789/0 conn(0x7fdf24072380 legacy=0x7fdf24152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf299c7640 1 -- 172.21.15.107:0/787851251 >> v1:172.21.15.46:6789/0 conn(0x7fdf240ca600 legacy=0x7fdf240c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.871+0000 7fdf299c7640 1 -- 172.21.15.107:0/787851251 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf24156790 con 0x7fdf240c8b40 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.872+0000 7fdf299c7640 1 --2- 172.21.15.107:0/787851251 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 0x7fdf24155980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf200097d0 tx=0x7fdf2002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41187e2e59a74caa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.872+0000 7fdf289c5640 1 -- 172.21.15.107:0/787851251 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20037070 con 0x7fdf240c8b40 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.872+0000 7fdf289c5640 1 -- 172.21.15.107:0/787851251 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf20032440 con 0x7fdf240c8b40 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.872+0000 7fdf289c5640 1 -- 172.21.15.107:0/787851251 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20032810 con 0x7fdf240c8b40 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/787851251 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 msgr2=0x7fdf24155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 --2- 172.21.15.107:0/787851251 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 0x7fdf24155980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf200097d0 tx=0x7fdf2002a180 comp rx=0 tx=0).stop 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/787851251 shutdown_connections 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 --2- 172.21.15.107:0/787851251 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf240c8b40 0x7fdf24155980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/787851251 >> 172.21.15.107:0/787851251 conn(0x7fdf240ac930 msgr2=0x7fdf240acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/787851251 shutdown_connections 2024-05-09T02:17:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.873+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/787851251 wait complete. 2024-05-09T02:17:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.875+0000 7fdf2bc2b640 1 Processor -- start 2024-05-09T02:17:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.875+0000 7fdf2bc2b640 1 -- start start 2024-05-09T02:17:51.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2bc2b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 0x7fdf240c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2bc2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf240c8b40 0x7fdf240aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2bc2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 0x7fdf2414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2bc2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241534e0 con 0x7fdf240c8b40 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2bc2b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdf24155ec0 con 0x7fdf240ca600 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2bc2b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdf241dff50 con 0x7fdf24072380 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 0x7fdf2414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf299c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 0x7fdf240c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 0x7fdf2414ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39688/0 (socket says 172.21.15.107:39688) 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 -- 172.21.15.107:0/1187917299 learned_addr learned my addr 172.21.15.107:0/1187917299 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf299c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 0x7fdf240c0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:43898/0 (socket says 172.21.15.107:43898) 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf291c6640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf240c8b40 0x7fdf240aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 -- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 msgr2=0x7fdf240c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 0x7fdf240c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 -- 172.21.15.107:0/1187917299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf240c8b40 msgr2=0x7fdf240aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.876+0000 7fdf2a1c8640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf240c8b40 0x7fdf240aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf2a1c8640 1 -- 172.21.15.107:0/1187917299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf240c05b0 con 0x7fdf240ca600 2024-05-09T02:17:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf299c7640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 0x7fdf240c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf2a1c8640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 0x7fdf2414ea40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c710 tx=0x7fdf1c00cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c018070 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00ce20 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2414f610 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00a880 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf241dfc90 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdf1c01b070 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.877+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fdf1c0077b0 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.878+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf241ebfd0 con 0x7fdf240ca600 2024-05-09T02:17:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.880+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdf240c05b0 con 0x7fdf240ca600 2024-05-09T02:17:51.883 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:51.880+0000 7f2cea12f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T02:17:51.910 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:51.907+0000 7f46a7110040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T02:17:51.933 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:51.930+0000 7f2cea12f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T02:17:51.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.954+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8630b698-09f3-4bbf-ab11-bacfa6d25a5e", "id": 5} v 0) -- 0x7fdf2406a330 con 0x7fdf240ca600 2024-05-09T02:17:51.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.957+0000 7fdf167fc640 1 -- 172.21.15.107:0/1187917299 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8630b698-09f3-4bbf-ab11-bacfa6d25a5e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fdf1c0071a0 con 0x7fdf240ca600 2024-05-09T02:17:51.960 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 msgr2=0x7fdf2414ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 0x7fdf2414ea40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c710 tx=0x7fdf1c00cbd0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 shutdown_connections 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf240ca600 0x7fdf2414ea40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf240c8b40 0x7fdf240aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 --2- 172.21.15.107:0/1187917299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf24072380 0x7fdf240c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 >> 172.21.15.107:0/1187917299 conn(0x7fdf240ac930 msgr2=0x7fdf24156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.958+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 shutdown_connections 2024-05-09T02:17:51.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:51.959+0000 7fdf2bc2b640 1 -- 172.21.15.107:0/1187917299 wait complete. 2024-05-09T02:17:51.965 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:51.963+0000 7f46a7110040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T02:17:51.971 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new f3693cfb-a968-4cf1-a914-c95e51e7eca6 6 2024-05-09T02:17:51.989 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:51.986+0000 7f2cea12f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T02:17:52.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.079+0000 7fded6b73640 1 Processor -- start 2024-05-09T02:17:52.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.079+0000 7fded6b73640 1 -- start start 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded6b73640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fded006df50 0x7fded00c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded6b73640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fded00c51c0 0x7fded01593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded6b73640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded006e360 con 0x7fded006d0d0 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded6b73640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fded0158f20 con 0x7fded00c51c0 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded6b73640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fded00c5820 con 0x7fded006df50 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fdecffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fded006df50 0x7fded00c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded490f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fded006d0d0 0x7fded0158810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41008/0 (socket says 172.21.15.107:41008) 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fdecffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fded006df50 0x7fded00c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39704/0 (socket says 172.21.15.107:39704) 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded490f640 1 -- 172.21.15.107:0/4071192854 learned_addr learned my addr 172.21.15.107:0/4071192854 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.080+0000 7fded5110640 1 --2- 172.21.15.107:0/4071192854 >> v2:172.21.15.46:3300/0 conn(0x7fded00c51c0 0x7fded01593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecffff640 1 -- 172.21.15.107:0/4071192854 >> v2:172.21.15.46:3300/0 conn(0x7fded00c51c0 msgr2=0x7fded01593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecffff640 1 --2- 172.21.15.107:0/4071192854 >> v2:172.21.15.46:3300/0 conn(0x7fded00c51c0 0x7fded01593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecffff640 1 -- 172.21.15.107:0/4071192854 >> v1:172.21.15.107:6789/0 conn(0x7fded006d0d0 legacy=0x7fded0158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecffff640 1 -- 172.21.15.107:0/4071192854 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00c5b00 con 0x7fded006df50 2024-05-09T02:17:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecf7fe640 1 -- 172.21.15.107:0/4071192854 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483853595 0 0) 0x7fdec4001110 con 0x7fded006d0d0 2024-05-09T02:17:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecffff640 1 --2- 172.21.15.107:0/4071192854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00c4c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fded00acdd0 tx=0x7fdebc02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5250404c5c1b16a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecf7fe640 1 -- 172.21.15.107:0/4071192854 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc037070 con 0x7fded006df50 2024-05-09T02:17:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.081+0000 7fdecf7fe640 1 -- 172.21.15.107:0/4071192854 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc02add0 con 0x7fded006df50 2024-05-09T02:17:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fdecf7fe640 1 -- 172.21.15.107:0/4071192854 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc032660 con 0x7fded006df50 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 -- 172.21.15.107:0/4071192854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 msgr2=0x7fded00c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 --2- 172.21.15.107:0/4071192854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00c4c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fded00acdd0 tx=0x7fdebc02a080 comp rx=0 tx=0).stop 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 -- 172.21.15.107:0/4071192854 shutdown_connections 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 --2- 172.21.15.107:0/4071192854 >> v2:172.21.15.46:3300/0 conn(0x7fded00c51c0 0x7fded01593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 --2- 172.21.15.107:0/4071192854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00c4c80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 -- 172.21.15.107:0/4071192854 >> 172.21.15.107:0/4071192854 conn(0x7fded00c9e50 msgr2=0x7fded00ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 -- 172.21.15.107:0/4071192854 shutdown_connections 2024-05-09T02:17:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.082+0000 7fded6b73640 1 -- 172.21.15.107:0/4071192854 wait complete. 2024-05-09T02:17:52.087 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:52.084+0000 7f46a7110040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.084+0000 7fded6b73640 1 Processor -- start 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.084+0000 7fded6b73640 1 -- start start 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded6b73640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fded006d0d0 0x7fded01e2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded6b73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded6b73640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded00c51c0 0x7fded0151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded6b73640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fded0156e20 con 0x7fded00c51c0 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded6b73640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fded00c60c0 con 0x7fded006df50 2024-05-09T02:17:52.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded6b73640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fded00c4800 con 0x7fded006d0d0 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fdecffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fdecffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39720/0 (socket says 172.21.15.107:39720) 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fdecffff640 1 -- 172.21.15.107:0/146832310 learned_addr learned my addr 172.21.15.107:0/146832310 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.085+0000 7fded490f640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fded006d0d0 0x7fded01e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fded5110640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded00c51c0 0x7fded0151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecffff640 1 -- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fded006d0d0 msgr2=0x7fded01e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecffff640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fded006d0d0 0x7fded01e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecffff640 1 -- 172.21.15.107:0/146832310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded00c51c0 msgr2=0x7fded0151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecffff640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded00c51c0 0x7fded0151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecffff640 1 -- 172.21.15.107:0/146832310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded0151fc0 con 0x7fded006df50 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecffff640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00aaf10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009890 tx=0x7fdebc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc037040 con 0x7fded006df50 2024-05-09T02:17:52.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc042070 con 0x7fded006df50 2024-05-09T02:17:52.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded00bf330 con 0x7fded006df50 2024-05-09T02:17:52.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc03d660 con 0x7fded006df50 2024-05-09T02:17:52.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded0151ce0 con 0x7fded006df50 2024-05-09T02:17:52.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdebc03d800 con 0x7fded006df50 2024-05-09T02:17:52.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.086+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fdebc03b3f0 con 0x7fded006df50 2024-05-09T02:17:52.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.087+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded006a330 con 0x7fded006df50 2024-05-09T02:17:52.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.089+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdebc03dc80 con 0x7fded006df50 2024-05-09T02:17:52.108 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:52.106+0000 7f2cea12f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T02:17:52.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.181+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3693cfb-a968-4cf1-a914-c95e51e7eca6", "id": 6} v 0) -- 0x7fded00c4a60 con 0x7fded006df50 2024-05-09T02:17:52.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.186+0000 7fdecd7fa640 1 -- 172.21.15.107:0/146832310 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3693cfb-a968-4cf1-a914-c95e51e7eca6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fdebc047460 con 0x7fded006df50 2024-05-09T02:17:52.188 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-05-09T02:17:52.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 msgr2=0x7fded00aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00aaf10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009890 tx=0x7fdebc0046c0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 shutdown_connections 2024-05-09T02:17:52.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded00c51c0 0x7fded0151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fded006df50 0x7fded00aaf10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 --2- 172.21.15.107:0/146832310 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fded006d0d0 0x7fded01e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 >> 172.21.15.107:0/146832310 conn(0x7fded00c9e50 msgr2=0x7fded0158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:52.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 shutdown_connections 2024-05-09T02:17:52.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.187+0000 7fded6b73640 1 -- 172.21.15.107:0/146832310 wait complete. 2024-05-09T02:17:52.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new a4088852-f89d-4b4e-bd35-2bae9d95a537 7 2024-05-09T02:17:52.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.308+0000 7f9ed510d640 1 Processor -- start 2024-05-09T02:17:52.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.308+0000 7f9ed510d640 1 -- start start 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ed510d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed0070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ed510d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ed015b0b0 0x7f9ed015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ed510d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed0157b40 con 0x7f9ed00c5f90 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ed510d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed00c4190 con 0x7f9ed015b0b0 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ed510d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed0157e20 con 0x7f9ed0070a70 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ecf59e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ed015b0b0 0x7f9ed015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed0070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ecf59e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ed015b0b0 0x7f9ed015b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39730/0 (socket says 172.21.15.107:39730) 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ecf59e640 1 -- 172.21.15.107:0/832889153 learned_addr learned my addr 172.21.15.107:0/832889153 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ecf59e640 1 -- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 msgr2=0x7f9ed0070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:52.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ecf59e640 1 --2- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed0070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.309+0000 7f9ecf59e640 1 -- 172.21.15.107:0/832889153 >> v1:172.21.15.46:6789/0 conn(0x7f9ed00c5f90 legacy=0x7f9ed00c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.310+0000 7f9ecf59e640 1 -- 172.21.15.107:0/832889153 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed0158100 con 0x7f9ed015b0b0 2024-05-09T02:17:52.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.310+0000 7f9ece59c640 1 --2- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed0070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:52.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.310+0000 7f9ecf59e640 1 --2- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed015b0b0 0x7f9ed015b4c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009e50 tx=0x7f9ec802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e30d82af0bcb0e9f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:52.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.310+0000 7f9ecdd9b640 1 -- 172.21.15.107:0/832889153 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8036070 con 0x7f9ed015b0b0 2024-05-09T02:17:52.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.310+0000 7f9ecdd9b640 1 -- 172.21.15.107:0/832889153 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8031600 con 0x7f9ed015b0b0 2024-05-09T02:17:52.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.310+0000 7f9ecdd9b640 1 -- 172.21.15.107:0/832889153 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80319d0 con 0x7f9ed015b0b0 2024-05-09T02:17:52.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 -- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed015b0b0 msgr2=0x7f9ed015b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 --2- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed015b0b0 0x7f9ed015b4c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009e50 tx=0x7f9ec802a680 comp rx=0 tx=0).stop 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 -- 172.21.15.107:0/832889153 shutdown_connections 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 --2- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed015b0b0 0x7f9ed015b4c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 --2- 172.21.15.107:0/832889153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed0070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 -- 172.21.15.107:0/832889153 >> 172.21.15.107:0/832889153 conn(0x7f9ed00c9e50 msgr2=0x7f9ed00ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 -- 172.21.15.107:0/832889153 shutdown_connections 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.311+0000 7f9ed510d640 1 -- 172.21.15.107:0/832889153 wait complete. 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.313+0000 7f9ed510d640 1 Processor -- start 2024-05-09T02:17:52.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.313+0000 7f9ed510d640 1 -- start start 2024-05-09T02:17:52.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ed510d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ed510d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 0x7f9ed0154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ed510d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed015b0b0 0x7f9ed0152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ed510d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed00c6520 con 0x7f9ed015b0b0 2024-05-09T02:17:52.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ed510d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed00c63a0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ed510d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed006e460 con 0x7f9ed0070a70 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 0x7f9ed0154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9eced9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 0x7f9ed0154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39732/0 (socket says 172.21.15.107:39732) 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.314+0000 7f9ece59c640 1 -- 172.21.15.107:0/2730914997 learned_addr learned my addr 172.21.15.107:0/2730914997 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ecf59e640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed015b0b0 0x7f9ed0152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ece59c640 1 -- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 msgr2=0x7f9ed014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ece59c640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed014c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ece59c640 1 -- 172.21.15.107:0/2730914997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed015b0b0 msgr2=0x7f9ed0152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ece59c640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed015b0b0 0x7f9ed0152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ece59c640 1 -- 172.21.15.107:0/2730914997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed00ae7d0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9eced9d640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:52.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ecf59e640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed015b0b0 0x7f9ed0152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ece59c640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 0x7f9ed0154be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400e940 tx=0x7f9ec400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4017070 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec400ca00 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed014d4a0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400cdb0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed014cf50 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.315+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ec401a070 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.316+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9ec401cab0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.316+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed006e8b0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.320+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9ec4009360 con 0x7f9ed00c5f90 2024-05-09T02:17:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.393+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a4088852-f89d-4b4e-bd35-2bae9d95a537", "id": 7} v 0) -- 0x7f9ed006a330 con 0x7f9ed00c5f90 2024-05-09T02:17:52.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.399+0000 7f9eb77fe640 1 -- 172.21.15.107:0/2730914997 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4088852-f89d-4b4e-bd35-2bae9d95a537", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9ec401c5c0 con 0x7f9ed00c5f90 2024-05-09T02:17:52.402 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 msgr2=0x7f9ed0154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 0x7f9ed0154be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400e940 tx=0x7f9ec400ee00 comp rx=0 tx=0).stop 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 shutdown_connections 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed015b0b0 0x7f9ed0152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ed00c5f90 0x7f9ed0154be0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 --2- 172.21.15.107:0/2730914997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ed0070a70 0x7f9ed014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 >> 172.21.15.107:0/2730914997 conn(0x7f9ed00c9e50 msgr2=0x7f9ed0157290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 shutdown_connections 2024-05-09T02:17:52.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:17:52.400+0000 7f9ed510d640 1 -- 172.21.15.107:0/2730914997 wait complete. 2024-05-09T02:17:52.413 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T02:17:52.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T02:17:52.416 INFO:tasks.ceph.osd.0:Started 2024-05-09T02:17:52.416 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T02:17:52.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T02:17:52.418 INFO:tasks.ceph.osd.1:Started 2024-05-09T02:17:52.418 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T02:17:52.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T02:17:52.420 INFO:tasks.ceph.osd.2:Started 2024-05-09T02:17:52.421 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T02:17:52.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T02:17:52.423 INFO:tasks.ceph.osd.3:Started 2024-05-09T02:17:52.423 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T02:17:52.423 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T02:17:52.425 INFO:tasks.ceph.osd.4:Started 2024-05-09T02:17:52.425 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T02:17:52.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T02:17:52.427 INFO:tasks.ceph.osd.5:Started 2024-05-09T02:17:52.427 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T02:17:52.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T02:17:52.430 INFO:tasks.ceph.osd.6:Started 2024-05-09T02:17:52.430 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T02:17:52.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T02:17:52.432 INFO:tasks.ceph.osd.7:Started 2024-05-09T02:17:52.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:17:52.516 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:52.513+0000 7f46a7110040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T02:17:52.558 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:52.556+0000 7f2cea12f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T02:17:52.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.572+0000 7ffb5c95e640 1 Processor -- start 2024-05-09T02:17:52.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.572+0000 7ffb5c95e640 1 -- start start 2024-05-09T02:17:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5c95e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb5806faf0 0x7ffb58073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5c95e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffb58074020 0x7ffb580c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5c95e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb580c9670 con 0x7ffb5806df50 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5c95e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5815fd50 con 0x7ffb58074020 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5c95e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffb58071660 con 0x7ffb5806faf0 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffb5806df50 0x7ffb580c6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37754/0 (socket says 172.21.15.46:37754) 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb5659c640 1 -- 172.21.15.46:0/2112317871 learned_addr learned my addr 172.21.15.46:0/2112317871 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb56d9d640 1 --2- 172.21.15.46:0/2112317871 >> v2:172.21.15.46:3300/0 conn(0x7ffb58074020 0x7ffb580c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.573+0000 7ffb55d9b640 1 --2- 172.21.15.46:0/2112317871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb5806faf0 0x7ffb58073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.574+0000 7ffb5559a640 1 -- 172.21.15.46:0/2112317871 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243225978 0 0) 0x7ffb580c9670 con 0x7ffb5806df50 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.574+0000 7ffb55d9b640 1 -- 172.21.15.46:0/2112317871 >> v2:172.21.15.46:3300/0 conn(0x7ffb58074020 msgr2=0x7ffb580c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.574+0000 7ffb55d9b640 1 --2- 172.21.15.46:0/2112317871 >> v2:172.21.15.46:3300/0 conn(0x7ffb58074020 0x7ffb580c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.574+0000 7ffb55d9b640 1 -- 172.21.15.46:0/2112317871 >> v1:172.21.15.46:6789/0 conn(0x7ffb5806df50 legacy=0x7ffb580c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.574+0000 7ffb55d9b640 1 -- 172.21.15.46:0/2112317871 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb58160280 con 0x7ffb5806faf0 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.575+0000 7ffb55d9b640 1 --2- 172.21.15.46:0/2112317871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb5806faf0 0x7ffb58073ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097a0 tx=0x7ffb4c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c99d0be1a7837 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.575+0000 7ffb5559a640 1 -- 172.21.15.46:0/2112317871 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c037070 con 0x7ffb5806faf0 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.575+0000 7ffb5559a640 1 -- 172.21.15.46:0/2112317871 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c02adb0 con 0x7ffb5806faf0 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.575+0000 7ffb5559a640 1 -- 172.21.15.46:0/2112317871 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c032660 con 0x7ffb5806faf0 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 -- 172.21.15.46:0/2112317871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb5806faf0 msgr2=0x7ffb58073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/2112317871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb5806faf0 0x7ffb58073ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097a0 tx=0x7ffb4c02a060 comp rx=0 tx=0).stop 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 -- 172.21.15.46:0/2112317871 shutdown_connections 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/2112317871 >> v2:172.21.15.46:3300/0 conn(0x7ffb58074020 0x7ffb580c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/2112317871 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb5806faf0 0x7ffb58073ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 -- 172.21.15.46:0/2112317871 >> 172.21.15.46:0/2112317871 conn(0x7ffb580aba90 msgr2=0x7ffb580abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:52.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 -- 172.21.15.46:0/2112317871 shutdown_connections 2024-05-09T02:17:52.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.576+0000 7ffb5c95e640 1 -- 172.21.15.46:0/2112317871 wait complete. 2024-05-09T02:17:52.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.578+0000 7ffb5c95e640 1 Processor -- start 2024-05-09T02:17:52.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.578+0000 7ffb5c95e640 1 -- start start 2024-05-09T02:17:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5c95e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 0x7ffb5815e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5c95e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb5806faf0 0x7ffb581f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5c95e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb58074020 0x7ffb58152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5c95e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5815ffa0 con 0x7ffb5806df50 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5c95e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffb580c9910 con 0x7ffb5806faf0 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5c95e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffb58071af0 con 0x7ffb58074020 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 0x7ffb5815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 0x7ffb5815e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49352/0 (socket says 172.21.15.46:49352) 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb5659c640 1 -- 172.21.15.46:0/442476945 learned_addr learned my addr 172.21.15.46:0/442476945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.579+0000 7ffb56d9d640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb58074020 0x7ffb58152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb55d9b640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb5806faf0 0x7ffb581f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5659c640 1 -- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb58074020 msgr2=0x7ffb58152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5659c640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb58074020 0x7ffb58152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5659c640 1 -- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb5806faf0 msgr2=0x7ffb581f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5659c640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb5806faf0 0x7ffb581f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5659c640 1 -- 172.21.15.46:0/442476945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb58155180 con 0x7ffb5806df50 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb56d9d640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb58074020 0x7ffb58152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5659c640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 0x7ffb5815e580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c390 tx=0x7ffb4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48017070 con 0x7ffb5806df50 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb48005ce0 con 0x7ffb5806df50 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb581f6030 con 0x7ffb5806df50 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48007310 con 0x7ffb5806df50 2024-05-09T02:17:52.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.580+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5815f1f0 con 0x7ffb5806df50 2024-05-09T02:17:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.581+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffb4801a070 con 0x7ffb5806df50 2024-05-09T02:17:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.581+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ffb48012ad0 con 0x7ffb5806df50 2024-05-09T02:17:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.582+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5815f430 con 0x7ffb5806df50 2024-05-09T02:17:52.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.584+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ffb5815f430 con 0x7ffb5806df50 2024-05-09T02:17:52.662 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:52.660+0000 7f46a7110040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T02:17:52.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.670+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb5806a330 con 0x7ffb5806df50 2024-05-09T02:17:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.671+0000 7ffb46ffd640 1 -- 172.21.15.46:0/442476945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ffb48021020 con 0x7ffb5806df50 2024-05-09T02:17:52.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:17:52.674 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:17:52.394989+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 msgr2=0x7ffb5815e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 0x7ffb5815e580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c390 tx=0x7ffb4800c850 comp rx=0 tx=0).stop 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 shutdown_connections 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb58074020 0x7ffb58152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb5806faf0 0x7ffb581f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 --2- 172.21.15.46:0/442476945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5806df50 0x7ffb5815e580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 >> 172.21.15.46:0/442476945 conn(0x7ffb580aba90 msgr2=0x7ffb580abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 shutdown_connections 2024-05-09T02:17:52.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:17:52.672+0000 7ffb5c95e640 1 -- 172.21.15.46:0/442476945 wait complete. 2024-05-09T02:17:52.685 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T02:17:52.685 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T02:17:52.730 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:52.728+0000 7f2cea12f040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T02:17:52.920 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:52.918+0000 7f46a7110040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T02:17:52.972 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:52.969+0000 7f46a7110040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T02:17:53.006 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.003+0000 7f2cea12f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T02:17:53.048 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-09T02:17:53.046+0000 7f0eef00d640 -1 Falling back to public interface 2024-05-09T02:17:53.050 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-05-09T02:17:53.047+0000 7f03e9815640 -1 Falling back to public interface 2024-05-09T02:17:53.051 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-09T02:17:53.049+0000 7f9f7e818640 -1 Falling back to public interface 2024-05-09T02:17:53.055 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-09T02:17:53.053+0000 7f2868bba640 -1 Falling back to public interface 2024-05-09T02:17:53.061 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.059+0000 7f2cea12f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T02:17:53.061 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-09T02:17:53.059+0000 7fc880221640 -1 Falling back to public interface 2024-05-09T02:17:53.067 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-05-09T02:17:53.064+0000 7ff8d35c2640 -1 Falling back to public interface 2024-05-09T02:17:53.067 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-05-09T02:17:53.064+0000 7f3b14015640 -1 Falling back to public interface 2024-05-09T02:17:53.068 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-05-09T02:17:53.066+0000 7f4c2a89d640 -1 Falling back to public interface 2024-05-09T02:17:53.093 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.091+0000 7f46a7110040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T02:17:53.188 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.186+0000 7f2cea12f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T02:17:53.388 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.385+0000 7f46a7110040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T02:17:53.435 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.433+0000 7f46a7110040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T02:17:53.500 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.498+0000 7f2cea12f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T02:17:53.530 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T02:17:53.551 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.549+0000 7f2cea12f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T02:17:53.592 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.589+0000 7f46a7110040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T02:17:53.636 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.633+0000 7f719ad26640 1 Processor -- start 2024-05-09T02:17:53.636 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.633+0000 7f719ad26640 1 -- start start 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f719ad26640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194155110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f719ad26640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719406e6f0 con 0x7f71940c94b0 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f719ad26640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719406e9d0 con 0x7f719415b040 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f719ad26640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f719406f020 con 0x7f7194154d00 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f7198ac2640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f71940c94b0 0x7f71940cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37760/0 (socket says 172.21.15.46:37760) 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f7198ac2640 1 -- 172.21.15.46:0/1267576914 learned_addr learned my addr 172.21.15.46:0/1267576914 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.634+0000 7f7193fff640 1 --2- 172.21.15.46:0/1267576914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238135911 0 0) 0x7f719406e6f0 con 0x7f71940c94b0 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7184003520 con 0x7f71940c94b0 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214608915 0 0) 0x7f719406e9d0 con 0x7f719415b040 2024-05-09T02:17:53.638 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f719406e6f0 con 0x7f719415b040 2024-05-09T02:17:53.639 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f7193fff640 1 -- 172.21.15.46:0/1267576914 >> v1:172.21.15.107:6789/0 conn(0x7f719415b040 legacy=0x7f719415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:53.639 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f7193fff640 1 -- 172.21.15.46:0/1267576914 >> v1:172.21.15.46:6789/0 conn(0x7f71940c94b0 legacy=0x7f71940cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:53.639 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.635+0000 7f7193fff640 1 -- 172.21.15.46:0/1267576914 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719406ecb0 con 0x7f7194154d00 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.636+0000 7f7193fff640 1 --2- 172.21.15.46:0/1267576914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194155110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71800097d0 tx=0x7f718002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f034750b4712805a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.636+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180037070 con 0x7f7194154d00 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.636+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180032440 con 0x7f7194154d00 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.636+0000 7f71937fe640 1 -- 172.21.15.46:0/1267576914 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180032810 con 0x7f7194154d00 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 -- 172.21.15.46:0/1267576914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 msgr2=0x7f7194155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 --2- 172.21.15.46:0/1267576914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194155110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71800097d0 tx=0x7f718002a180 comp rx=0 tx=0).stop 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 -- 172.21.15.46:0/1267576914 shutdown_connections 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 --2- 172.21.15.46:0/1267576914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194155110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:53.640 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 -- 172.21.15.46:0/1267576914 >> 172.21.15.46:0/1267576914 conn(0x7f71940aceb0 msgr2=0x7f71940cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:53.641 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 -- 172.21.15.46:0/1267576914 shutdown_connections 2024-05-09T02:17:53.641 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.637+0000 7f719ad26640 1 -- 172.21.15.46:0/1267576914 wait complete. 2024-05-09T02:17:53.641 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.638+0000 7f719ad26640 1 Processor -- start 2024-05-09T02:17:53.641 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.638+0000 7f719ad26640 1 -- start start 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f719ad26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 0x7f71940ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f719ad26640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f719ad26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719415b040 0x7f71940af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f719ad26640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f719415bb60 con 0x7f71940c94b0 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f719ad26640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f71940c9d80 con 0x7f719415b040 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f719ad26640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f719415bce0 con 0x7f7194154d00 2024-05-09T02:17:53.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 0x7f71940ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 0x7f71940ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49366/0 (socket says 172.21.15.46:49366) 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 -- 172.21.15.46:0/2000341105 learned_addr learned my addr 172.21.15.46:0/2000341105 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f71992c3640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719415b040 0x7f71940af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7193fff640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 -- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 msgr2=0x7f7194072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 -- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719415b040 msgr2=0x7f71940af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719415b040 0x7f71940af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 -- 172.21.15.46:0/2000341105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941ee3f0 con 0x7f71940c94b0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.640+0000 7f7198ac2640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 0x7f71940ada00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f718800c3c0 tx=0x7f718800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188017070 con 0x7f71940c94b0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7188005ce0 con 0x7f71940c94b0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880072f0 con 0x7f71940c94b0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7194150450 con 0x7f71940c94b0 2024-05-09T02:17:53.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941ee690 con 0x7f71940c94b0 2024-05-09T02:17:53.646 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f718801a070 con 0x7f71940c94b0 2024-05-09T02:17:53.646 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.641+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7188012ad0 con 0x7f71940c94b0 2024-05-09T02:17:53.646 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.642+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71940ac2a0 con 0x7f71940c94b0 2024-05-09T02:17:53.646 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.644+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7188021020 con 0x7f71940c94b0 2024-05-09T02:17:53.709 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.707+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71940c9950 con 0x7f71940c94b0 2024-05-09T02:17:53.710 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.707+0000 7f71917fa640 1 -- 172.21.15.46:0/2000341105 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7188007490 con 0x7f71940c94b0 2024-05-09T02:17:53.710 INFO:teuthology.misc.health.smithi046.stdout: 2024-05-09T02:17:53.710 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:17:52.394989+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:17:53.711 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 msgr2=0x7f71940ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:17:53.711 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 0x7f71940ada00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f718800c3c0 tx=0x7f718800c880 comp rx=0 tx=0).stop 2024-05-09T02:17:53.711 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 shutdown_connections 2024-05-09T02:17:53.711 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719415b040 0x7f71940af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:53.711 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7194154d00 0x7f7194072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:53.711 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 --2- 172.21.15.46:0/2000341105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71940c94b0 0x7f71940ada00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:17:53.712 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 >> 172.21.15.46:0/2000341105 conn(0x7f71940aceb0 msgr2=0x7f7194156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:17:53.712 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 shutdown_connections 2024-05-09T02:17:53.712 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:17:53.708+0000 7f719ad26640 1 -- 172.21.15.46:0/2000341105 wait complete. 2024-05-09T02:17:53.720 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T02:17:53.722 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.720+0000 7f2cea12f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T02:17:53.729 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.727+0000 7f46a7110040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T02:17:53.778 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.776+0000 7f46a7110040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T02:17:53.847 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.845+0000 7f46a7110040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T02:17:53.869 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.866+0000 7f2cea12f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T02:17:53.894 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:53.892+0000 7f46a7110040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T02:17:53.922 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.919+0000 7f2cea12f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T02:17:53.996 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:53.994+0000 7f2cea12f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T02:17:54.044 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:54.042+0000 7f2cea12f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T02:17:54.370 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:54.368+0000 7f46a7110040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T02:17:54.487 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:54.485+0000 7f46a7110040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T02:17:54.553 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:54.551+0000 7f2cea12f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T02:17:54.676 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-05-09T02:17:54.673+0000 7f2cea12f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T02:17:55.506 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:55.504+0000 7f464735a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T02:17:55.506 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-09T02:17:55.504+0000 7f464735a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T02:17:56.509 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-05-09T02:17:56.507+0000 7f03e9815640 -1 osd.0 0 log_to_monitors true 2024-05-09T02:17:56.537 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-09T02:17:56.535+0000 7f2868bba640 -1 osd.5 0 log_to_monitors true 2024-05-09T02:17:56.551 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-09T02:17:56.549+0000 7f0eef00d640 -1 osd.7 0 log_to_monitors true 2024-05-09T02:17:56.564 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-09T02:17:56.562+0000 7fc880221640 -1 osd.4 0 log_to_monitors true 2024-05-09T02:17:56.565 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-09T02:17:56.563+0000 7f9f7e818640 -1 osd.6 0 log_to_monitors true 2024-05-09T02:17:56.570 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-05-09T02:17:56.568+0000 7ff8d35c2640 -1 osd.3 0 log_to_monitors true 2024-05-09T02:17:56.572 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-05-09T02:17:56.570+0000 7f4c2a89d640 -1 osd.2 0 log_to_monitors true 2024-05-09T02:17:56.575 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-05-09T02:17:56.573+0000 7f3b14015640 -1 osd.1 0 log_to_monitors true 2024-05-09T02:18:00.013 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-05-09T02:18:00.012+0000 7f03e5940640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T02:18:00.027 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-05-09T02:18:00.026+0000 7f03dcf27640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.048 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-05-09T02:18:00.046+0000 7ff8cf558640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T02:18:00.057 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-05-09T02:18:00.056+0000 7ff8c7353640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.068 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-05-09T02:18:00.067+0000 7f4c26833640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T02:18:00.079 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-05-09T02:18:00.078+0000 7f4c1e62e640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.097 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-05-09T02:18:00.095+0000 7f3b0f8fb640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T02:18:00.109 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-05-09T02:18:00.108+0000 7f3b076f6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.528 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:00.639 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.637+0000 7fc861300640 1 Processor -- start 2024-05-09T02:18:00.639 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.637+0000 7fc861300640 1 -- start start 2024-05-09T02:18:00.641 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.638+0000 7fc861300640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c0c80b0 0x7fc85c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc861300640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc85c1551b0 0x7fc85c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc861300640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc85c15b710 0x7fc85c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc861300640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c15afa0 con 0x7fc85c1551b0 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc861300640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c0cae80 con 0x7fc85c15b710 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc861300640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c0cc4c0 con 0x7fc85c0c80b0 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc85c1551b0 0x7fc85c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc85c1551b0 0x7fc85c0cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42158/0 (socket says 172.21.15.46:42158) 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 -- 172.21.15.46:0/573114868 learned_addr learned my addr 172.21.15.46:0/573114868 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85affd640 1 --2- 172.21.15.46:0/573114868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c0c80b0 0x7fc85c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85b7fe640 1 --2- 172.21.15.46:0/573114868 >> v2:172.21.15.107:3300/0 conn(0x7fc85c15b710 0x7fc85c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 -- 172.21.15.46:0/573114868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c0c80b0 msgr2=0x7fc85c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:00.642 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 --2- 172.21.15.46:0/573114868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c0c80b0 0x7fc85c157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 -- 172.21.15.46:0/573114868 >> v2:172.21.15.107:3300/0 conn(0x7fc85c15b710 msgr2=0x7fc85c15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 --2- 172.21.15.46:0/573114868 >> v2:172.21.15.107:3300/0 conn(0x7fc85c15b710 0x7fc85c15bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.639+0000 7fc85a7fc640 1 -- 172.21.15.46:0/573114868 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c0cc7a0 con 0x7fc85c1551b0 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.640+0000 7fc85a7fc640 1 --2- 172.21.15.46:0/573114868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c1551b0 0x7fc85c0cbd70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0ac870 tx=0x7fc84402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f570f47bc18671 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.640+0000 7fc859ffb640 1 -- 172.21.15.46:0/573114868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844037070 con 0x7fc85c1551b0 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.640+0000 7fc859ffb640 1 -- 172.21.15.46:0/573114868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844032440 con 0x7fc85c1551b0 2024-05-09T02:18:00.643 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.640+0000 7fc859ffb640 1 -- 172.21.15.46:0/573114868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844032810 con 0x7fc85c1551b0 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 -- 172.21.15.46:0/573114868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c1551b0 msgr2=0x7fc85c0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 --2- 172.21.15.46:0/573114868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c1551b0 0x7fc85c0cbd70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0ac870 tx=0x7fc84402a1e0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 -- 172.21.15.46:0/573114868 shutdown_connections 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 --2- 172.21.15.46:0/573114868 >> v2:172.21.15.107:3300/0 conn(0x7fc85c15b710 0x7fc85c15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 --2- 172.21.15.46:0/573114868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c1551b0 0x7fc85c0cbd70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 --2- 172.21.15.46:0/573114868 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c0c80b0 0x7fc85c157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.644 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 -- 172.21.15.46:0/573114868 >> 172.21.15.46:0/573114868 conn(0x7fc85c0aed40 msgr2=0x7fc85c0af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:00.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 -- 172.21.15.46:0/573114868 shutdown_connections 2024-05-09T02:18:00.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.641+0000 7fc861300640 1 -- 172.21.15.46:0/573114868 wait complete. 2024-05-09T02:18:00.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.643+0000 7fc861300640 1 Processor -- start 2024-05-09T02:18:00.645 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.643+0000 7fc861300640 1 -- start start 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc861300640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc85c0c80b0 0x7fc85c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc861300640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c1551b0 0x7fc85c156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc861300640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 0x7fc85c0c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc861300640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0cb270 con 0x7fc85c15b710 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc861300640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c15b1f0 con 0x7fc85c0c80b0 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc861300640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c0cb3f0 con 0x7fc85c1551b0 2024-05-09T02:18:00.647 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 0x7fc85c0c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 0x7fc85c0c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42162/0 (socket says 172.21.15.46:42162) 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 -- 172.21.15.46:0/3676228574 learned_addr learned my addr 172.21.15.46:0/3676228574 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85affd640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc85c0c80b0 0x7fc85c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85a7fc640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c1551b0 0x7fc85c156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 -- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c1551b0 msgr2=0x7fc85c156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c1551b0 0x7fc85c156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 -- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc85c0c80b0 msgr2=0x7fc85c150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc85c0c80b0 0x7fc85c150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 -- 172.21.15.46:0/3676228574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c0c42e0 con 0x7fc85c15b710 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc85b7fe640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 0x7fc85c0c1d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc85400e7f0 tx=0x7fc85400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.644+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854017070 con 0x7fc85c15b710 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.645+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85400c730 con 0x7fc85c15b710 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.645+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c14e0f0 con 0x7fc85c15b710 2024-05-09T02:18:00.648 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.645+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85400cb20 con 0x7fc85c15b710 2024-05-09T02:18:00.649 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.645+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1ee260 con 0x7fc85c15b710 2024-05-09T02:18:00.649 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.645+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c0c1a70 con 0x7fc85c15b710 2024-05-09T02:18:00.649 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.646+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fc85401a070 con 0x7fc85c15b710 2024-05-09T02:18:00.649 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.647+0000 7fc8537fe640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc83c076240 0x7fc83c078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:00.649 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.647+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fc854096b70 con 0x7fc85c15b710 2024-05-09T02:18:00.650 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.647+0000 7fc85affd640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc83c076240 0x7fc83c078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:00.650 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.648+0000 7fc85affd640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc83c076240 0x7fc83c078750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011340 tx=0x7fc84c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:00.653 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.651+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc854060dd0 con 0x7fc85c15b710 2024-05-09T02:18:00.690 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-09T02:18:00.688+0000 7f9f7a1a0640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T02:18:00.695 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-09T02:18:00.693+0000 7f2864b50640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T02:18:00.703 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-09T02:18:00.701+0000 7f9f71f9b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.706 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-09T02:18:00.704+0000 7fc87c1b7640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T02:18:00.707 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-09T02:18:00.705+0000 7f0eeaa38640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T02:18:00.708 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-09T02:18:00.706+0000 7f285c94b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.720 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-09T02:18:00.718+0000 7f0ee2833640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.721 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-09T02:18:00.719+0000 7fc873fb2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T02:18:00.845 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.844+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc85c14e2c0 con 0x7fc85c15b710 2024-05-09T02:18:00.846 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.844+0000 7fc8537fe640 1 -- 172.21.15.46:0/3676228574 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fc8540650d0 con 0x7fc85c15b710 2024-05-09T02:18:00.846 INFO:teuthology.misc.health.smithi046.stdout: 2024-05-09T02:18:00.846 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":12,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:17:58.507503+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:00.848 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.846+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc83c076240 msgr2=0x7fc83c078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:00.848 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.846+0000 7fc861300640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc83c076240 0x7fc83c078750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011340 tx=0x7fc84c00b040 comp rx=0 tx=0).stop 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.846+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 msgr2=0x7fc85c0c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.846+0000 7fc861300640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 0x7fc85c0c1d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc85400e7f0 tx=0x7fc85400ecb0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 shutdown_connections 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc83c076240 0x7fc83c078750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c15b710 0x7fc85c0c1d80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc85c1551b0 0x7fc85c156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 --2- 172.21.15.46:0/3676228574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc85c0c80b0 0x7fc85c150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 >> 172.21.15.46:0/3676228574 conn(0x7fc85c0aed40 msgr2=0x7fc85c0c9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 shutdown_connections 2024-05-09T02:18:00.849 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:00.847+0000 7fc861300640 1 -- 172.21.15.46:0/3676228574 wait complete. 2024-05-09T02:18:00.858 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T02:18:07.666 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:07.785 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.783+0000 7f7920a27640 1 Processor -- start 2024-05-09T02:18:07.785 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.783+0000 7f7920a27640 1 -- start start 2024-05-09T02:18:07.787 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.784+0000 7f7920a27640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f791c0c80b0 0x7f791c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:07.787 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.784+0000 7f7920a27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0cbd70 0x7f791c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:07.787 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.784+0000 7f7920a27640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791c0cae80 con 0x7f791c1551b0 2024-05-09T02:18:07.787 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.784+0000 7f7920a27640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f791c15afa0 con 0x7f791c0c80b0 2024-05-09T02:18:07.787 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.784+0000 7f7920a27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f791c0cc4c0 con 0x7f791c0cbd70 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.784+0000 7f791a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f791c0c80b0 0x7f791c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f791c0c80b0 0x7f791c157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35586/0 (socket says 172.21.15.46:35586) 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791a59c640 1 -- 172.21.15.46:0/1826425214 learned_addr learned my addr 172.21.15.46:0/1826425214 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791ad9d640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0cbd70 0x7f791c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791a59c640 1 -- 172.21.15.46:0/1826425214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0cbd70 msgr2=0x7f791c0cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791a59c640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0cbd70 0x7f791c0cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791a59c640 1 -- 172.21.15.46:0/1826425214 >> v1:172.21.15.46:6789/0 conn(0x7f791c1551b0 legacy=0x7f791c15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791a59c640 1 -- 172.21.15.46:0/1826425214 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c0cc7a0 con 0x7f791c0c80b0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f7919d9b640 1 -- 172.21.15.46:0/1826425214 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954849424 0 0) 0x7f791c0cae80 con 0x7f791c1551b0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.785+0000 7f791ad9d640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0cbd70 0x7f791c0cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.786+0000 7f791a59c640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c0c80b0 0x7f791c157a30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f790c009870 tx=0x7f790c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6d359479fed603 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.786+0000 7f7919d9b640 1 -- 172.21.15.46:0/1826425214 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c037070 con 0x7f791c0c80b0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.786+0000 7f7919d9b640 1 -- 172.21.15.46:0/1826425214 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c032440 con 0x7f791c0c80b0 2024-05-09T02:18:07.788 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.786+0000 7f7919d9b640 1 -- 172.21.15.46:0/1826425214 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c032810 con 0x7f791c0c80b0 2024-05-09T02:18:07.789 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.786+0000 7f7920a27640 1 -- 172.21.15.46:0/1826425214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c0c80b0 msgr2=0x7f791c157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:07.789 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.786+0000 7f7920a27640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c0c80b0 0x7f791c157a30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f790c009870 tx=0x7f790c02a270 comp rx=0 tx=0).stop 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.787+0000 7f7920a27640 1 -- 172.21.15.46:0/1826425214 shutdown_connections 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.787+0000 7f7920a27640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0cbd70 0x7f791c0cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.787+0000 7f7920a27640 1 --2- 172.21.15.46:0/1826425214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c0c80b0 0x7f791c157a30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.787+0000 7f7920a27640 1 -- 172.21.15.46:0/1826425214 >> 172.21.15.46:0/1826425214 conn(0x7f791c0aed40 msgr2=0x7f791c0af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.787+0000 7f7920a27640 1 -- 172.21.15.46:0/1826425214 shutdown_connections 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.787+0000 7f7920a27640 1 -- 172.21.15.46:0/1826425214 wait complete. 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.789+0000 7f7920a27640 1 Processor -- start 2024-05-09T02:18:07.790 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.789+0000 7f7920a27640 1 -- start start 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7920a27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0c80b0 0x7f791c1e1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7920a27640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c0cbd70 0x7f791c0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7920a27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 0x7f791c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7920a27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f791c15be20 con 0x7f791c1551b0 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7920a27640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f791c15b1f0 con 0x7f791c0cbd70 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7920a27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f791c0cc180 con 0x7f791c0c80b0 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 0x7f791c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 0x7f791c151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35598/0 (socket says 172.21.15.46:35598) 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 -- 172.21.15.46:0/2148268039 learned_addr learned my addr 172.21.15.46:0/2148268039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791a59c640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0c80b0 0x7f791c1e1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7913fff640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c0cbd70 0x7f791c0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 -- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0c80b0 msgr2=0x7f791c1e1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:07.793 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0c80b0 0x7f791c1e1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 -- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c0cbd70 msgr2=0x7f791c0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c0cbd70 0x7f791c0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f791ad9d640 1 -- 172.21.15.46:0/2148268039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c1eebe0 con 0x7f791c1551b0 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.790+0000 7f7913fff640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c0cbd70 0x7f791c0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.791+0000 7f791ad9d640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 0x7f791c151c50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f791400cd80 tx=0x7f791400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.791+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400f680 con 0x7f791c1551b0 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.791+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791400f840 con 0x7f791c1551b0 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.791+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791c0c2f40 con 0x7f791c1551b0 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.791+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400fc30 con 0x7f791c1551b0 2024-05-09T02:18:07.794 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.791+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791c0c31e0 con 0x7f791c1551b0 2024-05-09T02:18:07.795 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.792+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791c159f20 con 0x7f791c1551b0 2024-05-09T02:18:07.795 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.793+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79140213f0 con 0x7f791c1551b0 2024-05-09T02:18:07.795 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.793+0000 7f7912ffd640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f78fc0762d0 0x7f78fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:07.795 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.793+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7914097ee0 con 0x7f791c1551b0 2024-05-09T02:18:07.795 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.794+0000 7f791a59c640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f78fc0762d0 0x7f78fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:07.796 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.794+0000 7f791a59c640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f78fc0762d0 0x7f78fc0787e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f790c034000 tx=0x7f790c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:07.800 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.799+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f791c159f20 con 0x7f791c1551b0 2024-05-09T02:18:07.992 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.990+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f791c06a330 con 0x7f791c1551b0 2024-05-09T02:18:07.993 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.991+0000 7f7912ffd640 1 -- 172.21.15.46:0/2148268039 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f7914014030 con 0x7f791c1551b0 2024-05-09T02:18:07.993 INFO:teuthology.misc.health.smithi046.stdout: 2024-05-09T02:18:07.993 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":17,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:05.029012+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:07.995 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f78fc0762d0 msgr2=0x7f78fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:07.995 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f78fc0762d0 0x7f78fc0787e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f790c034000 tx=0x7f790c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:07.995 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 msgr2=0x7f791c151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:07.995 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 0x7f791c151c50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f791400cd80 tx=0x7f791400a650 comp rx=0 tx=0).stop 2024-05-09T02:18:07.995 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 shutdown_connections 2024-05-09T02:18:07.995 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f78fc0762d0 0x7f78fc0787e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.996 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f791c1551b0 0x7f791c151c50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.996 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c0cbd70 0x7f791c0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.996 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 --2- 172.21.15.46:0/2148268039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f791c0c80b0 0x7f791c1e1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:07.996 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 >> 172.21.15.46:0/2148268039 conn(0x7f791c0aed40 msgr2=0x7f791c0ad780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:07.996 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 shutdown_connections 2024-05-09T02:18:07.996 INFO:teuthology.misc.health.smithi046.stderr:2024-05-09T02:18:07.993+0000 7f7920a27640 1 -- 172.21.15.46:0/2148268039 wait complete. 2024-05-09T02:18:08.005 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T02:18:08.005 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T02:18:08.005 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T02:18:08.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T02:18:08.007 INFO:tasks.ceph.mds.a:Started 2024-05-09T02:18:08.008 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T02:18:08.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T02:18:08.010 INFO:tasks.ceph.mds.c:Started 2024-05-09T02:18:08.010 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T02:18:08.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T02:18:08.012 INFO:tasks.ceph.mds.b:Started 2024-05-09T02:18:08.013 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T02:18:08.013 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T02:18:08.015 INFO:tasks.ceph.mds.d:Started 2024-05-09T02:18:08.015 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T02:18:08.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:08.098 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-05-09T02:18:08.098 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-05-09T02:18:08.111 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-09T02:18:08.111 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-09T02:18:08.111 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-09T02:18:08.109+0000 7fa02a3a2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-09T02:18:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.135+0000 7fdb9611c640 1 Processor -- start 2024-05-09T02:18:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.135+0000 7fdb9611c640 1 -- start start 2024-05-09T02:18:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb9611c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb90155260 0x7fdb901587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb9611c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90071510 con 0x7fdb900c6150 2024-05-09T02:18:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb9611c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90158d00 con 0x7fdb900aa410 2024-05-09T02:18:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb9611c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdb900aa820 con 0x7fdb90155260 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb8f7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdb900c6150 0x7fdb90070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45870/0 (socket says 172.21.15.46:45870) 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb8f7fe640 1 -- 172.21.15.46:0/2721949695 learned_addr learned my addr 172.21.15.46:0/2721949695 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb8ffff640 1 --2- 172.21.15.46:0/2721949695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb90155260 0x7fdb901587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.136+0000 7fdb8e7fc640 1 -- 172.21.15.46:0/2721949695 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946029357 0 0) 0x7fdb80001490 con 0x7fdb900c6150 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.137+0000 7fdb8e7fc640 1 -- 172.21.15.46:0/2721949695 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb78003520 con 0x7fdb900c6150 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.137+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2721949695 >> v1:172.21.15.107:6789/0 conn(0x7fdb900aa410 legacy=0x7fdb901580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.137+0000 7fdb8e7fc640 1 -- 172.21.15.46:0/2721949695 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339058355 0 0) 0x7fdb90158d00 con 0x7fdb900aa410 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.137+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2721949695 >> v1:172.21.15.46:6789/0 conn(0x7fdb900c6150 legacy=0x7fdb90070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.137+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2721949695 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb900ac900 con 0x7fdb90155260 2024-05-09T02:18:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.137+0000 7fdb8ffff640 1 --2- 172.21.15.46:0/2721949695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb90155260 0x7fdb901587c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb880097d0 tx=0x7fdb8802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536c5e5d919e7bb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb8e7fc640 1 -- 172.21.15.46:0/2721949695 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88037070 con 0x7fdb90155260 2024-05-09T02:18:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb8e7fc640 1 -- 172.21.15.46:0/2721949695 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88032440 con 0x7fdb90155260 2024-05-09T02:18:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb8e7fc640 1 -- 172.21.15.46:0/2721949695 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88032810 con 0x7fdb90155260 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 -- 172.21.15.46:0/2721949695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb90155260 msgr2=0x7fdb901587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2721949695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb90155260 0x7fdb901587c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb880097d0 tx=0x7fdb8802a210 comp rx=0 tx=0).stop 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 -- 172.21.15.46:0/2721949695 shutdown_connections 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2721949695 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb90155260 0x7fdb901587c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 -- 172.21.15.46:0/2721949695 >> 172.21.15.46:0/2721949695 conn(0x7fdb900c6770 msgr2=0x7fdb900c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 -- 172.21.15.46:0/2721949695 shutdown_connections 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.138+0000 7fdb9611c640 1 -- 172.21.15.46:0/2721949695 wait complete. 2024-05-09T02:18:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.140+0000 7fdb9611c640 1 Processor -- start 2024-05-09T02:18:08.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.140+0000 7fdb9611c640 1 -- start start 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb9611c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb900aa410 0x7fdb901ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb9611c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb900c6150 0x7fdb901ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb9611c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 0x7fdb90151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb9611c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900ac2b0 con 0x7fdb90155260 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb9611c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900abfd0 con 0x7fdb900aa410 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb9611c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdb900ac590 con 0x7fdb900c6150 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 0x7fdb90151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 0x7fdb90151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35622/0 (socket says 172.21.15.46:35622) 2024-05-09T02:18:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2541424877 learned_addr learned my addr 172.21.15.46:0/2541424877 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb8effd640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb900c6150 0x7fdb901ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.141+0000 7fdb8f7fe640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb900aa410 0x7fdb901ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb900c6150 msgr2=0x7fdb901ec2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8ffff640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb900c6150 0x7fdb901ec2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb900aa410 msgr2=0x7fdb901ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8ffff640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb900aa410 0x7fdb901ef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8ffff640 1 -- 172.21.15.46:0/2541424877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb900ade90 con 0x7fdb90155260 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8effd640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb900c6150 0x7fdb901ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb8ffff640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 0x7fdb90151290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb88009720 tx=0x7fdb880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88037040 con 0x7fdb90155260 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88004230 con 0x7fdb90155260 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb900acd50 con 0x7fdb90155260 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88003610 con 0x7fdb90155260 2024-05-09T02:18:08.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.142+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb900ad8d0 con 0x7fdb90155260 2024-05-09T02:18:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.143+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9006a330 con 0x7fdb90155260 2024-05-09T02:18:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.144+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb880037b0 con 0x7fdb90155260 2024-05-09T02:18:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.144+0000 7fdb77fff640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdb7c0762d0 0x7fdb7c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.145+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdb880b7da0 con 0x7fdb90155260 2024-05-09T02:18:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.145+0000 7fdb8f7fe640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdb7c0762d0 0x7fdb7c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.145+0000 7fdb8f7fe640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdb7c0762d0 0x7fdb7c0787e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb80005c00 tx=0x7fdb80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.149+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdb900acd50 con 0x7fdb90155260 2024-05-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.380+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb900c4910 con 0x7fdb90155260 2024-05-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.380+0000 7fdb77fff640 1 -- 172.21.15.46:0/2541424877 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7fdb88081370 con 0x7fdb90155260 2024-05-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-05-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdb7c0762d0 msgr2=0x7fdb7c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdb7c0762d0 0x7fdb7c0787e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb80005c00 tx=0x7fdb80009040 comp rx=0 tx=0).stop 2024-05-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 msgr2=0x7fdb90151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 0x7fdb90151290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb88009720 tx=0x7fdb880046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 shutdown_connections 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdb7c0762d0 0x7fdb7c0787e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb90155260 0x7fdb90151290 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb900c6150 0x7fdb901ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 --2- 172.21.15.46:0/2541424877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb900aa410 0x7fdb901ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.382+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 >> 172.21.15.46:0/2541424877 conn(0x7fdb900c6770 msgr2=0x7fdb90073ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.383+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 shutdown_connections 2024-05-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:08.383+0000 7fdb9611c640 1 -- 172.21.15.46:0/2541424877 wait complete. 2024-05-09T02:18:10.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.523+0000 7f95f2a29640 1 Processor -- start 2024-05-09T02:18:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.523+0000 7f95f2a29640 1 -- start start 2024-05-09T02:18:10.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.524+0000 7f95f2a29640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec140d40 0x7f95ec0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.524+0000 7f95f2a29640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ec1584a0 0x7f95ec06e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.524+0000 7f95f2a29640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec06eab0 con 0x7f95ec0c1e20 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.524+0000 7f95f2a29640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f95ec06f010 con 0x7f95ec1584a0 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.524+0000 7f95f2a29640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec1588b0 con 0x7f95ec140d40 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.524+0000 7f95eb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ec1584a0 0x7f95ec06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95eb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ec1584a0 0x7f95ec06e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35628/0 (socket says 172.21.15.46:35628) 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95f0fc6640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95ec0c1e20 0x7f95ec0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45882/0 (socket says 172.21.15.46:45882) 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95eb7fe640 1 -- 172.21.15.46:0/2947800959 learned_addr learned my addr 172.21.15.46:0/2947800959 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95ebfff640 1 --2- 172.21.15.46:0/2947800959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec140d40 0x7f95ec0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95eb7fe640 1 -- 172.21.15.46:0/2947800959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec140d40 msgr2=0x7f95ec0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95eb7fe640 1 --2- 172.21.15.46:0/2947800959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec140d40 0x7f95ec0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95eb7fe640 1 -- 172.21.15.46:0/2947800959 >> v1:172.21.15.46:6789/0 conn(0x7f95ec0c1e20 legacy=0x7f95ec0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.525+0000 7f95eb7fe640 1 -- 172.21.15.46:0/2947800959 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec06ed30 con 0x7f95ec1584a0 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.526+0000 7f95eb7fe640 1 --2- 172.21.15.46:0/2947800959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec06e570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098a0 tx=0x7f95e002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88296bdf0e2ea2ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:10.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.526+0000 7f95eaffd640 1 -- 172.21.15.46:0/2947800959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0037070 con 0x7f95ec1584a0 2024-05-09T02:18:10.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.526+0000 7f95eaffd640 1 -- 172.21.15.46:0/2947800959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e0032440 con 0x7f95ec1584a0 2024-05-09T02:18:10.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.526+0000 7f95eaffd640 1 -- 172.21.15.46:0/2947800959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0032810 con 0x7f95ec1584a0 2024-05-09T02:18:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 -- 172.21.15.46:0/2947800959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 msgr2=0x7f95ec06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 --2- 172.21.15.46:0/2947800959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec06e570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098a0 tx=0x7f95e002a200 comp rx=0 tx=0).stop 2024-05-09T02:18:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 -- 172.21.15.46:0/2947800959 shutdown_connections 2024-05-09T02:18:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 --2- 172.21.15.46:0/2947800959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec06e570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 --2- 172.21.15.46:0/2947800959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec140d40 0x7f95ec0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 -- 172.21.15.46:0/2947800959 >> 172.21.15.46:0/2947800959 conn(0x7f95ec068e00 msgr2=0x7f95ec0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 -- 172.21.15.46:0/2947800959 shutdown_connections 2024-05-09T02:18:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.527+0000 7f95f2a29640 1 -- 172.21.15.46:0/2947800959 wait complete. 2024-05-09T02:18:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.528+0000 7f95f2a29640 1 Processor -- start 2024-05-09T02:18:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.529+0000 7f95f2a29640 1 -- start start 2024-05-09T02:18:10.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f2a29640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec0c1e20 0x7f95ec13d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f2a29640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95ec140d40 0x7f95ec1ee020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f2a29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec13a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f2a29640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec0c7ef0 con 0x7f95ec1584a0 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f2a29640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec0c7c10 con 0x7f95ec140d40 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f2a29640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec0c92f0 con 0x7f95ec0c1e20 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec13a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec13a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35638/0 (socket says 172.21.15.46:35638) 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 -- 172.21.15.46:0/3942714941 learned_addr learned my addr 172.21.15.46:0/3942714941 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95ebfff640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec0c1e20 0x7f95ec13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95eb7fe640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95ec140d40 0x7f95ec1ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 -- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec0c1e20 msgr2=0x7f95ec13d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec0c1e20 0x7f95ec13d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 -- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95ec140d40 msgr2=0x7f95ec1ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95ec140d40 0x7f95ec1ee020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 -- 172.21.15.46:0/3942714941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec0cbd00 con 0x7f95ec1584a0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95ebfff640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec0c1e20 0x7f95ec13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.530+0000 7f95f0fc6640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec13a140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95e400c760 tx=0x7f95e400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.531+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4017070 con 0x7f95ec1584a0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.531+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e400a640 con 0x7f95ec1584a0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.531+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec1f1ea0 con 0x7f95ec1584a0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.531+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e400a9f0 con 0x7f95ec1584a0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.531+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec1e2db0 con 0x7f95ec1584a0 2024-05-09T02:18:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.532+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec1e2ff0 con 0x7f95ec1584a0 2024-05-09T02:18:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.533+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f95e401a070 con 0x7f95ec1584a0 2024-05-09T02:18:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.533+0000 7f95e8ff9640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f95d80762d0 0x7f95d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.534+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f95e40967a0 con 0x7f95ec1584a0 2024-05-09T02:18:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.534+0000 7f95ebfff640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f95d80762d0 0x7f95d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.534+0000 7f95ebfff640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f95d80762d0 0x7f95d80787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95dc006fd0 tx=0x7f95dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:10.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.538+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f95ec1e2ff0 con 0x7f95ec1584a0 2024-05-09T02:18:10.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.766+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95ec1f1c30 con 0x7f95ec1584a0 2024-05-09T02:18:10.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.767+0000 7f95e8ff9640 1 -- 172.21.15.46:0/3942714941 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3858 (secure 0 0 0) 0x7f95ec0cbd00 con 0x7f95ec1584a0 2024-05-09T02:18:10.769 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:10.769 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T02:18:10.770 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-05-09T02:18:10.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f95d80762d0 msgr2=0x7f95d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f95d80762d0 0x7f95d80787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f95dc006fd0 tx=0x7f95dc008040 comp rx=0 tx=0).stop 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 msgr2=0x7f95ec13a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec13a140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95e400c760 tx=0x7f95e400cc20 comp rx=0 tx=0).stop 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 shutdown_connections 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f95d80762d0 0x7f95d80787e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ec1584a0 0x7f95ec13a140 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95ec140d40 0x7f95ec1ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 --2- 172.21.15.46:0/3942714941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95ec0c1e20 0x7f95ec13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 >> 172.21.15.46:0/3942714941 conn(0x7f95ec068e00 msgr2=0x7f95ec075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:10.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 shutdown_connections 2024-05-09T02:18:10.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.769+0000 7f95f2a29640 1 -- 172.21.15.46:0/3942714941 wait complete. 2024-05-09T02:18:10.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T02:18:10.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.894+0000 7f62fbaf9640 1 Processor -- start 2024-05-09T02:18:10.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.895+0000 7f62fbaf9640 1 -- start start 2024-05-09T02:18:10.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62fbaf9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f4155160 0x7f62f40c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62fbaf9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62f40c84a0 0x7f62f40c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62fbaf9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f4158ae0 con 0x7f62f40c9c00 2024-05-09T02:18:10.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62fbaf9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f62f4155570 con 0x7f62f40c84a0 2024-05-09T02:18:10.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62fbaf9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f62f4157ed0 con 0x7f62f4155160 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62f40c84a0 0x7f62f40c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62f40c84a0 0x7f62f40c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35642/0 (socket says 172.21.15.46:35642) 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 -- 172.21.15.46:0/3014124527 learned_addr learned my addr 172.21.15.46:0/3014124527 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9895640 1 --2- 172.21.15.46:0/3014124527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f4155160 0x7f62f40c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 -- 172.21.15.46:0/3014124527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f4155160 msgr2=0x7f62f40c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 --2- 172.21.15.46:0/3014124527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f4155160 0x7f62f40c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 -- 172.21.15.46:0/3014124527 >> v1:172.21.15.107:6789/0 conn(0x7f62f40c9c00 legacy=0x7f62f415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.896+0000 7f62f9094640 1 -- 172.21.15.46:0/3014124527 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f41581b0 con 0x7f62f40c84a0 2024-05-09T02:18:10.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.897+0000 7f62f9094640 1 --2- 172.21.15.46:0/3014124527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f40c84a0 0x7f62f40c96c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009870 tx=0x7f62e802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dd553972997777 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:10.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.897+0000 7f62f8893640 1 -- 172.21.15.46:0/3014124527 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8037070 con 0x7f62f40c84a0 2024-05-09T02:18:10.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.897+0000 7f62f8893640 1 -- 172.21.15.46:0/3014124527 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e8032440 con 0x7f62f40c84a0 2024-05-09T02:18:10.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.897+0000 7f62f8893640 1 -- 172.21.15.46:0/3014124527 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8032810 con 0x7f62f40c84a0 2024-05-09T02:18:10.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 -- 172.21.15.46:0/3014124527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f40c84a0 msgr2=0x7f62f40c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/3014124527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f40c84a0 0x7f62f40c96c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009870 tx=0x7f62e802a130 comp rx=0 tx=0).stop 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 -- 172.21.15.46:0/3014124527 shutdown_connections 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/3014124527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f40c84a0 0x7f62f40c96c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/3014124527 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f4155160 0x7f62f40c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 -- 172.21.15.46:0/3014124527 >> 172.21.15.46:0/3014124527 conn(0x7f62f40aebe0 msgr2=0x7f62f40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 -- 172.21.15.46:0/3014124527 shutdown_connections 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.898+0000 7f62fbaf9640 1 -- 172.21.15.46:0/3014124527 wait complete. 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.900+0000 7f62fbaf9640 1 Processor -- start 2024-05-09T02:18:10.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.900+0000 7f62fbaf9640 1 -- start start 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fbaf9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62f40c84a0 0x7f62f41431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fbaf9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f40c9c00 0x7f62f41f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fbaf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 0x7f62f41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fbaf9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4157b30 con 0x7f62f4155160 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fbaf9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4158770 con 0x7f62f40c84a0 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fbaf9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f62f4157cb0 con 0x7f62f40c9c00 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 0x7f62f41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 0x7f62f41569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35658/0 (socket says 172.21.15.46:35658) 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 -- 172.21.15.46:0/151504699 learned_addr learned my addr 172.21.15.46:0/151504699 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62f9094640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f40c9c00 0x7f62f41f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62f9895640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62f40c84a0 0x7f62f41431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 -- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f40c9c00 msgr2=0x7f62f41f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f40c9c00 0x7f62f41f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 -- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62f40c84a0 msgr2=0x7f62f41431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62f40c84a0 0x7f62f41431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62fa096640 1 -- 172.21.15.46:0/151504699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40ae7f0 con 0x7f62f4155160 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.901+0000 7f62f9895640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62f40c84a0 0x7f62f41431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.902+0000 7f62fa096640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 0x7f62f41569f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62e4002230 tx=0x7f62e400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.902+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4003b70 con 0x7f62f4155160 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.902+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4003d10 con 0x7f62f4155160 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.902+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f41ee910 con 0x7f62f4155160 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.902+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e40052d0 con 0x7f62f4155160 2024-05-09T02:18:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.902+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41f11b0 con 0x7f62f4155160 2024-05-09T02:18:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.903+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f406a330 con 0x7f62f4155160 2024-05-09T02:18:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.903+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f62e4005470 con 0x7f62f4155160 2024-05-09T02:18:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.904+0000 7f62f27fc640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f62e00762d0 0x7f62e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.904+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f62e4097050 con 0x7f62f4155160 2024-05-09T02:18:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.904+0000 7f62f9895640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f62e00762d0 0x7f62e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:10.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.905+0000 7f62f9895640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f62e00762d0 0x7f62e00787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62f408e7e0 tx=0x7f62ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:10.909+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f62e4060d00 con 0x7f62f4155160 2024-05-09T02:18:11.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.103+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f62f40cb100 con 0x7f62f4155160 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.104+0000 7f62f27fc640 1 -- 172.21.15.46:0/151504699 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f62e4060600 con 0x7f62f4155160 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T02:18:11.106 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f62e00762d0 msgr2=0x7f62e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f62e00762d0 0x7f62e00787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62f408e7e0 tx=0x7f62ec008040 comp rx=0 tx=0).stop 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 msgr2=0x7f62f41569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 0x7f62f41569f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62e4002230 tx=0x7f62e400cb90 comp rx=0 tx=0).stop 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 shutdown_connections 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f62e00762d0 0x7f62e00787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f4155160 0x7f62f41569f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f62f40c9c00 0x7f62f41f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 --2- 172.21.15.46:0/151504699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62f40c84a0 0x7f62f41431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 >> 172.21.15.46:0/151504699 conn(0x7f62f40aebe0 msgr2=0x7f62f414ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:11.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 shutdown_connections 2024-05-09T02:18:11.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.106+0000 7f62fbaf9640 1 -- 172.21.15.46:0/151504699 wait complete. 2024-05-09T02:18:11.119 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-05-09T02:18:11.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-05-09T02:18:11.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.235+0000 7f4f12584640 1 Processor -- start 2024-05-09T02:18:11.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.235+0000 7f4f12584640 1 -- start start 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.236+0000 7f4f12584640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c06e660 0x7f4f0c06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.236+0000 7f4f12584640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f0c15b0c0 0x7f4f0c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f12584640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f0c0c9590 con 0x7f4f0c151b10 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f12584640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0c157be0 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f12584640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c157ec0 con 0x7f4f0c06e660 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f10b21640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f0c15b0c0 0x7f4f0c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4f0c151b10 0x7f4f0c0c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:44932/0 (socket says 172.21.15.46:44932) 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c06e660 0x7f4f0c06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0bfff640 1 -- 172.21.15.46:0/1773346622 learned_addr learned my addr 172.21.15.46:0/1773346622 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0affd640 1 -- 172.21.15.46:0/1773346622 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835461224 0 0) 0x7f4f0c0c9590 con 0x7f4f0c151b10 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0affd640 1 -- 172.21.15.46:0/1773346622 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ef4003520 con 0x7f4f0c151b10 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0b7fe640 1 -- 172.21.15.46:0/1773346622 >> v2:172.21.15.107:3300/0 conn(0x7f4f0c15b0c0 msgr2=0x7f4f0c15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0b7fe640 1 --2- 172.21.15.46:0/1773346622 >> v2:172.21.15.107:3300/0 conn(0x7f4f0c15b0c0 0x7f4f0c15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0b7fe640 1 -- 172.21.15.46:0/1773346622 >> v1:172.21.15.107:6789/0 conn(0x7f4f0c151b10 legacy=0x7f4f0c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f0b7fe640 1 -- 172.21.15.46:0/1773346622 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c1581a0 con 0x7f4f0c06e660 2024-05-09T02:18:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.237+0000 7f4f10b21640 1 --2- 172.21.15.46:0/1773346622 >> v2:172.21.15.107:3300/0 conn(0x7f4f0c15b0c0 0x7f4f0c15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:11.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.238+0000 7f4f0b7fe640 1 --2- 172.21.15.46:0/1773346622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c06e660 0x7f4f0c06ea70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f000097a0 tx=0x7f4f0002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b1f71d52e57e829 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:11.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.238+0000 7f4f0affd640 1 -- 172.21.15.46:0/1773346622 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00037070 con 0x7f4f0c06e660 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.238+0000 7f4f0affd640 1 -- 172.21.15.46:0/1773346622 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0002adb0 con 0x7f4f0c06e660 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.238+0000 7f4f0affd640 1 -- 172.21.15.46:0/1773346622 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00032660 con 0x7f4f0c06e660 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 -- 172.21.15.46:0/1773346622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c06e660 msgr2=0x7f4f0c06ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 --2- 172.21.15.46:0/1773346622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c06e660 0x7f4f0c06ea70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f000097a0 tx=0x7f4f0002a060 comp rx=0 tx=0).stop 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 -- 172.21.15.46:0/1773346622 shutdown_connections 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 --2- 172.21.15.46:0/1773346622 >> v2:172.21.15.107:3300/0 conn(0x7f4f0c15b0c0 0x7f4f0c15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 --2- 172.21.15.46:0/1773346622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c06e660 0x7f4f0c06ea70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 -- 172.21.15.46:0/1773346622 >> 172.21.15.46:0/1773346622 conn(0x7f4f0c068c40 msgr2=0x7f4f0c0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 -- 172.21.15.46:0/1773346622 shutdown_connections 2024-05-09T02:18:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.239+0000 7f4f12584640 1 -- 172.21.15.46:0/1773346622 wait complete. 2024-05-09T02:18:11.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.241+0000 7f4f12584640 1 Processor -- start 2024-05-09T02:18:11.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.241+0000 7f4f12584640 1 -- start start 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f12584640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f0c06e660 0x7f4f0c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f12584640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c151b10 0x7f4f0c1f1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f12584640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 0x7f4f0c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f12584640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c0c9270 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f12584640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c151f20 con 0x7f4f0c06e660 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f12584640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c1589a0 con 0x7f4f0c151b10 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f10b21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 0x7f4f0c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f10b21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 0x7f4f0c159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35662/0 (socket says 172.21.15.46:35662) 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f10b21640 1 -- 172.21.15.46:0/3987693774 learned_addr learned my addr 172.21.15.46:0/3987693774 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f0b7fe640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c151b10 0x7f4f0c1f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.242+0000 7f4f0bfff640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f0c06e660 0x7f4f0c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f10b21640 1 -- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c151b10 msgr2=0x7f4f0c1f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f10b21640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c151b10 0x7f4f0c1f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f10b21640 1 -- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f0c06e660 msgr2=0x7f4f0c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f10b21640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f0c06e660 0x7f4f0c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f10b21640 1 -- 172.21.15.46:0/3987693774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c1f1ba0 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f10b21640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 0x7f4f0c159b70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009e10 tx=0x7f4f0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04018020 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f04014480 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0c0cb6c0 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04014850 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.243+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0c0cbc80 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.244+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f0c06a3a0 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.245+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f0401b020 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.245+0000 7f4f08ff9640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4ef80762d0 0x7f4ef80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.245+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4f04097f20 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.245+0000 7f4f0bfff640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4ef80762d0 0x7f4ef80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.246+0000 7f4f0bfff640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4ef80762d0 0x7f4ef80787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4efc005880 tx=0x7f4efc006aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:11.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.250+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f04022020 con 0x7f4f0c15b0c0 2024-05-09T02:18:11.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:11.439+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7f4f0c0c7020 con 0x7f4f0c15b0c0 2024-05-09T02:18:12.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.119+0000 7f4f08ff9640 1 -- 172.21.15.46:0/3987693774 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v18) ==== 128+0+0 (secure 0 0 0) 0x7f4f04010040 con 0x7f4f0c15b0c0 2024-05-09T02:18:12.121 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'a_metadata' created 2024-05-09T02:18:12.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4ef80762d0 msgr2=0x7f4ef80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4ef80762d0 0x7f4ef80787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4efc005880 tx=0x7f4efc006aa0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 msgr2=0x7f4f0c159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 0x7f4f0c159b70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009e10 tx=0x7f4f0400c490 comp rx=0 tx=0).stop 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 shutdown_connections 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4ef80762d0 0x7f4ef80787e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f0c15b0c0 0x7f4f0c159b70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f0c151b10 0x7f4f0c1f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 --2- 172.21.15.46:0/3987693774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f0c06e660 0x7f4f0c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 >> 172.21.15.46:0/3987693774 conn(0x7f4f0c068c40 msgr2=0x7f4f0c1563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.124+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 shutdown_connections 2024-05-09T02:18:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.125+0000 7f4f12584640 1 -- 172.21.15.46:0/3987693774 wait complete. 2024-05-09T02:18:12.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T02:18:12.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.269+0000 7fe1543a8640 1 Processor -- start 2024-05-09T02:18:12.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.269+0000 7fe1543a8640 1 -- start start 2024-05-09T02:18:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe1543a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe1543a8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe14c154fb0 0x7fe14c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe1543a8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c15b340 con 0x7fe14c0c6020 2024-05-09T02:18:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe1543a8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe14c0c6430 con 0x7fe14c154fb0 2024-05-09T02:18:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe1543a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c158920 con 0x7fe14c15af30 2024-05-09T02:18:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe152945640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe14c154fb0 0x7fe14c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe152945640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe14c154fb0 0x7fe14c0c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35678/0 (socket says 172.21.15.46:35678) 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe152945640 1 -- 172.21.15.46:0/1644932541 learned_addr learned my addr 172.21.15.46:0/1644932541 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe151943640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe152945640 1 -- 172.21.15.46:0/1644932541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 msgr2=0x7fe14c0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe152945640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c0c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.270+0000 7fe152945640 1 -- 172.21.15.46:0/1644932541 >> v1:172.21.15.107:6789/0 conn(0x7fe14c0c6020 legacy=0x7fe14c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.271+0000 7fe152945640 1 -- 172.21.15.46:0/1644932541 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c0caab0 con 0x7fe14c154fb0 2024-05-09T02:18:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.271+0000 7fe151943640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.271+0000 7fe152945640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c154fb0 0x7fe14c0c76e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe144009870 tx=0x7fe14402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee04164ee49ca61e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.271+0000 7fe151142640 1 -- 172.21.15.46:0/1644932541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144037070 con 0x7fe14c154fb0 2024-05-09T02:18:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.271+0000 7fe151142640 1 -- 172.21.15.46:0/1644932541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe144032440 con 0x7fe14c154fb0 2024-05-09T02:18:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.271+0000 7fe151142640 1 -- 172.21.15.46:0/1644932541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144032810 con 0x7fe14c154fb0 2024-05-09T02:18:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 -- 172.21.15.46:0/1644932541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c154fb0 msgr2=0x7fe14c0c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c154fb0 0x7fe14c0c76e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe144009870 tx=0x7fe14402a1c0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 -- 172.21.15.46:0/1644932541 shutdown_connections 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c154fb0 0x7fe14c0c76e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 --2- 172.21.15.46:0/1644932541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 -- 172.21.15.46:0/1644932541 >> 172.21.15.46:0/1644932541 conn(0x7fe14c069130 msgr2=0x7fe14c0ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 -- 172.21.15.46:0/1644932541 shutdown_connections 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.272+0000 7fe1543a8640 1 -- 172.21.15.46:0/1644932541 wait complete. 2024-05-09T02:18:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.274+0000 7fe1543a8640 1 Processor -- start 2024-05-09T02:18:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.274+0000 7fe1543a8640 1 -- start start 2024-05-09T02:18:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe1543a8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 0x7fe14c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe1543a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe14c154fb0 0x7fe14c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe1543a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe1543a8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c0c9cb0 con 0x7fe14c0c6020 2024-05-09T02:18:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe1543a8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c0c99d0 con 0x7fe14c154fb0 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe1543a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c157cf0 con 0x7fe14c15af30 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe152144640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 0x7fe14c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe152144640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 0x7fe14c0add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35682/0 (socket says 172.21.15.46:35682) 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe152144640 1 -- 172.21.15.46:0/2834122570 learned_addr learned my addr 172.21.15.46:0/2834122570 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe151943640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe14c154fb0 0x7fe14c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.275+0000 7fe152945640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152144640 1 -- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 msgr2=0x7fe14c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152144640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152144640 1 -- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe14c154fb0 msgr2=0x7fe14c0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152144640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe14c154fb0 0x7fe14c0af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152144640 1 -- 172.21.15.46:0/2834122570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c0ae8d0 con 0x7fe14c0c6020 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152945640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe152144640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 0x7fe14c0add40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00c730 tx=0x7fe13c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c003b70 con 0x7fe14c0c6020 2024-05-09T02:18:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13c003d10 con 0x7fe14c0c6020 2024-05-09T02:18:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c06f750 con 0x7fe14c0c6020 2024-05-09T02:18:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00aa50 con 0x7fe14c0c6020 2024-05-09T02:18:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.276+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1e1180 con 0x7fe14c0c6020 2024-05-09T02:18:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.277+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14c1e0fa0 con 0x7fe14c0c6020 2024-05-09T02:18:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.278+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe13c00abf0 con 0x7fe14c0c6020 2024-05-09T02:18:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.278+0000 7fe14affd640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe138076300 0x7fe138078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.278+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5222+0+0 (secure 0 0 0) 0x7fe13c0972a0 con 0x7fe14c0c6020 2024-05-09T02:18:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.278+0000 7fe151943640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe138076300 0x7fe138078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.279+0000 7fe151943640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe138076300 0x7fe138078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe14c15b920 tx=0x7fe140008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:12.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.283+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe14c1e0fa0 con 0x7fe14c0c6020 2024-05-09T02:18:12.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:12.476+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe14c06a330 con 0x7fe14c0c6020 2024-05-09T02:18:13.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.125+0000 7fe14affd640 1 -- 172.21.15.46:0/2834122570 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v19) ==== 160+0+0 (secure 0 0 0) 0x7fe14c15b340 con 0x7fe14c0c6020 2024-05-09T02:18:13.127 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'a_data' created 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe138076300 msgr2=0x7fe138078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe138076300 0x7fe138078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe14c15b920 tx=0x7fe140008040 comp rx=0 tx=0).stop 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 msgr2=0x7fe14c0add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 0x7fe14c0add40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00c730 tx=0x7fe13c00cbf0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 shutdown_connections 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe138076300 0x7fe138078810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe14c15af30 0x7fe14c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe14c154fb0 0x7fe14c0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 --2- 172.21.15.46:0/2834122570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c0c6020 0x7fe14c0add40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 >> 172.21.15.46:0/2834122570 conn(0x7fe14c069130 msgr2=0x7fe14c070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 shutdown_connections 2024-05-09T02:18:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.129+0000 7fe1543a8640 1 -- 172.21.15.46:0/2834122570 wait complete. 2024-05-09T02:18:13.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-05-09T02:18:13.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.278+0000 7fa45f56c640 1 Processor -- start 2024-05-09T02:18:13.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.278+0000 7fa45f56c640 1 -- start start 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45f56c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4580c80f0 0x7fa45815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45f56c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4580cd520 0x7fa4580cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45f56c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa458157b10 con 0x7fa458155060 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45f56c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa458157e10 con 0x7fa4580c80f0 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45f56c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4581589b0 con 0x7fa4580cd520 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45cb07640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa458155060 0x7fa4581582a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45888/0 (socket says 172.21.15.46:45888) 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45cb07640 1 -- 172.21.15.46:0/892725652 learned_addr learned my addr 172.21.15.46:0/892725652 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45d308640 1 --2- 172.21.15.46:0/892725652 >> v2:172.21.15.107:3300/0 conn(0x7fa4580c80f0 0x7fa45815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45db09640 1 --2- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4580cd520 0x7fa4580cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa44ffff640 1 -- 172.21.15.46:0/892725652 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043669241 0 0) 0x7fa458157b10 con 0x7fa458155060 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa44ffff640 1 -- 172.21.15.46:0/892725652 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa444003520 con 0x7fa458155060 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45d308640 1 -- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4580cd520 msgr2=0x7fa4580cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45d308640 1 --2- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4580cd520 0x7fa4580cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45d308640 1 -- 172.21.15.46:0/892725652 >> v1:172.21.15.46:6789/0 conn(0x7fa458155060 legacy=0x7fa4581582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.280+0000 7fa45d308640 1 -- 172.21.15.46:0/892725652 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45815b7c0 con 0x7fa4580c80f0 2024-05-09T02:18:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.281+0000 7fa45d308640 1 --2- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580c80f0 0x7fa45815af70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa4540097a0 tx=0x7fa45402a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0ade17f4cbe0f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.281+0000 7fa44ffff640 1 -- 172.21.15.46:0/892725652 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454037070 con 0x7fa4580c80f0 2024-05-09T02:18:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.281+0000 7fa44ffff640 1 -- 172.21.15.46:0/892725652 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45402ada0 con 0x7fa4580c80f0 2024-05-09T02:18:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.281+0000 7fa44ffff640 1 -- 172.21.15.46:0/892725652 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454032660 con 0x7fa4580c80f0 2024-05-09T02:18:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 -- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580c80f0 msgr2=0x7fa45815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 --2- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580c80f0 0x7fa45815af70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa4540097a0 tx=0x7fa45402a050 comp rx=0 tx=0).stop 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 -- 172.21.15.46:0/892725652 shutdown_connections 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 --2- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4580cd520 0x7fa4580cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 --2- 172.21.15.46:0/892725652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580c80f0 0x7fa45815af70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 -- 172.21.15.46:0/892725652 >> 172.21.15.46:0/892725652 conn(0x7fa4580aefc0 msgr2=0x7fa4580cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 -- 172.21.15.46:0/892725652 shutdown_connections 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.282+0000 7fa45f56c640 1 -- 172.21.15.46:0/892725652 wait complete. 2024-05-09T02:18:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.284+0000 7fa45f56c640 1 Processor -- start 2024-05-09T02:18:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.284+0000 7fa45f56c640 1 -- start start 2024-05-09T02:18:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45f56c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 0x7fa4580cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45f56c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580cd520 0x7fa4580ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45f56c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa458155060 0x7fa45814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45f56c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa45815bd80 con 0x7fa4580c80f0 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45f56c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa45815b4b0 con 0x7fa4580cd520 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45f56c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa458155470 con 0x7fa458155060 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45d308640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 0x7fa4580cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45d308640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 0x7fa4580cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35694/0 (socket says 172.21.15.46:35694) 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.285+0000 7fa45d308640 1 -- 172.21.15.46:0/859037416 learned_addr learned my addr 172.21.15.46:0/859037416 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45cb07640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580cd520 0x7fa4580ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45db09640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa458155060 0x7fa45814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45d308640 1 -- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa458155060 msgr2=0x7fa45814fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45d308640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa458155060 0x7fa45814fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45d308640 1 -- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580cd520 msgr2=0x7fa4580ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45d308640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580cd520 0x7fa4580ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45d308640 1 -- 172.21.15.46:0/859037416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4581ee520 con 0x7fa4580c80f0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45d308640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 0x7fa4580cadd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4540098c0 tx=0x7fa4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454037040 con 0x7fa4580c80f0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45402aba0 con 0x7fa4580c80f0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581ee800 con 0x7fa4580c80f0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454006e10 con 0x7fa4580c80f0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.286+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4580adc50 con 0x7fa4580c80f0 2024-05-09T02:18:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.287+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45806a330 con 0x7fa4580c80f0 2024-05-09T02:18:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.288+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa454044020 con 0x7fa4580c80f0 2024-05-09T02:18:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.289+0000 7fa44dffb640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa43c0762d0 0x7fa43c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.289+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5599+0+0 (secure 0 0 0) 0x7fa4540b7f50 con 0x7fa4580c80f0 2024-05-09T02:18:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.289+0000 7fa45cb07640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa43c0762d0 0x7fa43c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.290+0000 7fa45cb07640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa43c0762d0 0x7fa43c0787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa448007a60 tx=0x7fa448009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.292+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa454081920 con 0x7fa4580c80f0 2024-05-09T02:18:13.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:13.521+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7fa458076510 con 0x7fa4580c80f0 2024-05-09T02:18:14.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.125+0000 7fa44dffb640 1 -- 172.21.15.46:0/859037416 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7fa454081220 con 0x7fa4580c80f0 2024-05-09T02:18:14.128 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T02:18:14.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.131+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa43c0762d0 msgr2=0x7fa43c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.131+0000 7fa45f56c640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa43c0762d0 0x7fa43c0787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa448007a60 tx=0x7fa448009040 comp rx=0 tx=0).stop 2024-05-09T02:18:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.132+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 msgr2=0x7fa4580cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.132+0000 7fa45f56c640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 0x7fa4580cadd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4540098c0 tx=0x7fa4540046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.133+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 shutdown_connections 2024-05-09T02:18:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.133+0000 7fa45f56c640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa43c0762d0 0x7fa43c0787e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.133+0000 7fa45f56c640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa458155060 0x7fa45814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.133+0000 7fa45f56c640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4580cd520 0x7fa4580ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.133+0000 7fa45f56c640 1 --2- 172.21.15.46:0/859037416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4580c80f0 0x7fa4580cadd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.133+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 >> 172.21.15.46:0/859037416 conn(0x7fa4580aefc0 msgr2=0x7fa458155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:14.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.138+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 shutdown_connections 2024-05-09T02:18:14.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.141+0000 7fa45f56c640 1 -- 172.21.15.46:0/859037416 wait complete. 2024-05-09T02:18:14.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:14.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.289+0000 7f3172869640 1 Processor -- start 2024-05-09T02:18:14.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.289+0000 7f3172869640 1 -- start start 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f3172869640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f316c0c8ba0 0x7f316c153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f3172869640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 0x7f316c159500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f3172869640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316c155fe0 con 0x7f316c0ca560 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f3172869640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f316c159070 con 0x7f316c0c8ba0 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f3172869640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f316c1562c0 con 0x7f316c155890 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f316b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f316c0ca560 0x7f316c0c7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45892/0 (socket says 172.21.15.46:45892) 2024-05-09T02:18:14.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.290+0000 7f316b7fe640 1 -- 172.21.15.46:0/2507502341 learned_addr learned my addr 172.21.15.46:0/2507502341 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316bfff640 1 --2- 172.21.15.46:0/2507502341 >> v2:172.21.15.107:3300/0 conn(0x7f316c0c8ba0 0x7f316c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f3170e06640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 0x7f316c159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010315709 0 0) 0x7f316c155fe0 con 0x7f316c0ca560 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3154003520 con 0x7f316c0ca560 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2172929897 0 0) 0x7f3154003520 con 0x7f316c0ca560 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 msgr2=0x7f316c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 0x7f316c159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 >> v2:172.21.15.107:3300/0 conn(0x7f316c0c8ba0 msgr2=0x7f316c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 --2- 172.21.15.46:0/2507502341 >> v2:172.21.15.107:3300/0 conn(0x7f316c0c8ba0 0x7f316c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c1565a0 con 0x7f316c0ca560 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f31600016f0 con 0x7f316c0ca560 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 >> v1:172.21.15.46:6789/0 conn(0x7f316c0ca560 legacy=0x7f316c0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 0x7f3154003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3154003fd0 0x7f3154004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f3154005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f316c159070 con 0x7f3154004d40 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1562c0 con 0x7f3154003fd0 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f315400bb50 con 0x7f316c155890 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f3170e06640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f3154005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316bfff640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 0x7f3154003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.291+0000 7f316b7fe640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3154003fd0 0x7f3154004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f3170e06640 1 -- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 msgr2=0x7f3154003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f3170e06640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c155890 0x7f3154003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f3170e06640 1 -- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3154003fd0 msgr2=0x7f3154004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f3170e06640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3154003fd0 0x7f3154004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f3170e06640 1 -- 172.21.15.46:0/2507502341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3154003520 con 0x7f3154004d40 2024-05-09T02:18:14.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f3170e06640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f3154005150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3164009f90 tx=0x7f3154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81556e231a100f53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.292+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164009c10 con 0x7f3154004d40 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3164036070 con 0x7f3154004d40 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f316affd640 1 -- 172.21.15.46:0/2507502341 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164031850 con 0x7f3154004d40 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3172869640 1 -- 172.21.15.46:0/2507502341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 msgr2=0x7f3154005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3172869640 1 --2- 172.21.15.46:0/2507502341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f3154005150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3164009f90 tx=0x7f3154005830 comp rx=0 tx=0).stop 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3170e06640 1 -- 172.21.15.46:0/2507502341 reap_dead start 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3172869640 1 -- 172.21.15.46:0/2507502341 shutdown_connections 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3172869640 1 -- 172.21.15.46:0/2507502341 >> 172.21.15.46:0/2507502341 conn(0x7f316c0ac930 msgr2=0x7f316c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3172869640 1 -- 172.21.15.46:0/2507502341 shutdown_connections 2024-05-09T02:18:14.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.293+0000 7f3172869640 1 -- 172.21.15.46:0/2507502341 wait complete. 2024-05-09T02:18:14.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.295+0000 7f3172869640 1 Processor -- start 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.295+0000 7f3172869640 1 -- start start 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f3172869640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f316c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f3172869640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f316c0c4760 0x7f316c1ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f3172869640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c1ef750 0x7f316c1ebef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f3172869640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0c7d60 con 0x7f3154004d40 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f3172869640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f316c155ca0 con 0x7f316c0c4760 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f3172869640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f316c0c7ee0 con 0x7f316c1ef750 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f316bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f316c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f316bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f316c0b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35712/0 (socket says 172.21.15.46:35712) 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.296+0000 7f316bfff640 1 -- 172.21.15.46:0/1498150241 learned_addr learned my addr 172.21.15.46:0/1498150241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316b7fe640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f316c0c4760 0x7f316c1ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f3170e06640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c1ef750 0x7f316c1ebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316bfff640 1 -- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c1ef750 msgr2=0x7f316c1ebef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316bfff640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c1ef750 0x7f316c1ebef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316bfff640 1 -- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f316c0c4760 msgr2=0x7f316c1ef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316bfff640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f316c0c4760 0x7f316c1ef210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316bfff640 1 -- 172.21.15.46:0/1498150241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c152500 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f316bfff640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f316c0b0120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f315c011980 tx=0x7f315c011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c00faf0 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315c00fc90 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c1eb930 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c014440 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.297+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c1508b0 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.298+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c150620 con 0x7f3154004d40 2024-05-09T02:18:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.299+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f315c012040 con 0x7f3154004d40 2024-05-09T02:18:14.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.300+0000 7f3168ff9640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31580762d0 0x7f31580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.300+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f315c097f40 con 0x7f3154004d40 2024-05-09T02:18:14.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.300+0000 7f316b7fe640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31580762d0 0x7f31580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.300+0000 7f316b7fe640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31580762d0 0x7f31580787e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f316c1551f0 tx=0x7f31600078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.303+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f315c019030 con 0x7f3154004d40 2024-05-09T02:18:14.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.495+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f316c06a330 con 0x7f3154004d40 2024-05-09T02:18:14.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.496+0000 7f3168ff9640 1 -- 172.21.15.46:0/1498150241 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16562 (secure 0 0 0) 0x7f315c061340 con 0x7f3154004d40 2024-05-09T02:18:14.499 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:14.499 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:13.523139+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31580762d0 msgr2=0x7f31580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31580762d0 0x7f31580787e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f316c1551f0 tx=0x7f31600078f0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 msgr2=0x7f316c0b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f316c0b0120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f315c011980 tx=0x7f315c011e40 comp rx=0 tx=0).stop 2024-05-09T02:18:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 shutdown_connections 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31580762d0 0x7f31580787e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f316c1ef750 0x7f316c1ebef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f316c0c4760 0x7f316c1ef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 --2- 172.21.15.46:0/1498150241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3154004d40 0x7f316c0b0120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.498+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 >> 172.21.15.46:0/1498150241 conn(0x7f316c0ac930 msgr2=0x7f316c075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.499+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 shutdown_connections 2024-05-09T02:18:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.499+0000 7f3172869640 1 -- 172.21.15.46:0/1498150241 wait complete. 2024-05-09T02:18:14.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:14.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.624+0000 7fdd81c61640 1 Processor -- start 2024-05-09T02:18:14.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.624+0000 7fdd81c61640 1 -- start start 2024-05-09T02:18:14.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd81c61640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd7c0c9060 0x7fdd7c155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd81c61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c9630 0x7fdd7c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd81c61640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd7c0c6cb0 0x7fdd7c158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd81c61640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7c0c5720 con 0x7fdd7c0c9060 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd81c61640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7c1559b0 con 0x7fdd7c0c6cb0 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd81c61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c0c46e0 con 0x7fdd7c0c9630 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd7b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd7c0c9060 0x7fdd7c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd7b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd7c0c9060 0x7fdd7c155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35726/0 (socket says 172.21.15.46:35726) 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.625+0000 7fdd7b7fe640 1 -- 172.21.15.46:0/4253832004 learned_addr learned my addr 172.21.15.46:0/4253832004 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7affd640 1 --2- 172.21.15.46:0/4253832004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c9630 0x7fdd7c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7bfff640 1 --2- 172.21.15.46:0/4253832004 >> v2:172.21.15.107:3300/0 conn(0x7fdd7c0c6cb0 0x7fdd7c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7b7fe640 1 -- 172.21.15.46:0/4253832004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c9630 msgr2=0x7fdd7c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7b7fe640 1 --2- 172.21.15.46:0/4253832004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c9630 0x7fdd7c0c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7b7fe640 1 -- 172.21.15.46:0/4253832004 >> v2:172.21.15.107:3300/0 conn(0x7fdd7c0c6cb0 msgr2=0x7fdd7c158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7b7fe640 1 --2- 172.21.15.46:0/4253832004 >> v2:172.21.15.107:3300/0 conn(0x7fdd7c0c6cb0 0x7fdd7c158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7b7fe640 1 -- 172.21.15.46:0/4253832004 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c0c49c0 con 0x7fdd7c0c9060 2024-05-09T02:18:14.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.626+0000 7fdd7b7fe640 1 --2- 172.21.15.46:0/4253832004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c155470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c157f50 tx=0x7fdd6c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e328fb79a65da8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd7a7fc640 1 -- 172.21.15.46:0/4253832004 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c037070 con 0x7fdd7c0c9060 2024-05-09T02:18:14.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd7a7fc640 1 -- 172.21.15.46:0/4253832004 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c032440 con 0x7fdd7c0c9060 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd7a7fc640 1 -- 172.21.15.46:0/4253832004 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c032810 con 0x7fdd7c0c9060 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 -- 172.21.15.46:0/4253832004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 msgr2=0x7fdd7c155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4253832004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c155470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c157f50 tx=0x7fdd6c02a140 comp rx=0 tx=0).stop 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 -- 172.21.15.46:0/4253832004 shutdown_connections 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4253832004 >> v2:172.21.15.107:3300/0 conn(0x7fdd7c0c6cb0 0x7fdd7c158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4253832004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c9630 0x7fdd7c0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4253832004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c155470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 -- 172.21.15.46:0/4253832004 >> 172.21.15.46:0/4253832004 conn(0x7fdd7c06d7d0 msgr2=0x7fdd7c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 -- 172.21.15.46:0/4253832004 shutdown_connections 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.627+0000 7fdd81c61640 1 -- 172.21.15.46:0/4253832004 wait complete. 2024-05-09T02:18:14.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.629+0000 7fdd81c61640 1 Processor -- start 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.629+0000 7fdd81c61640 1 -- start start 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.630+0000 7fdd81c61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c6cb0 0x7fdd7c0aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.630+0000 7fdd81c61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c1e8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.630+0000 7fdd81c61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd7c0c9630 0x7fdd7c1e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.630+0000 7fdd81c61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c0c41a0 con 0x7fdd7c0c9060 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.630+0000 7fdd81c61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c0c53b0 con 0x7fdd7c0c9630 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.630+0000 7fdd81c61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c0c4320 con 0x7fdd7c0c6cb0 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c1e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c1e8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35736/0 (socket says 172.21.15.46:35736) 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 -- 172.21.15.46:0/4132646902 learned_addr learned my addr 172.21.15.46:0/4132646902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7b7fe640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c6cb0 0x7fdd7c0aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7bfff640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd7c0c9630 0x7fdd7c1e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 -- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c6cb0 msgr2=0x7fdd7c0aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c6cb0 0x7fdd7c0aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 -- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd7c0c9630 msgr2=0x7fdd7c1e8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd7c0c9630 0x7fdd7c1e8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 -- 172.21.15.46:0/4132646902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c145770 con 0x7fdd7c0c9060 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd7affd640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c1e8900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000e870 tx=0x7fdd7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70017070 con 0x7fdd7c0c9060 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7000c940 con 0x7fdd7c0c9060 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c144940 con 0x7fdd7c0c9060 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000cd10 con 0x7fdd7c0c9060 2024-05-09T02:18:14.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.631+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c144f00 con 0x7fdd7c0c9060 2024-05-09T02:18:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.632+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c06a330 con 0x7fdd7c0c9060 2024-05-09T02:18:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.633+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd7001a070 con 0x7fdd7c0c9060 2024-05-09T02:18:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.633+0000 7fdd63fff640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd680762d0 0x7fdd680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.634+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fdd70097760 con 0x7fdd7c0c9060 2024-05-09T02:18:14.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.634+0000 7fdd7b7fe640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd680762d0 0x7fdd680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.634+0000 7fdd7b7fe640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd680762d0 0x7fdd680787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c034000 tx=0x7fdd6c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.638+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd70060a80 con 0x7fdd7c0c9060 2024-05-09T02:18:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.830+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd7c1450d0 con 0x7fdd7c0c9060 2024-05-09T02:18:14.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.831+0000 7fdd63fff640 1 -- 172.21.15.46:0/4132646902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16562 (secure 0 0 0) 0x7fdd70064d80 con 0x7fdd7c0c9060 2024-05-09T02:18:14.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:14.834 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:13.523139+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd680762d0 msgr2=0x7fdd680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd680762d0 0x7fdd680787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c034000 tx=0x7fdd6c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 msgr2=0x7fdd7c1e8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c1e8900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000e870 tx=0x7fdd7000ed30 comp rx=0 tx=0).stop 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 shutdown_connections 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd680762d0 0x7fdd680787e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd7c0c9630 0x7fdd7c1e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd7c0c9060 0x7fdd7c1e8900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 --2- 172.21.15.46:0/4132646902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd7c0c6cb0 0x7fdd7c0aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.833+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 >> 172.21.15.46:0/4132646902 conn(0x7fdd7c06d7d0 msgr2=0x7fdd7c0c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.834+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 shutdown_connections 2024-05-09T02:18:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.834+0000 7fdd81c61640 1 -- 172.21.15.46:0/4132646902 wait complete. 2024-05-09T02:18:14.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-05-09T02:18:14.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.962+0000 7faa509c7640 1 Processor -- start 2024-05-09T02:18:14.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.962+0000 7faa509c7640 1 -- start start 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.963+0000 7faa509c7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa4c0c80f0 0x7faa4c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.963+0000 7faa509c7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4c157b10 con 0x7faa4c0cd520 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.963+0000 7faa509c7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4c15b7c0 con 0x7faa4c155060 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.963+0000 7faa509c7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa4c157e10 con 0x7faa4c0c80f0 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4ad9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faa4c0cd520 0x7faa4c0cad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45894/0 (socket says 172.21.15.46:45894) 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4ad9d640 1 -- 172.21.15.46:0/1942344276 learned_addr learned my addr 172.21.15.46:0/1942344276 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4a59c640 1 --2- 172.21.15.46:0/1942344276 >> v2:172.21.15.107:3300/0 conn(0x7faa4c0c80f0 0x7faa4c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4959a640 1 -- 172.21.15.46:0/1942344276 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264866499 0 0) 0x7faa4c157b10 con 0x7faa4c0cd520 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4959a640 1 -- 172.21.15.46:0/1942344276 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa38003520 con 0x7faa4c0cd520 2024-05-09T02:18:14.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4959a640 1 -- 172.21.15.46:0/1942344276 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3066055164 0 0) 0x7faa38003520 con 0x7faa4c0cd520 2024-05-09T02:18:14.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4a59c640 1 -- 172.21.15.46:0/1942344276 >> v1:172.21.15.107:6789/0 conn(0x7faa4c155060 legacy=0x7faa4c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4a59c640 1 -- 172.21.15.46:0/1942344276 >> v1:172.21.15.46:6789/0 conn(0x7faa4c0cd520 legacy=0x7faa4c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.964+0000 7faa4a59c640 1 -- 172.21.15.46:0/1942344276 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c15baa0 con 0x7faa4c0c80f0 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.965+0000 7faa4a59c640 1 --2- 172.21.15.46:0/1942344276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c15af70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa440097a0 tx=0x7faa4402a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f8770cecbe2e79b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.965+0000 7faa4959a640 1 -- 172.21.15.46:0/1942344276 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44037070 con 0x7faa4c0c80f0 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.965+0000 7faa4959a640 1 -- 172.21.15.46:0/1942344276 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4402ab30 con 0x7faa4c0c80f0 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.965+0000 7faa4959a640 1 -- 172.21.15.46:0/1942344276 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c001a70 con 0x7faa4c0c80f0 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 -- 172.21.15.46:0/1942344276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 msgr2=0x7faa4c15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 --2- 172.21.15.46:0/1942344276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c15af70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa440097a0 tx=0x7faa4402a0a0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 -- 172.21.15.46:0/1942344276 shutdown_connections 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 --2- 172.21.15.46:0/1942344276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c15af70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 -- 172.21.15.46:0/1942344276 >> 172.21.15.46:0/1942344276 conn(0x7faa4c0aefc0 msgr2=0x7faa4c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 -- 172.21.15.46:0/1942344276 shutdown_connections 2024-05-09T02:18:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.966+0000 7faa509c7640 1 -- 172.21.15.46:0/1942344276 wait complete. 2024-05-09T02:18:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.968+0000 7faa509c7640 1 Processor -- start 2024-05-09T02:18:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.968+0000 7faa509c7640 1 -- start start 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa509c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa509c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 0x7faa4c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa509c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4c155060 0x7faa4c0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa509c7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c15bd80 con 0x7faa4c0cd520 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa509c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1589b0 con 0x7faa4c0c80f0 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa509c7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa4c155470 con 0x7faa4c155060 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 0x7faa4c0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 0x7faa4c0c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35740/0 (socket says 172.21.15.46:35740) 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 -- 172.21.15.46:0/4084909118 learned_addr learned my addr 172.21.15.46:0/4084909118 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa4ad9d640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4c155060 0x7faa4c0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa4a59c640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 -- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4c155060 msgr2=0x7faa4c0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4c155060 0x7faa4c0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 -- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 msgr2=0x7faa4c0b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c0b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa49d9b640 1 -- 172.21.15.46:0/4084909118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c0c3880 con 0x7faa4c0cd520 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa4ad9d640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4c155060 0x7faa4c0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.969+0000 7faa4a59c640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.970+0000 7faa49d9b640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 0x7faa4c0c25f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa3400c430 tx=0x7faa3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.970+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34017070 con 0x7faa4c0cd520 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.970+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa340052d0 con 0x7faa4c0cd520 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.970+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c0c0810 con 0x7faa4c0cd520 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.970+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34003830 con 0x7faa4c0cd520 2024-05-09T02:18:14.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.970+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c0c4a30 con 0x7faa4c0cd520 2024-05-09T02:18:14.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.971+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c06a330 con 0x7faa4c0cd520 2024-05-09T02:18:14.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.971+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa3401a070 con 0x7faa4c0cd520 2024-05-09T02:18:14.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.972+0000 7faa42ffd640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faa2c076300 0x7faa2c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:14.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.972+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7faa34096940 con 0x7faa4c0cd520 2024-05-09T02:18:14.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.972+0000 7faa4a59c640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faa2c076300 0x7faa2c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:14.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.973+0000 7faa4a59c640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faa2c076300 0x7faa2c078810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa44034000 tx=0x7faa4402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:14.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:14.977+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa340602b0 con 0x7faa4c0cd520 2024-05-09T02:18:15.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:15.208+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faa4c0766f0 con 0x7faa4c0cd520 2024-05-09T02:18:15.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:18:15.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:18:16.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.141+0000 7faa42ffd640 1 -- 172.21.15.46:0/4084909118 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 113+0+0 (secure 0 0 0) 0x7faa340682a0 con 0x7faa4c0cd520 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.143+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faa2c076300 msgr2=0x7faa2c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.143+0000 7faa509c7640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faa2c076300 0x7faa2c078810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa44034000 tx=0x7faa4402e000 comp rx=0 tx=0).stop 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 msgr2=0x7faa4c0c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 0x7faa4c0c25f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa3400c430 tx=0x7faa3400c8f0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 shutdown_connections 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faa2c076300 0x7faa2c078810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4c155060 0x7faa4c0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa4c0cd520 0x7faa4c0c25f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 --2- 172.21.15.46:0/4084909118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4c0c80f0 0x7faa4c0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 >> 172.21.15.46:0/4084909118 conn(0x7faa4c0aefc0 msgr2=0x7faa4c155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:16.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 shutdown_connections 2024-05-09T02:18:16.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.144+0000 7faa509c7640 1 -- 172.21.15.46:0/4084909118 wait complete. 2024-05-09T02:18:16.160 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-09T02:18:16.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-05-09T02:18:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.282+0000 7f0a2131f640 1 Processor -- start 2024-05-09T02:18:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.282+0000 7f0a2131f640 1 -- start start 2024-05-09T02:18:16.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a2131f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0a1c06e4a0 0x7f0a1c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a2131f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a1c0c2b60 0x7f0a1c0c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a2131f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a1c158820 con 0x7f0a1c0b1890 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a2131f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c0c1e30 con 0x7f0a1c06e4a0 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a2131f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c0c2080 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a1a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0a1c06e4a0 0x7f0a1c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a1a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0a1c06e4a0 0x7f0a1c06e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35754/0 (socket says 172.21.15.46:35754) 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a1affd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0a1c0b1890 0x7f0a1c1550b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45900/0 (socket says 172.21.15.46:45900) 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.283+0000 7f0a1a7fc640 1 -- 172.21.15.46:0/640764920 learned_addr learned my addr 172.21.15.46:0/640764920 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.284+0000 7f0a1b7fe640 1 --2- 172.21.15.46:0/640764920 >> v2:172.21.15.107:3300/0 conn(0x7f0a1c0c2b60 0x7f0a1c0c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.284+0000 7f0a1a7fc640 1 -- 172.21.15.46:0/640764920 >> v2:172.21.15.107:3300/0 conn(0x7f0a1c0c2b60 msgr2=0x7f0a1c0c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.284+0000 7f0a1a7fc640 1 --2- 172.21.15.46:0/640764920 >> v2:172.21.15.107:3300/0 conn(0x7f0a1c0c2b60 0x7f0a1c0c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.284+0000 7f0a1a7fc640 1 -- 172.21.15.46:0/640764920 >> v1:172.21.15.46:6789/0 conn(0x7f0a1c0b1890 legacy=0x7f0a1c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:16.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.284+0000 7f0a1a7fc640 1 -- 172.21.15.46:0/640764920 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c0c2360 con 0x7f0a1c06e4a0 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.284+0000 7f0a1a7fc640 1 --2- 172.21.15.46:0/640764920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c06e8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c06d4d0 tx=0x7f0a0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2045648656804522 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a19ffb640 1 -- 172.21.15.46:0/640764920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04037070 con 0x7f0a1c06e4a0 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a19ffb640 1 -- 172.21.15.46:0/640764920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a04032440 con 0x7f0a1c06e4a0 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a19ffb640 1 -- 172.21.15.46:0/640764920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04032810 con 0x7f0a1c06e4a0 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 -- 172.21.15.46:0/640764920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c06e4a0 msgr2=0x7f0a1c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 --2- 172.21.15.46:0/640764920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c06e8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c06d4d0 tx=0x7f0a0402a1e0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 -- 172.21.15.46:0/640764920 shutdown_connections 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 --2- 172.21.15.46:0/640764920 >> v2:172.21.15.107:3300/0 conn(0x7f0a1c0c2b60 0x7f0a1c0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 --2- 172.21.15.46:0/640764920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c06e8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 -- 172.21.15.46:0/640764920 >> 172.21.15.46:0/640764920 conn(0x7f0a1c068e90 msgr2=0x7f0a1c0cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:16.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 -- 172.21.15.46:0/640764920 shutdown_connections 2024-05-09T02:18:16.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.285+0000 7f0a2131f640 1 -- 172.21.15.46:0/640764920 wait complete. 2024-05-09T02:18:16.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.287+0000 7f0a2131f640 1 Processor -- start 2024-05-09T02:18:16.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.287+0000 7f0a2131f640 1 -- start start 2024-05-09T02:18:16.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.288+0000 7f0a2131f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:16.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a2131f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a1c0b1890 0x7f0a1c1ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a2131f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 0x7f0a1c14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a2131f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c0b2190 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a2131f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c0b1ca0 con 0x7f0a1c06e4a0 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a2131f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c158440 con 0x7f0a1c0b1890 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 0x7f0a1c14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 0x7f0a1c14c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35758/0 (socket says 172.21.15.46:35758) 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 -- 172.21.15.46:0/2254531593 learned_addr learned my addr 172.21.15.46:0/2254531593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1affd640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1a7fc640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a1c0b1890 0x7f0a1c1ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 -- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a1c0b1890 msgr2=0x7f0a1c1ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a1c0b1890 0x7f0a1c1ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 -- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1c06e4a0 msgr2=0x7f0a1c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:16.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 -- 172.21.15.46:0/2254531593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c14d0a0 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1affd640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a1b7fe640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 0x7f0a1c14c1f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400d5d0 tx=0x7f0a1400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140125f0 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.289+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a14019070 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.290+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c0ccaf0 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.290+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140129f0 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.290+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c1f1870 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.290+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c06a330 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.291+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a14012b90 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.292+0000 7f0a137fe640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f09fc076300 0x7f09fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:16.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.292+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f0a14097860 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.292+0000 7f0a1affd640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f09fc076300 0x7f09fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:16.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.293+0000 7f0a1affd640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f09fc076300 0x7f09fc078810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0012e0 tx=0x7f0a0c005bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:16.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.296+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0a140611e0 con 0x7f0a1c0c2b60 2024-05-09T02:18:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:16.527+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0a1c0cd1a0 con 0x7f0a1c0c2b60 2024-05-09T02:18:17.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.153+0000 7f0a137fe640 1 -- 172.21.15.46:0/2254531593 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 117+0+0 (secure 0 0 0) 0x7f0a14060ae0 con 0x7f0a1c0c2b60 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f09fc076300 msgr2=0x7f09fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f09fc076300 0x7f09fc078810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0012e0 tx=0x7f0a0c005bb0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 msgr2=0x7f0a1c14c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 0x7f0a1c14c1f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400d5d0 tx=0x7f0a1400da90 comp rx=0 tx=0).stop 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 shutdown_connections 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f09fc076300 0x7f09fc078810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a1c0c2b60 0x7f0a1c14c1f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a1c0b1890 0x7f0a1c1ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 --2- 172.21.15.46:0/2254531593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1c06e4a0 0x7f0a1c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 >> 172.21.15.46:0/2254531593 conn(0x7f0a1c068e90 msgr2=0x7f0a1c150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 shutdown_connections 2024-05-09T02:18:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.156+0000 7f0a2131f640 1 -- 172.21.15.46:0/2254531593 wait complete. 2024-05-09T02:18:17.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-05-09T02:18:17.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.294+0000 7ff1df3d5640 1 Processor -- start 2024-05-09T02:18:17.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.294+0000 7ff1df3d5640 1 -- start start 2024-05-09T02:18:17.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1df3d5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 0x7ff1d815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1df3d5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d8157b10 con 0x7ff1d8155060 2024-05-09T02:18:17.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1df3d5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d815b7c0 con 0x7ff1d80cd520 2024-05-09T02:18:17.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1df3d5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d8157e10 con 0x7ff1d80c80f0 2024-05-09T02:18:17.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1dc970640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff1d8155060 0x7ff1d81582a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38800/0 (socket says 172.21.15.46:38800) 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1dc970640 1 -- 172.21.15.46:0/834275028 learned_addr learned my addr 172.21.15.46:0/834275028 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716295889 0 0) 0x7ff1d8157b10 con 0x7ff1d8155060 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1dd171640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 0x7ff1d815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c0003520 con 0x7ff1d8155060 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4140559526 0 0) 0x7ff1c0003520 con 0x7ff1d8155060 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 msgr2=0x7ff1d815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 0x7ff1d815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 >> v1:172.21.15.107:6789/0 conn(0x7ff1d80cd520 legacy=0x7ff1d80cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d815baa0 con 0x7ff1d8155060 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.296+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7ff1cc0016f0 con 0x7ff1d8155060 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 >> v1:172.21.15.46:6789/0 conn(0x7ff1d8155060 legacy=0x7ff1d81582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 0x7ff1c0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c0004000 0x7ff1c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004e60 0x7ff1c0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c000bcf0 con 0x7ff1c0004e60 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c000bea0 con 0x7ff1c0004000 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c000c0a0 con 0x7ff1d80c80f0 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd972640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004e60 0x7ff1c0005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dc970640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c0004000 0x7ff1c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd171640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 0x7ff1c0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd972640 1 -- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 msgr2=0x7ff1c0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd972640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c80f0 0x7ff1c0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd972640 1 -- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c0004000 msgr2=0x7ff1c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd972640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1c0004000 0x7ff1c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.297+0000 7ff1dd972640 1 -- 172.21.15.46:0/834275028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0003520 con 0x7ff1c0004e60 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.298+0000 7ff1dd972640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004e60 0x7ff1c0005290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80b2f80 tx=0x7ff1c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1d66a36a06ad83 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:17.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.298+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8001a50 con 0x7ff1c0004e60 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.298+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c802adf0 con 0x7ff1c0004e60 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.298+0000 7ff1d7fff640 1 -- 172.21.15.46:0/834275028 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8003b70 con 0x7ff1c0004e60 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1df3d5640 1 -- 172.21.15.46:0/834275028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004e60 msgr2=0x7ff1c0005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/834275028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c0004e60 0x7ff1c0005290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80b2f80 tx=0x7ff1c0005830 comp rx=0 tx=0).stop 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1dd972640 1 -- 172.21.15.46:0/834275028 reap_dead start 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1df3d5640 1 -- 172.21.15.46:0/834275028 shutdown_connections 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1df3d5640 1 -- 172.21.15.46:0/834275028 >> 172.21.15.46:0/834275028 conn(0x7ff1d80aefc0 msgr2=0x7ff1d80cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1df3d5640 1 -- 172.21.15.46:0/834275028 shutdown_connections 2024-05-09T02:18:17.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.299+0000 7ff1df3d5640 1 -- 172.21.15.46:0/834275028 wait complete. 2024-05-09T02:18:17.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.300+0000 7ff1df3d5640 1 Processor -- start 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.300+0000 7ff1df3d5640 1 -- start start 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1df3d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1d81ed810 0x7ff1d80c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1df3d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 0x7ff1d80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1df3d5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c4ed0 0x7ff1d80c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1df3d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d8155470 con 0x7ff1d80c1000 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1df3d5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d81589b0 con 0x7ff1d81ed810 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1df3d5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d81555f0 con 0x7ff1d80c4ed0 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 0x7ff1d80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 0x7ff1d80c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44864/0 (socket says 172.21.15.46:44864) 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 -- 172.21.15.46:0/1236102422 learned_addr learned my addr 172.21.15.46:0/1236102422 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dd972640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c4ed0 0x7ff1d80c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dd171640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1d81ed810 0x7ff1d80c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 -- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c4ed0 msgr2=0x7ff1d80c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c4ed0 0x7ff1d80c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 -- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1d81ed810 msgr2=0x7ff1d80c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1d81ed810 0x7ff1d80c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 -- 172.21.15.46:0/1236102422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d80c4110 con 0x7ff1d80c1000 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1dc970640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 0x7ff1d80c68f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc004ec0 tx=0x7ff1cc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.302+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc01a070 con 0x7ff1d80c1000 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.303+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00f7b0 con 0x7ff1d80c1000 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.303+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d80c43f0 con 0x7ff1d80c1000 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.303+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00fba0 con 0x7ff1d80c1000 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.303+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d80c5af0 con 0x7ff1d80c1000 2024-05-09T02:18:17.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.304+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d806a330 con 0x7ff1d80c1000 2024-05-09T02:18:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.304+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff1cc01d070 con 0x7ff1d80c1000 2024-05-09T02:18:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.305+0000 7ff1d5ffb640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff1c40762d0 0x7ff1c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.305+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7ff1cc096df0 con 0x7ff1d80c1000 2024-05-09T02:18:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.305+0000 7ff1dd171640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff1c40762d0 0x7ff1c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:17.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.306+0000 7ff1dd171640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff1c40762d0 0x7ff1c40787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8146c60 tx=0x7ff1d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:17.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.310+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff1cc0607f0 con 0x7ff1d80c1000 2024-05-09T02:18:17.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:17.540+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff1d8156420 con 0x7ff1d80c1000 2024-05-09T02:18:18.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.154+0000 7ff1d5ffb640 1 -- 172.21.15.46:0/1236102422 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v8) ==== 110+0+0 (secure 0 0 0) 0x7ff1cc0600f0 con 0x7ff1d80c1000 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff1c40762d0 msgr2=0x7ff1c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff1c40762d0 0x7ff1c40787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8146c60 tx=0x7ff1d0008040 comp rx=0 tx=0).stop 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 msgr2=0x7ff1d80c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 0x7ff1d80c68f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc004ec0 tx=0x7ff1cc007430 comp rx=0 tx=0).stop 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 shutdown_connections 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff1c40762d0 0x7ff1c40787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1d80c4ed0 0x7ff1d80c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1d80c1000 0x7ff1d80c68f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 --2- 172.21.15.46:0/1236102422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1d81ed810 0x7ff1d80c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 >> 172.21.15.46:0/1236102422 conn(0x7ff1d80aefc0 msgr2=0x7ff1d81571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 shutdown_connections 2024-05-09T02:18:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.158+0000 7ff1df3d5640 1 -- 172.21.15.46:0/1236102422 wait complete. 2024-05-09T02:18:18.175 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-05-09T02:18:18.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.294+0000 7ff7d2527640 1 Processor -- start 2024-05-09T02:18:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.294+0000 7ff7d2527640 1 -- start start 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d2527640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff7cc1602f0 0x7ff7cc162710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d2527640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc1553e0 con 0x7ff7cc0c6d70 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d2527640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc158580 con 0x7ff7cc154fd0 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d2527640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff7cc0c2690 con 0x7ff7cc1602f0 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cbfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff7cc0c6d70 0x7ff7cc0c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38816/0 (socket says 172.21.15.46:38816) 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cbfff640 1 -- 172.21.15.46:0/2955639504 learned_addr learned my addr 172.21.15.46:0/2955639504 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d0ac4640 1 --2- 172.21.15.46:0/2955639504 >> v2:172.21.15.107:3300/0 conn(0x7ff7cc1602f0 0x7ff7cc162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284856759 0 0) 0x7ff7bc001110 con 0x7ff7cc0c6d70 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7b8003520 con 0x7ff7cc0c6d70 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218778371 0 0) 0x7ff7cc158580 con 0x7ff7cc154fd0 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7bc001110 con 0x7ff7cc154fd0 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227238164 0 0) 0x7ff7b8003520 con 0x7ff7cc0c6d70 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d0ac4640 1 -- 172.21.15.46:0/2955639504 >> v1:172.21.15.107:6789/0 conn(0x7ff7cc154fd0 legacy=0x7ff7cc0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d0ac4640 1 -- 172.21.15.46:0/2955639504 >> v1:172.21.15.46:6789/0 conn(0x7ff7cc0c6d70 legacy=0x7ff7cc0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.296+0000 7ff7d0ac4640 1 -- 172.21.15.46:0/2955639504 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc158860 con 0x7ff7cc1602f0 2024-05-09T02:18:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.297+0000 7ff7d0ac4640 1 --2- 172.21.15.46:0/2955639504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc1602f0 0x7ff7cc162710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009dc0 tx=0x7ff7c402a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eae1d32b745a1024 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.297+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0018c0 con 0x7ff7cc1602f0 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.297+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c4007540 con 0x7ff7cc1602f0 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.297+0000 7ff7cb7fe640 1 -- 172.21.15.46:0/2955639504 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4007910 con 0x7ff7cc1602f0 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 -- 172.21.15.46:0/2955639504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc1602f0 msgr2=0x7ff7cc162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 --2- 172.21.15.46:0/2955639504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc1602f0 0x7ff7cc162710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009dc0 tx=0x7ff7c402a590 comp rx=0 tx=0).stop 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 -- 172.21.15.46:0/2955639504 shutdown_connections 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 --2- 172.21.15.46:0/2955639504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc1602f0 0x7ff7cc162710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 -- 172.21.15.46:0/2955639504 >> 172.21.15.46:0/2955639504 conn(0x7ff7cc06e8f0 msgr2=0x7ff7cc06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 -- 172.21.15.46:0/2955639504 shutdown_connections 2024-05-09T02:18:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.298+0000 7ff7d2527640 1 -- 172.21.15.46:0/2955639504 wait complete. 2024-05-09T02:18:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.300+0000 7ff7d2527640 1 Processor -- start 2024-05-09T02:18:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.300+0000 7ff7d2527640 1 -- start start 2024-05-09T02:18:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d2527640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc0c6d70 0x7ff7cc1eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d2527640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 0x7ff7cc14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d2527640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7cc1602f0 0x7ff7cc14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d2527640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc162c50 con 0x7ff7cc154fd0 2024-05-09T02:18:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d2527640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0c2320 con 0x7ff7cc0c6d70 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d2527640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc162dd0 con 0x7ff7cc1602f0 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 0x7ff7cc14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 0x7ff7cc14d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44880/0 (socket says 172.21.15.46:44880) 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7c3fff640 1 -- 172.21.15.46:0/431810762 learned_addr learned my addr 172.21.15.46:0/431810762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7cbfff640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc0c6d70 0x7ff7cc1eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7d0ac4640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7cc1602f0 0x7ff7cc14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7c3fff640 1 -- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7cc1602f0 msgr2=0x7ff7cc14de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.301+0000 7ff7c3fff640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7cc1602f0 0x7ff7cc14de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c3fff640 1 -- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc0c6d70 msgr2=0x7ff7cc1eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c3fff640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc0c6d70 0x7ff7cc1eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c3fff640 1 -- 172.21.15.46:0/431810762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc1546f0 con 0x7ff7cc154fd0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7d0ac4640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7cc1602f0 0x7ff7cc14de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c3fff640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 0x7ff7cc14d910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c460 tx=0x7ff7b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40052d0 con 0x7ff7cc154fd0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b4005490 con 0x7ff7cc154fd0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc14a7f0 con 0x7ff7cc154fd0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4012870 con 0x7ff7cc154fd0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.302+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7cc14c410 con 0x7ff7cc154fd0 2024-05-09T02:18:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.303+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7cc06a330 con 0x7ff7cc154fd0 2024-05-09T02:18:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.304+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff7b4012a10 con 0x7ff7cc154fd0 2024-05-09T02:18:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.304+0000 7ff7c97fa640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff7ac076300 0x7ff7ac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.304+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7ff7b40970b0 con 0x7ff7cc154fd0 2024-05-09T02:18:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.304+0000 7ff7cbfff640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff7ac076300 0x7ff7ac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.305+0000 7ff7cbfff640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff7ac076300 0x7ff7ac078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0013f0 tx=0x7ff7bc001020 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:18.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.309+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff7b4060a30 con 0x7ff7cc154fd0 2024-05-09T02:18:18.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.537+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7cc069e80 con 0x7ff7cc154fd0 2024-05-09T02:18:18.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.538+0000 7ff7c97fa640 1 -- 172.21.15.46:0/431810762 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5165 (secure 0 0 0) 0x7ff7b4060330 con 0x7ff7cc154fd0 2024-05-09T02:18:18.540 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1}]} 2024-05-09T02:18:18.541 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff7ac076300 msgr2=0x7ff7ac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff7ac076300 0x7ff7ac078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0013f0 tx=0x7ff7bc001020 comp rx=0 tx=0).stop 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 msgr2=0x7ff7cc14d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 0x7ff7cc14d910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c460 tx=0x7ff7b400c920 comp rx=0 tx=0).stop 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 shutdown_connections 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff7ac076300 0x7ff7ac078810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7cc1602f0 0x7ff7cc14de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7cc154fd0 0x7ff7cc14d910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 --2- 172.21.15.46:0/431810762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7cc0c6d70 0x7ff7cc1eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 >> 172.21.15.46:0/431810762 conn(0x7ff7cc06e8f0 msgr2=0x7ff7cc0c58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 shutdown_connections 2024-05-09T02:18:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.540+0000 7ff7d2527640 1 -- 172.21.15.46:0/431810762 wait complete. 2024-05-09T02:18:18.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:18.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.665+0000 7f05daabd640 1 Processor -- start 2024-05-09T02:18:18.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.666+0000 7f05daabd640 1 -- start start 2024-05-09T02:18:18.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05daabd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f05d4155160 0x7f05d40c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05daabd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05daabd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4158ae0 con 0x7f05d40c84a0 2024-05-09T02:18:18.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05daabd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f05d4155570 con 0x7f05d4155160 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05daabd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05d4157ed0 con 0x7f05d415b3a0 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05d3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f05d40c84a0 0x7f05d40c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38822/0 (socket says 172.21.15.46:38822) 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05d3fff640 1 -- 172.21.15.46:0/93859179 learned_addr learned my addr 172.21.15.46:0/93859179 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05d8859640 1 --2- 172.21.15.46:0/93859179 >> v2:172.21.15.107:3300/0 conn(0x7f05d4155160 0x7f05d40c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05d905a640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05d37fe640 1 -- 172.21.15.46:0/93859179 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737267941 0 0) 0x7f05d4158ae0 con 0x7f05d40c84a0 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.667+0000 7f05d37fe640 1 -- 172.21.15.46:0/93859179 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c4003520 con 0x7f05d40c84a0 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d8859640 1 -- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 msgr2=0x7f05d415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d37fe640 1 -- 172.21.15.46:0/93859179 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288797716 0 0) 0x7f05c4003520 con 0x7f05d40c84a0 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d8859640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d8859640 1 -- 172.21.15.46:0/93859179 >> v1:172.21.15.46:6789/0 conn(0x7f05d40c84a0 legacy=0x7f05d40c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d8859640 1 -- 172.21.15.46:0/93859179 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d41581b0 con 0x7f05d4155160 2024-05-09T02:18:18.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d905a640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.668+0000 7f05d8859640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d40c7f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c80097a0 tx=0x7f05c802a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca82d763fe0dcf1f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05d37fe640 1 -- 172.21.15.46:0/93859179 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8037070 con 0x7f05d4155160 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05d37fe640 1 -- 172.21.15.46:0/93859179 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c802aa90 con 0x7f05d4155160 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05d37fe640 1 -- 172.21.15.46:0/93859179 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c00016f0 con 0x7f05d4155160 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 -- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 msgr2=0x7f05d40c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d40c7f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c80097a0 tx=0x7f05c802a000 comp rx=0 tx=0).stop 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 -- 172.21.15.46:0/93859179 shutdown_connections 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 --2- 172.21.15.46:0/93859179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d40c7f60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 -- 172.21.15.46:0/93859179 >> 172.21.15.46:0/93859179 conn(0x7f05d40aebe0 msgr2=0x7f05d40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 -- 172.21.15.46:0/93859179 shutdown_connections 2024-05-09T02:18:18.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.669+0000 7f05daabd640 1 -- 172.21.15.46:0/93859179 wait complete. 2024-05-09T02:18:18.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.671+0000 7f05daabd640 1 Processor -- start 2024-05-09T02:18:18.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.671+0000 7f05daabd640 1 -- start start 2024-05-09T02:18:18.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05daabd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 0x7f05d414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05daabd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d4152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05daabd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d4149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05daabd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4157b30 con 0x7f05d40c84a0 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05daabd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4158770 con 0x7f05d4155160 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05daabd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05d4157cb0 con 0x7f05d415b3a0 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05d8859640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 0x7f05d414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05d8859640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 0x7f05d414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44892/0 (socket says 172.21.15.46:44892) 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.672+0000 7f05d8859640 1 -- 172.21.15.46:0/1517624881 learned_addr learned my addr 172.21.15.46:0/1517624881 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d3fff640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d4152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d905a640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d4149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d8859640 1 -- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 msgr2=0x7f05d4149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d8859640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d4149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d8859640 1 -- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 msgr2=0x7f05d4152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d8859640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d4152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d8859640 1 -- 172.21.15.46:0/1517624881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4153a10 con 0x7f05d40c84a0 2024-05-09T02:18:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d905a640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d4149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d8859640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 0x7f05d414af90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000c00 tx=0x7f05c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8041070 con 0x7f05d40c84a0 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c803c660 con 0x7f05d40c84a0 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d41ee3f0 con 0x7f05d40c84a0 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8037040 con 0x7f05d40c84a0 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.673+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d4152a90 con 0x7f05d40c84a0 2024-05-09T02:18:18.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.674+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d408e4c0 con 0x7f05d40c84a0 2024-05-09T02:18:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.675+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05c8044070 con 0x7f05d40c84a0 2024-05-09T02:18:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.675+0000 7f05d17fa640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05b80762d0 0x7f05b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.676+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f05c80b7d10 con 0x7f05d40c84a0 2024-05-09T02:18:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.676+0000 7f05d3fff640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05b80762d0 0x7f05b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.676+0000 7f05d3fff640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05b80762d0 0x7f05b80787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05c0001300 tx=0x7f05c0001290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.679+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05c8081230 con 0x7f05d40c84a0 2024-05-09T02:18:18.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.871+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05d406a330 con 0x7f05d40c84a0 2024-05-09T02:18:18.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.872+0000 7f05d17fa640 1 -- 172.21.15.46:0/1517624881 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16549 (secure 0 0 0) 0x7f05c8085530 con 0x7f05d40c84a0 2024-05-09T02:18:18.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:18.875 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:15.136248+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05b80762d0 msgr2=0x7f05b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05b80762d0 0x7f05b80787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05c0001300 tx=0x7f05c0001290 comp rx=0 tx=0).stop 2024-05-09T02:18:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 msgr2=0x7f05d414af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 0x7f05d414af90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000c00 tx=0x7f05c80046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 shutdown_connections 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05b80762d0 0x7f05b80787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05d415b3a0 0x7f05d4149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d4155160 0x7f05d4152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 --2- 172.21.15.46:0/1517624881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05d40c84a0 0x7f05d414af90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 >> 172.21.15.46:0/1517624881 conn(0x7f05d40aebe0 msgr2=0x7f05d40cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 shutdown_connections 2024-05-09T02:18:18.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:18.874+0000 7f05daabd640 1 -- 172.21.15.46:0/1517624881 wait complete. 2024-05-09T02:18:18.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T02:18:18.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.000+0000 7f28f5e42640 1 Processor -- start 2024-05-09T02:18:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.000+0000 7f28f5e42640 1 -- start start 2024-05-09T02:18:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28f5e42640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28f00c5790 0x7f28f01579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28f5e42640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f0155100 0x7f28f015b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28f5e42640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28f015bb60 0x7f28f00ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28f5e42640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f28f00c96f0 con 0x7f28f00c5790 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28f5e42640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f28f00c9410 con 0x7f28f015bb60 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28f5e42640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f28f00c8ee0 con 0x7f28f0155100 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28ef7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28f00c5790 0x7f28f01579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28ef7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28f00c5790 0x7f28f01579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44906/0 (socket says 172.21.15.46:44906) 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28ef7fe640 1 -- 172.21.15.46:0/2107374434 learned_addr learned my addr 172.21.15.46:0/2107374434 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28eeffd640 1 --2- 172.21.15.46:0/2107374434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f0155100 0x7f28f015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.001+0000 7f28effff640 1 --2- 172.21.15.46:0/2107374434 >> v2:172.21.15.107:3300/0 conn(0x7f28f015bb60 0x7f28f00ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ef7fe640 1 -- 172.21.15.46:0/2107374434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f0155100 msgr2=0x7f28f015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ef7fe640 1 --2- 172.21.15.46:0/2107374434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f0155100 0x7f28f015b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ef7fe640 1 -- 172.21.15.46:0/2107374434 >> v2:172.21.15.107:3300/0 conn(0x7f28f015bb60 msgr2=0x7f28f00ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ef7fe640 1 --2- 172.21.15.46:0/2107374434 >> v2:172.21.15.107:3300/0 conn(0x7f28f015bb60 0x7f28f00ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ef7fe640 1 -- 172.21.15.46:0/2107374434 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f015b100 con 0x7f28f00c5790 2024-05-09T02:18:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ef7fe640 1 --2- 172.21.15.46:0/2107374434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f01579f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28f0074950 tx=0x7f28e002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a6fb6d5cef18b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ee7fc640 1 -- 172.21.15.46:0/2107374434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0036070 con 0x7f28f00c5790 2024-05-09T02:18:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ee7fc640 1 -- 172.21.15.46:0/2107374434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e0031600 con 0x7f28f00c5790 2024-05-09T02:18:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.002+0000 7f28ee7fc640 1 -- 172.21.15.46:0/2107374434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00319d0 con 0x7f28f00c5790 2024-05-09T02:18:19.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 -- 172.21.15.46:0/2107374434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 msgr2=0x7f28f01579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 --2- 172.21.15.46:0/2107374434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f01579f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28f0074950 tx=0x7f28e002a570 comp rx=0 tx=0).stop 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 -- 172.21.15.46:0/2107374434 shutdown_connections 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 --2- 172.21.15.46:0/2107374434 >> v2:172.21.15.107:3300/0 conn(0x7f28f015bb60 0x7f28f00ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 --2- 172.21.15.46:0/2107374434 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f0155100 0x7f28f015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 --2- 172.21.15.46:0/2107374434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f01579f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 -- 172.21.15.46:0/2107374434 >> 172.21.15.46:0/2107374434 conn(0x7f28f006cb10 msgr2=0x7f28f006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 -- 172.21.15.46:0/2107374434 shutdown_connections 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.003+0000 7f28f5e42640 1 -- 172.21.15.46:0/2107374434 wait complete. 2024-05-09T02:18:19.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.005+0000 7f28f5e42640 1 Processor -- start 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.005+0000 7f28f5e42640 1 -- start start 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28f5e42640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28f5e42640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28f0155100 0x7f28f0155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28f5e42640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f015bb60 0x7f28f01f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28f5e42640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0072c20 con 0x7f28f00c5790 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28f5e42640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0072aa0 con 0x7f28f0155100 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28f5e42640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f28f00ca630 con 0x7f28f015bb60 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28ef7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28ef7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f014fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44922/0 (socket says 172.21.15.46:44922) 2024-05-09T02:18:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28ef7fe640 1 -- 172.21.15.46:0/3553041450 learned_addr learned my addr 172.21.15.46:0/3553041450 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28eeffd640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28f0155100 0x7f28f0155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.006+0000 7f28effff640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f015bb60 0x7f28f01f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28ef7fe640 1 -- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f015bb60 msgr2=0x7f28f01f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28ef7fe640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f015bb60 0x7f28f01f10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28ef7fe640 1 -- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28f0155100 msgr2=0x7f28f0155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28ef7fe640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28f0155100 0x7f28f0155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28ef7fe640 1 -- 172.21.15.46:0/3553041450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f00aab50 con 0x7f28f00c5790 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28eeffd640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28f0155100 0x7f28f0155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28ef7fe640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f014fa10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009f40 tx=0x7f28e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e003f020 con 0x7f28f00c5790 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e0037040 con 0x7f28f00c5790 2024-05-09T02:18:19.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f01f1f30 con 0x7f28f00c5790 2024-05-09T02:18:19.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0036070 con 0x7f28f00c5790 2024-05-09T02:18:19.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.007+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f00c1300 con 0x7f28f00c5790 2024-05-09T02:18:19.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.008+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f006a330 con 0x7f28f00c5790 2024-05-09T02:18:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.009+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f28e0042020 con 0x7f28f00c5790 2024-05-09T02:18:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.010+0000 7f28e7fff640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f28d00762d0 0x7f28d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.010+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f28e00b78e0 con 0x7f28f00c5790 2024-05-09T02:18:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.010+0000 7f28eeffd640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f28d00762d0 0x7f28d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.011+0000 7f28eeffd640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f28d00762d0 0x7f28d00787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28f015b720 tx=0x7f28d8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.014+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f28e0049030 con 0x7f28f00c5790 2024-05-09T02:18:19.119 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-09T02:18:19.114+0000 7fa024396640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:18:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.201+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28f00c6110 con 0x7f28d00762d0 2024-05-09T02:18:19.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.208+0000 7f28e7fff640 1 -- 172.21.15.46:0/3553041450 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f28f00c6110 con 0x7f28d00762d0 2024-05-09T02:18:19.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:19.238 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:19.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f28d00762d0 msgr2=0x7f28d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f28d00762d0 0x7f28d00787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28f015b720 tx=0x7f28d8009190 comp rx=0 tx=0).stop 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 msgr2=0x7f28f014fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f014fa10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009f40 tx=0x7f28e0004a40 comp rx=0 tx=0).stop 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 shutdown_connections 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f28d00762d0 0x7f28d00787e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28f015bb60 0x7f28f01f10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28f0155100 0x7f28f0155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 --2- 172.21.15.46:0/3553041450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28f00c5790 0x7f28f014fa10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 >> 172.21.15.46:0/3553041450 conn(0x7f28f006cb10 msgr2=0x7f28f006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 shutdown_connections 2024-05-09T02:18:19.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.211+0000 7f28f5e42640 1 -- 172.21.15.46:0/3553041450 wait complete. 2024-05-09T02:18:19.241 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-09T02:18:18.498803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235724,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2965504,"data_stored":1777206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001716"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144614+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:15.144614+0000","last_peered":"2024-05-09T02:18:15.144614+0000","last_clean":"2024-05-09T02:18:15.144614+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:15.144614+0000","last_undegraded":"2024-05-09T02:18:15.144614+0000","last_fullsized":"2024-05-09T02:18:15.144614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280228+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:15.280228+0000","last_peered":"2024-05-09T02:18:15.280228+0000","last_clean":"2024-05-09T02:18:15.280228+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:15.280228+0000","last_undegraded":"2024-05-09T02:18:15.280228+0000","last_fullsized":"2024-05-09T02:18:15.280228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142806+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:15.142806+0000","last_peered":"2024-05-09T02:18:15.142806+0000","last_clean":"2024-05-09T02:18:15.142806+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:15.142806+0000","last_undegraded":"2024-05-09T02:18:15.142806+0000","last_fullsized":"2024-05-09T02:18:15.142806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657643+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:15.657643+0000","last_peered":"2024-05-09T02:18:15.657643+0000","last_clean":"2024-05-09T02:18:15.657643+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:15.657643+0000","last_undegraded":"2024-05-09T02:18:15.657643+0000","last_fullsized":"2024-05-09T02:18:15.657643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143635+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:15.143635+0000","last_peered":"2024-05-09T02:18:15.143635+0000","last_clean":"2024-05-09T02:18:15.143635+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:15.143635+0000","last_undegraded":"2024-05-09T02:18:15.143635+0000","last_fullsized":"2024-05-09T02:18:15.143635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657462+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:15.657462+0000","last_peered":"2024-05-09T02:18:15.657462+0000","last_clean":"2024-05-09T02:18:15.657462+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:15.657462+0000","last_undegraded":"2024-05-09T02:18:15.657462+0000","last_fullsized":"2024-05-09T02:18:15.657462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143279+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:15.143279+0000","last_peered":"2024-05-09T02:18:15.143279+0000","last_clean":"2024-05-09T02:18:15.143279+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:15.143279+0000","last_undegraded":"2024-05-09T02:18:15.143279+0000","last_fullsized":"2024-05-09T02:18:15.143279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657735+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:15.657735+0000","last_peered":"2024-05-09T02:18:15.657735+0000","last_clean":"2024-05-09T02:18:15.657735+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:15.657735+0000","last_undegraded":"2024-05-09T02:18:15.657735+0000","last_fullsized":"2024-05-09T02:18:15.657735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144708+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:15.144708+0000","last_peered":"2024-05-09T02:18:15.144708+0000","last_clean":"2024-05-09T02:18:15.144708+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:15.144708+0000","last_undegraded":"2024-05-09T02:18:15.144708+0000","last_fullsized":"2024-05-09T02:18:15.144708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270249+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:15.270249+0000","last_peered":"2024-05-09T02:18:15.270249+0000","last_clean":"2024-05-09T02:18:15.270249+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:15.270249+0000","last_undegraded":"2024-05-09T02:18:15.270249+0000","last_fullsized":"2024-05-09T02:18:15.270249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270066+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:15.270066+0000","last_peered":"2024-05-09T02:18:15.270066+0000","last_clean":"2024-05-09T02:18:15.270066+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:15.270066+0000","last_undegraded":"2024-05-09T02:18:15.270066+0000","last_fullsized":"2024-05-09T02:18:15.270066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143768+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:15.143768+0000","last_peered":"2024-05-09T02:18:15.143768+0000","last_clean":"2024-05-09T02:18:15.143768+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:15.143768+0000","last_undegraded":"2024-05-09T02:18:15.143768+0000","last_fullsized":"2024-05-09T02:18:15.143768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658201+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:15.658201+0000","last_peered":"2024-05-09T02:18:15.658201+0000","last_clean":"2024-05-09T02:18:15.658201+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:15.658201+0000","last_undegraded":"2024-05-09T02:18:15.658201+0000","last_fullsized":"2024-05-09T02:18:15.658201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142480+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:15.142480+0000","last_peered":"2024-05-09T02:18:15.142480+0000","last_clean":"2024-05-09T02:18:15.142480+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:15.142480+0000","last_undegraded":"2024-05-09T02:18:15.142480+0000","last_fullsized":"2024-05-09T02:18:15.142480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.279990+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:15.279990+0000","last_peered":"2024-05-09T02:18:15.279990+0000","last_clean":"2024-05-09T02:18:15.279990+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:15.279990+0000","last_undegraded":"2024-05-09T02:18:15.279990+0000","last_fullsized":"2024-05-09T02:18:15.279990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657314+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:15.657314+0000","last_peered":"2024-05-09T02:18:15.657314+0000","last_clean":"2024-05-09T02:18:15.657314+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:15.657314+0000","last_undegraded":"2024-05-09T02:18:15.657314+0000","last_fullsized":"2024-05-09T02:18:15.657314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658114+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:15.658114+0000","last_peered":"2024-05-09T02:18:15.658114+0000","last_clean":"2024-05-09T02:18:15.658114+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:15.658114+0000","last_undegraded":"2024-05-09T02:18:15.658114+0000","last_fullsized":"2024-05-09T02:18:15.658114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657406+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:15.657406+0000","last_peered":"2024-05-09T02:18:15.657406+0000","last_clean":"2024-05-09T02:18:15.657406+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:15.657406+0000","last_undegraded":"2024-05-09T02:18:15.657406+0000","last_fullsized":"2024-05-09T02:18:15.657406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144238+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:15.144238+0000","last_peered":"2024-05-09T02:18:15.144238+0000","last_clean":"2024-05-09T02:18:15.144238+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:15.144238+0000","last_undegraded":"2024-05-09T02:18:15.144238+0000","last_fullsized":"2024-05-09T02:18:15.144238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270158+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:15.270158+0000","last_peered":"2024-05-09T02:18:15.270158+0000","last_clean":"2024-05-09T02:18:15.270158+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:15.270158+0000","last_undegraded":"2024-05-09T02:18:15.270158+0000","last_fullsized":"2024-05-09T02:18:15.270158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142558+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:15.142558+0000","last_peered":"2024-05-09T02:18:15.142558+0000","last_clean":"2024-05-09T02:18:15.142558+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:15.142558+0000","last_undegraded":"2024-05-09T02:18:15.142558+0000","last_fullsized":"2024-05-09T02:18:15.142558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657514+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:15.657514+0000","last_peered":"2024-05-09T02:18:15.657514+0000","last_clean":"2024-05-09T02:18:15.657514+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:15.657514+0000","last_undegraded":"2024-05-09T02:18:15.657514+0000","last_fullsized":"2024-05-09T02:18:15.657514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657903+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:15.657903+0000","last_peered":"2024-05-09T02:18:15.657903+0000","last_clean":"2024-05-09T02:18:15.657903+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:15.657903+0000","last_undegraded":"2024-05-09T02:18:15.657903+0000","last_fullsized":"2024-05-09T02:18:15.657903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657420+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:15.657420+0000","last_peered":"2024-05-09T02:18:15.657420+0000","last_clean":"2024-05-09T02:18:15.657420+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:15.657420+0000","last_undegraded":"2024-05-09T02:18:15.657420+0000","last_fullsized":"2024-05-09T02:18:15.657420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658367+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:15.658367+0000","last_peered":"2024-05-09T02:18:15.658367+0000","last_clean":"2024-05-09T02:18:15.658367+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:15.658367+0000","last_undegraded":"2024-05-09T02:18:15.658367+0000","last_fullsized":"2024-05-09T02:18:15.658367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270269+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:15.270269+0000","last_peered":"2024-05-09T02:18:15.270269+0000","last_clean":"2024-05-09T02:18:15.270269+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:15.270269+0000","last_undegraded":"2024-05-09T02:18:15.270269+0000","last_fullsized":"2024-05-09T02:18:15.270269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280262+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:15.280262+0000","last_peered":"2024-05-09T02:18:15.280262+0000","last_clean":"2024-05-09T02:18:15.280262+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:15.280262+0000","last_undegraded":"2024-05-09T02:18:15.280262+0000","last_fullsized":"2024-05-09T02:18:15.280262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658337+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:15.658337+0000","last_peered":"2024-05-09T02:18:15.658337+0000","last_clean":"2024-05-09T02:18:15.658337+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:15.658337+0000","last_undegraded":"2024-05-09T02:18:15.658337+0000","last_fullsized":"2024-05-09T02:18:15.658337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142760+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:15.142760+0000","last_peered":"2024-05-09T02:18:15.142760+0000","last_clean":"2024-05-09T02:18:15.142760+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:15.142760+0000","last_undegraded":"2024-05-09T02:18:15.142760+0000","last_fullsized":"2024-05-09T02:18:15.142760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657924+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:15.657924+0000","last_peered":"2024-05-09T02:18:15.657924+0000","last_clean":"2024-05-09T02:18:15.657924+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:15.657924+0000","last_undegraded":"2024-05-09T02:18:15.657924+0000","last_fullsized":"2024-05-09T02:18:15.657924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657258+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:15.657258+0000","last_peered":"2024-05-09T02:18:15.657258+0000","last_clean":"2024-05-09T02:18:15.657258+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:15.657258+0000","last_undegraded":"2024-05-09T02:18:15.657258+0000","last_fullsized":"2024-05-09T02:18:15.657258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270008+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:15.270008+0000","last_peered":"2024-05-09T02:18:15.270008+0000","last_clean":"2024-05-09T02:18:15.270008+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:15.270008+0000","last_undegraded":"2024-05-09T02:18:15.270008+0000","last_fullsized":"2024-05-09T02:18:15.270008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143326+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:15.143326+0000","last_peered":"2024-05-09T02:18:15.143326+0000","last_clean":"2024-05-09T02:18:15.143326+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:15.143326+0000","last_undegraded":"2024-05-09T02:18:15.143326+0000","last_fullsized":"2024-05-09T02:18:15.143326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658346+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:15.658346+0000","last_peered":"2024-05-09T02:18:15.658346+0000","last_clean":"2024-05-09T02:18:15.658346+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:15.658346+0000","last_undegraded":"2024-05-09T02:18:15.658346+0000","last_fullsized":"2024-05-09T02:18:15.658346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142909+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:15.142909+0000","last_peered":"2024-05-09T02:18:15.142909+0000","last_clean":"2024-05-09T02:18:15.142909+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:15.142909+0000","last_undegraded":"2024-05-09T02:18:15.142909+0000","last_fullsized":"2024-05-09T02:18:15.142909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269783+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:15.269783+0000","last_peered":"2024-05-09T02:18:15.269783+0000","last_clean":"2024-05-09T02:18:15.269783+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:15.269783+0000","last_undegraded":"2024-05-09T02:18:15.269783+0000","last_fullsized":"2024-05-09T02:18:15.269783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657832+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:15.657832+0000","last_peered":"2024-05-09T02:18:15.657832+0000","last_clean":"2024-05-09T02:18:15.657832+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:15.657832+0000","last_undegraded":"2024-05-09T02:18:15.657832+0000","last_fullsized":"2024-05-09T02:18:15.657832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657791+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:15.657791+0000","last_peered":"2024-05-09T02:18:15.657791+0000","last_clean":"2024-05-09T02:18:15.657791+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:15.657791+0000","last_undegraded":"2024-05-09T02:18:15.657791+0000","last_fullsized":"2024-05-09T02:18:15.657791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657493+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:15.657493+0000","last_peered":"2024-05-09T02:18:15.657493+0000","last_clean":"2024-05-09T02:18:15.657493+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:15.657493+0000","last_undegraded":"2024-05-09T02:18:15.657493+0000","last_fullsized":"2024-05-09T02:18:15.657493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.279966+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:15.279966+0000","last_peered":"2024-05-09T02:18:15.279966+0000","last_clean":"2024-05-09T02:18:15.279966+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:15.279966+0000","last_undegraded":"2024-05-09T02:18:15.279966+0000","last_fullsized":"2024-05-09T02:18:15.279966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270099+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:15.270099+0000","last_peered":"2024-05-09T02:18:15.270099+0000","last_clean":"2024-05-09T02:18:15.270099+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:15.270099+0000","last_undegraded":"2024-05-09T02:18:15.270099+0000","last_fullsized":"2024-05-09T02:18:15.270099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657843+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:15.657843+0000","last_peered":"2024-05-09T02:18:15.657843+0000","last_clean":"2024-05-09T02:18:15.657843+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:15.657843+0000","last_undegraded":"2024-05-09T02:18:15.657843+0000","last_fullsized":"2024-05-09T02:18:15.657843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657840+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:15.657840+0000","last_peered":"2024-05-09T02:18:15.657840+0000","last_clean":"2024-05-09T02:18:15.657840+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:15.657840+0000","last_undegraded":"2024-05-09T02:18:15.657840+0000","last_fullsized":"2024-05-09T02:18:15.657840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142963+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:15.142963+0000","last_peered":"2024-05-09T02:18:15.142963+0000","last_clean":"2024-05-09T02:18:15.142963+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:15.142963+0000","last_undegraded":"2024-05-09T02:18:15.142963+0000","last_fullsized":"2024-05-09T02:18:15.142963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280035+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:15.280035+0000","last_peered":"2024-05-09T02:18:15.280035+0000","last_clean":"2024-05-09T02:18:15.280035+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:15.280035+0000","last_undegraded":"2024-05-09T02:18:15.280035+0000","last_fullsized":"2024-05-09T02:18:15.280035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143838+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:15.143838+0000","last_peered":"2024-05-09T02:18:15.143838+0000","last_clean":"2024-05-09T02:18:15.143838+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:15.143838+0000","last_undegraded":"2024-05-09T02:18:15.143838+0000","last_fullsized":"2024-05-09T02:18:15.143838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270081+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:15.270081+0000","last_peered":"2024-05-09T02:18:15.270081+0000","last_clean":"2024-05-09T02:18:15.270081+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:15.270081+0000","last_undegraded":"2024-05-09T02:18:15.270081+0000","last_fullsized":"2024-05-09T02:18:15.270081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143242+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:15.143242+0000","last_peered":"2024-05-09T02:18:15.143242+0000","last_clean":"2024-05-09T02:18:15.143242+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:15.143242+0000","last_undegraded":"2024-05-09T02:18:15.143242+0000","last_fullsized":"2024-05-09T02:18:15.143242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142862+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:15.142862+0000","last_peered":"2024-05-09T02:18:15.142862+0000","last_clean":"2024-05-09T02:18:15.142862+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:15.142862+0000","last_undegraded":"2024-05-09T02:18:15.142862+0000","last_fullsized":"2024-05-09T02:18:15.142862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142659+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:15.142659+0000","last_peered":"2024-05-09T02:18:15.142659+0000","last_clean":"2024-05-09T02:18:15.142659+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:15.142659+0000","last_undegraded":"2024-05-09T02:18:15.142659+0000","last_fullsized":"2024-05-09T02:18:15.142659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657779+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:15.657779+0000","last_peered":"2024-05-09T02:18:15.657779+0000","last_clean":"2024-05-09T02:18:15.657779+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:15.657779+0000","last_undegraded":"2024-05-09T02:18:15.657779+0000","last_fullsized":"2024-05-09T02:18:15.657779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143686+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:15.143686+0000","last_peered":"2024-05-09T02:18:15.143686+0000","last_clean":"2024-05-09T02:18:15.143686+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:15.143686+0000","last_undegraded":"2024-05-09T02:18:15.143686+0000","last_fullsized":"2024-05-09T02:18:15.143686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269753+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:15.269753+0000","last_peered":"2024-05-09T02:18:15.269753+0000","last_clean":"2024-05-09T02:18:15.269753+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:15.269753+0000","last_undegraded":"2024-05-09T02:18:15.269753+0000","last_fullsized":"2024-05-09T02:18:15.269753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269880+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:15.269880+0000","last_peered":"2024-05-09T02:18:15.269880+0000","last_clean":"2024-05-09T02:18:15.269880+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:15.269880+0000","last_undegraded":"2024-05-09T02:18:15.269880+0000","last_fullsized":"2024-05-09T02:18:15.269880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657117+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:15.657117+0000","last_peered":"2024-05-09T02:18:15.657117+0000","last_clean":"2024-05-09T02:18:15.657117+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:15.657117+0000","last_undegraded":"2024-05-09T02:18:15.657117+0000","last_fullsized":"2024-05-09T02:18:15.657117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143502+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:15.143502+0000","last_peered":"2024-05-09T02:18:15.143502+0000","last_clean":"2024-05-09T02:18:15.143502+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:15.143502+0000","last_undegraded":"2024-05-09T02:18:15.143502+0000","last_fullsized":"2024-05-09T02:18:15.143502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144031+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:15.144031+0000","last_peered":"2024-05-09T02:18:15.144031+0000","last_clean":"2024-05-09T02:18:15.144031+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:15.144031+0000","last_undegraded":"2024-05-09T02:18:15.144031+0000","last_fullsized":"2024-05-09T02:18:15.144031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144507+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:15.144507+0000","last_peered":"2024-05-09T02:18:15.144507+0000","last_clean":"2024-05-09T02:18:15.144507+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:15.144507+0000","last_undegraded":"2024-05-09T02:18:15.144507+0000","last_fullsized":"2024-05-09T02:18:15.144507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657370+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:15.657370+0000","last_peered":"2024-05-09T02:18:15.657370+0000","last_clean":"2024-05-09T02:18:15.657370+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:15.657370+0000","last_undegraded":"2024-05-09T02:18:15.657370+0000","last_fullsized":"2024-05-09T02:18:15.657370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144765+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:15.144765+0000","last_peered":"2024-05-09T02:18:15.144765+0000","last_clean":"2024-05-09T02:18:15.144765+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:15.144765+0000","last_undegraded":"2024-05-09T02:18:15.144765+0000","last_fullsized":"2024-05-09T02:18:15.144765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280165+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:15.280165+0000","last_peered":"2024-05-09T02:18:15.280165+0000","last_clean":"2024-05-09T02:18:15.280165+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:15.280165+0000","last_undegraded":"2024-05-09T02:18:15.280165+0000","last_fullsized":"2024-05-09T02:18:15.280165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658016+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:15.658016+0000","last_peered":"2024-05-09T02:18:15.658016+0000","last_clean":"2024-05-09T02:18:15.658016+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:15.658016+0000","last_undegraded":"2024-05-09T02:18:15.658016+0000","last_fullsized":"2024-05-09T02:18:15.658016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657311+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:15.657311+0000","last_peered":"2024-05-09T02:18:15.657311+0000","last_clean":"2024-05-09T02:18:15.657311+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:15.657311+0000","last_undegraded":"2024-05-09T02:18:15.657311+0000","last_fullsized":"2024-05-09T02:18:15.657311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143459+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:15.143459+0000","last_peered":"2024-05-09T02:18:15.143459+0000","last_clean":"2024-05-09T02:18:15.143459+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:15.143459+0000","last_undegraded":"2024-05-09T02:18:15.143459+0000","last_fullsized":"2024-05-09T02:18:15.143459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144038+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:15.144038+0000","last_peered":"2024-05-09T02:18:15.144038+0000","last_clean":"2024-05-09T02:18:15.144038+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:15.144038+0000","last_undegraded":"2024-05-09T02:18:15.144038+0000","last_fullsized":"2024-05-09T02:18:15.144038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657405+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:15.657405+0000","last_peered":"2024-05-09T02:18:15.657405+0000","last_clean":"2024-05-09T02:18:15.657405+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:15.657405+0000","last_undegraded":"2024-05-09T02:18:15.657405+0000","last_fullsized":"2024-05-09T02:18:15.657405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658066+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:15.658066+0000","last_peered":"2024-05-09T02:18:15.658066+0000","last_clean":"2024-05-09T02:18:15.658066+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:15.658066+0000","last_undegraded":"2024-05-09T02:18:15.658066+0000","last_fullsized":"2024-05-09T02:18:15.658066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143969+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:15.143969+0000","last_peered":"2024-05-09T02:18:15.143969+0000","last_clean":"2024-05-09T02:18:15.143969+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:15.143969+0000","last_undegraded":"2024-05-09T02:18:15.143969+0000","last_fullsized":"2024-05-09T02:18:15.143969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142466+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:15.142466+0000","last_peered":"2024-05-09T02:18:15.142466+0000","last_clean":"2024-05-09T02:18:15.142466+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:15.142466+0000","last_undegraded":"2024-05-09T02:18:15.142466+0000","last_fullsized":"2024-05-09T02:18:15.142466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657236+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:15.657236+0000","last_peered":"2024-05-09T02:18:15.657236+0000","last_clean":"2024-05-09T02:18:15.657236+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:15.657236+0000","last_undegraded":"2024-05-09T02:18:15.657236+0000","last_fullsized":"2024-05-09T02:18:15.657236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.279988+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:15.279988+0000","last_peered":"2024-05-09T02:18:15.279988+0000","last_clean":"2024-05-09T02:18:15.279988+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:15.279988+0000","last_undegraded":"2024-05-09T02:18:15.279988+0000","last_fullsized":"2024-05-09T02:18:15.279988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658036+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:15.658036+0000","last_peered":"2024-05-09T02:18:15.658036+0000","last_clean":"2024-05-09T02:18:15.658036+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:15.658036+0000","last_undegraded":"2024-05-09T02:18:15.658036+0000","last_fullsized":"2024-05-09T02:18:15.658036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143334+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:15.143334+0000","last_peered":"2024-05-09T02:18:15.143334+0000","last_clean":"2024-05-09T02:18:15.143334+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:15.143334+0000","last_undegraded":"2024-05-09T02:18:15.143334+0000","last_fullsized":"2024-05-09T02:18:15.143334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280104+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:15.280104+0000","last_peered":"2024-05-09T02:18:15.280104+0000","last_clean":"2024-05-09T02:18:15.280104+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:15.280104+0000","last_undegraded":"2024-05-09T02:18:15.280104+0000","last_fullsized":"2024-05-09T02:18:15.280104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657969+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:15.657969+0000","last_peered":"2024-05-09T02:18:15.657969+0000","last_clean":"2024-05-09T02:18:15.657969+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:15.657969+0000","last_undegraded":"2024-05-09T02:18:15.657969+0000","last_fullsized":"2024-05-09T02:18:15.657969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144353+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:15.144353+0000","last_peered":"2024-05-09T02:18:15.144353+0000","last_clean":"2024-05-09T02:18:15.144353+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:15.144353+0000","last_undegraded":"2024-05-09T02:18:15.144353+0000","last_fullsized":"2024-05-09T02:18:15.144353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280133+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:15.280133+0000","last_peered":"2024-05-09T02:18:15.280133+0000","last_clean":"2024-05-09T02:18:15.280133+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:15.280133+0000","last_undegraded":"2024-05-09T02:18:15.280133+0000","last_fullsized":"2024-05-09T02:18:15.280133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280200+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:15.280200+0000","last_peered":"2024-05-09T02:18:15.280200+0000","last_clean":"2024-05-09T02:18:15.280200+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:15.280200+0000","last_undegraded":"2024-05-09T02:18:15.280200+0000","last_fullsized":"2024-05-09T02:18:15.280200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658375+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:15.658375+0000","last_peered":"2024-05-09T02:18:15.658375+0000","last_clean":"2024-05-09T02:18:15.658375+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:15.658375+0000","last_undegraded":"2024-05-09T02:18:15.658375+0000","last_fullsized":"2024-05-09T02:18:15.658375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270143+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:15.270143+0000","last_peered":"2024-05-09T02:18:15.270143+0000","last_clean":"2024-05-09T02:18:15.270143+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:15.270143+0000","last_undegraded":"2024-05-09T02:18:15.270143+0000","last_fullsized":"2024-05-09T02:18:15.270143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142756+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:15.142756+0000","last_peered":"2024-05-09T02:18:15.142756+0000","last_clean":"2024-05-09T02:18:15.142756+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:15.142756+0000","last_undegraded":"2024-05-09T02:18:15.142756+0000","last_fullsized":"2024-05-09T02:18:15.142756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143783+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:15.143783+0000","last_peered":"2024-05-09T02:18:15.143783+0000","last_clean":"2024-05-09T02:18:15.143783+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:15.143783+0000","last_undegraded":"2024-05-09T02:18:15.143783+0000","last_fullsized":"2024-05-09T02:18:15.143783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144606+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:15.144606+0000","last_peered":"2024-05-09T02:18:15.144606+0000","last_clean":"2024-05-09T02:18:15.144606+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:15.144606+0000","last_undegraded":"2024-05-09T02:18:15.144606+0000","last_fullsized":"2024-05-09T02:18:15.144606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280093+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:15.280093+0000","last_peered":"2024-05-09T02:18:15.280093+0000","last_clean":"2024-05-09T02:18:15.280093+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:15.280093+0000","last_undegraded":"2024-05-09T02:18:15.280093+0000","last_fullsized":"2024-05-09T02:18:15.280093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657943+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:15.657943+0000","last_peered":"2024-05-09T02:18:15.657943+0000","last_clean":"2024-05-09T02:18:15.657943+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:15.657943+0000","last_undegraded":"2024-05-09T02:18:15.657943+0000","last_fullsized":"2024-05-09T02:18:15.657943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280058+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:15.280058+0000","last_peered":"2024-05-09T02:18:15.280058+0000","last_clean":"2024-05-09T02:18:15.280058+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:15.280058+0000","last_undegraded":"2024-05-09T02:18:15.280058+0000","last_fullsized":"2024-05-09T02:18:15.280058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658279+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:15.658279+0000","last_peered":"2024-05-09T02:18:15.658279+0000","last_clean":"2024-05-09T02:18:15.658279+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:15.658279+0000","last_undegraded":"2024-05-09T02:18:15.658279+0000","last_fullsized":"2024-05-09T02:18:15.658279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143776+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:15.143776+0000","last_peered":"2024-05-09T02:18:15.143776+0000","last_clean":"2024-05-09T02:18:15.143776+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:15.143776+0000","last_undegraded":"2024-05-09T02:18:15.143776+0000","last_fullsized":"2024-05-09T02:18:15.143776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269946+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:15.269946+0000","last_peered":"2024-05-09T02:18:15.269946+0000","last_clean":"2024-05-09T02:18:15.269946+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:15.269946+0000","last_undegraded":"2024-05-09T02:18:15.269946+0000","last_fullsized":"2024-05-09T02:18:15.269946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657941+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:15.657941+0000","last_peered":"2024-05-09T02:18:15.657941+0000","last_clean":"2024-05-09T02:18:15.657941+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:15.657941+0000","last_undegraded":"2024-05-09T02:18:15.657941+0000","last_fullsized":"2024-05-09T02:18:15.657941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143320+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:15.143320+0000","last_peered":"2024-05-09T02:18:15.143320+0000","last_clean":"2024-05-09T02:18:15.143320+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:15.143320+0000","last_undegraded":"2024-05-09T02:18:15.143320+0000","last_fullsized":"2024-05-09T02:18:15.143320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657721+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:15.657721+0000","last_peered":"2024-05-09T02:18:15.657721+0000","last_clean":"2024-05-09T02:18:15.657721+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:15.657721+0000","last_undegraded":"2024-05-09T02:18:15.657721+0000","last_fullsized":"2024-05-09T02:18:15.657721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144001+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:15.144001+0000","last_peered":"2024-05-09T02:18:15.144001+0000","last_clean":"2024-05-09T02:18:15.144001+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:15.144001+0000","last_undegraded":"2024-05-09T02:18:15.144001+0000","last_fullsized":"2024-05-09T02:18:15.144001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142631+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:15.142631+0000","last_peered":"2024-05-09T02:18:15.142631+0000","last_clean":"2024-05-09T02:18:15.142631+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:15.142631+0000","last_undegraded":"2024-05-09T02:18:15.142631+0000","last_fullsized":"2024-05-09T02:18:15.142631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658401+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:15.658401+0000","last_peered":"2024-05-09T02:18:15.658401+0000","last_clean":"2024-05-09T02:18:15.658401+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:15.658401+0000","last_undegraded":"2024-05-09T02:18:15.658401+0000","last_fullsized":"2024-05-09T02:18:15.658401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658390+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:15.658390+0000","last_peered":"2024-05-09T02:18:15.658390+0000","last_clean":"2024-05-09T02:18:15.658390+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:15.658390+0000","last_undegraded":"2024-05-09T02:18:15.658390+0000","last_fullsized":"2024-05-09T02:18:15.658390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142916+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:15.142916+0000","last_peered":"2024-05-09T02:18:15.142916+0000","last_clean":"2024-05-09T02:18:15.142916+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:15.142916+0000","last_undegraded":"2024-05-09T02:18:15.142916+0000","last_fullsized":"2024-05-09T02:18:15.142916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":70862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":69250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:19.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:19.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.397+0000 7f6af4c53640 1 Processor -- start 2024-05-09T02:18:19.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.397+0000 7f6af4c53640 1 -- start start 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6af4c53640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6af0154fd0 0x7f6af00c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6af4c53640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6af015af70 0x7f6af015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6af4c53640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af01553e0 con 0x7f6af00c6d70 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6af4c53640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f6af00c2690 con 0x7f6af0154fd0 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6af4c53640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6af0158580 con 0x7f6af015af70 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6aee59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6af00c6d70 0x7f6af00c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38834/0 (socket says 172.21.15.46:38834) 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6aee59c640 1 -- 172.21.15.46:0/3256545082 learned_addr learned my addr 172.21.15.46:0/3256545082 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.398+0000 7f6ae7fff640 1 --2- 172.21.15.46:0/3256545082 >> v2:172.21.15.46:3300/0 conn(0x7f6af0154fd0 0x7f6af00c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6ae7fff640 1 -- 172.21.15.46:0/3256545082 >> v2:172.21.15.107:3300/0 conn(0x7f6af015af70 msgr2=0x7f6af015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6aeed9d640 1 --2- 172.21.15.46:0/3256545082 >> v2:172.21.15.107:3300/0 conn(0x7f6af015af70 0x7f6af015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6ae7fff640 1 --2- 172.21.15.46:0/3256545082 >> v2:172.21.15.107:3300/0 conn(0x7f6af015af70 0x7f6af015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6aedd9b640 1 -- 172.21.15.46:0/3256545082 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518452086 0 0) 0x7f6ae0001110 con 0x7f6af00c6d70 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6ae7fff640 1 -- 172.21.15.46:0/3256545082 >> v1:172.21.15.46:6789/0 conn(0x7f6af00c6d70 legacy=0x7f6af00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6ae7fff640 1 -- 172.21.15.46:0/3256545082 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af0158860 con 0x7f6af0154fd0 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.399+0000 7f6aeed9d640 1 --2- 172.21.15.46:0/3256545082 >> v2:172.21.15.107:3300/0 conn(0x7f6af015af70 0x7f6af015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6ae7fff640 1 --2- 172.21.15.46:0/3256545082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af00c9a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6af00c5040 tx=0x7f6ad802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c325f0a8d55ab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6aedd9b640 1 -- 172.21.15.46:0/3256545082 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8037070 con 0x7f6af0154fd0 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6aedd9b640 1 -- 172.21.15.46:0/3256545082 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad802add0 con 0x7f6af0154fd0 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6aedd9b640 1 -- 172.21.15.46:0/3256545082 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8032660 con 0x7f6af0154fd0 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6af4c53640 1 -- 172.21.15.46:0/3256545082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 msgr2=0x7f6af00c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6af4c53640 1 --2- 172.21.15.46:0/3256545082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af00c9a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6af00c5040 tx=0x7f6ad802a080 comp rx=0 tx=0).stop 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6af4c53640 1 -- 172.21.15.46:0/3256545082 shutdown_connections 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6af4c53640 1 --2- 172.21.15.46:0/3256545082 >> v2:172.21.15.107:3300/0 conn(0x7f6af015af70 0x7f6af015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6af4c53640 1 --2- 172.21.15.46:0/3256545082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af00c9a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.400+0000 7f6af4c53640 1 -- 172.21.15.46:0/3256545082 >> 172.21.15.46:0/3256545082 conn(0x7f6af006e8f0 msgr2=0x7f6af006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:19.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.401+0000 7f6af4c53640 1 -- 172.21.15.46:0/3256545082 shutdown_connections 2024-05-09T02:18:19.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.401+0000 7f6af4c53640 1 -- 172.21.15.46:0/3256545082 wait complete. 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.402+0000 7f6af4c53640 1 Processor -- start 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.402+0000 7f6af4c53640 1 -- start start 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6af00c6d70 0x7f6af0143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6af015af70 0x7f6af01edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00c9f40 con 0x7f6af0154fd0 2024-05-09T02:18:19.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00c2320 con 0x7f6af015af70 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6af015b8c0 con 0x7f6af00c6d70 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af014d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44936/0 (socket says 172.21.15.46:44936) 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 -- 172.21.15.46:0/1846829571 learned_addr learned my addr 172.21.15.46:0/1846829571 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6aeed9d640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6af015af70 0x7f6af01edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6aee59c640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6af00c6d70 0x7f6af0143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 -- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6af00c6d70 msgr2=0x7f6af0143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6af00c6d70 0x7f6af0143240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 -- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6af015af70 msgr2=0x7f6af01edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6af015af70 0x7f6af01edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 -- 172.21.15.46:0/1846829571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af01f14b0 con 0x7f6af0154fd0 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6aee59c640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6af00c6d70 0x7f6af0143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:19.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae7fff640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af014d880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009890 tx=0x7f6ad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8037040 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8042070 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af01f1790 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.404+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad803b890 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.405+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af01f1d50 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.405+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af01f1220 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.406+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ad802ac50 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.407+0000 7f6ae6ffd640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ad0076300 0x7f6ad0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.407+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f6ad80b7ad0 con 0x7f6af0154fd0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.407+0000 7f6aee59c640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ad0076300 0x7f6ad0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.408+0000 7f6aee59c640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ad0076300 0x7f6ad0078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0000f60 tx=0x7f6ae0007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.411+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ad80813b0 con 0x7f6af0154fd0 2024-05-09T02:18:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.599+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6af006a330 con 0x7f6ad0076300 2024-05-09T02:18:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.606+0000 7f6ae6ffd640 1 -- 172.21.15.46:0/1846829571 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f6af006a330 con 0x7f6ad0076300 2024-05-09T02:18:19.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ad0076300 msgr2=0x7f6ad0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ad0076300 0x7f6ad0078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0000f60 tx=0x7f6ae0007ca0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 msgr2=0x7f6af014d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af014d880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009890 tx=0x7f6ad80046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 shutdown_connections 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ad0076300 0x7f6ad0078810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6af015af70 0x7f6af01edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af0154fd0 0x7f6af014d880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 --2- 172.21.15.46:0/1846829571 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6af00c6d70 0x7f6af0143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 >> 172.21.15.46:0/1846829571 conn(0x7f6af006e8f0 msgr2=0x7f6af00c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 shutdown_connections 2024-05-09T02:18:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.609+0000 7f6af4c53640 1 -- 172.21.15.46:0/1846829571 wait complete. 2024-05-09T02:18:19.623 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-09T02:18:18.498803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235724,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2965504,"data_stored":1777206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001716"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144614+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:15.144614+0000","last_peered":"2024-05-09T02:18:15.144614+0000","last_clean":"2024-05-09T02:18:15.144614+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:15.144614+0000","last_undegraded":"2024-05-09T02:18:15.144614+0000","last_fullsized":"2024-05-09T02:18:15.144614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280228+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:15.280228+0000","last_peered":"2024-05-09T02:18:15.280228+0000","last_clean":"2024-05-09T02:18:15.280228+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:15.280228+0000","last_undegraded":"2024-05-09T02:18:15.280228+0000","last_fullsized":"2024-05-09T02:18:15.280228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142806+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:15.142806+0000","last_peered":"2024-05-09T02:18:15.142806+0000","last_clean":"2024-05-09T02:18:15.142806+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:15.142806+0000","last_undegraded":"2024-05-09T02:18:15.142806+0000","last_fullsized":"2024-05-09T02:18:15.142806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657643+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:15.657643+0000","last_peered":"2024-05-09T02:18:15.657643+0000","last_clean":"2024-05-09T02:18:15.657643+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:15.657643+0000","last_undegraded":"2024-05-09T02:18:15.657643+0000","last_fullsized":"2024-05-09T02:18:15.657643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143635+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:15.143635+0000","last_peered":"2024-05-09T02:18:15.143635+0000","last_clean":"2024-05-09T02:18:15.143635+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:15.143635+0000","last_undegraded":"2024-05-09T02:18:15.143635+0000","last_fullsized":"2024-05-09T02:18:15.143635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657462+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:15.657462+0000","last_peered":"2024-05-09T02:18:15.657462+0000","last_clean":"2024-05-09T02:18:15.657462+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:15.657462+0000","last_undegraded":"2024-05-09T02:18:15.657462+0000","last_fullsized":"2024-05-09T02:18:15.657462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143279+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:15.143279+0000","last_peered":"2024-05-09T02:18:15.143279+0000","last_clean":"2024-05-09T02:18:15.143279+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:15.143279+0000","last_undegraded":"2024-05-09T02:18:15.143279+0000","last_fullsized":"2024-05-09T02:18:15.143279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657735+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:15.657735+0000","last_peered":"2024-05-09T02:18:15.657735+0000","last_clean":"2024-05-09T02:18:15.657735+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:15.657735+0000","last_undegraded":"2024-05-09T02:18:15.657735+0000","last_fullsized":"2024-05-09T02:18:15.657735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144708+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:15.144708+0000","last_peered":"2024-05-09T02:18:15.144708+0000","last_clean":"2024-05-09T02:18:15.144708+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:15.144708+0000","last_undegraded":"2024-05-09T02:18:15.144708+0000","last_fullsized":"2024-05-09T02:18:15.144708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270249+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:15.270249+0000","last_peered":"2024-05-09T02:18:15.270249+0000","last_clean":"2024-05-09T02:18:15.270249+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:15.270249+0000","last_undegraded":"2024-05-09T02:18:15.270249+0000","last_fullsized":"2024-05-09T02:18:15.270249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270066+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:15.270066+0000","last_peered":"2024-05-09T02:18:15.270066+0000","last_clean":"2024-05-09T02:18:15.270066+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:15.270066+0000","last_undegraded":"2024-05-09T02:18:15.270066+0000","last_fullsized":"2024-05-09T02:18:15.270066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143768+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:15.143768+0000","last_peered":"2024-05-09T02:18:15.143768+0000","last_clean":"2024-05-09T02:18:15.143768+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:15.143768+0000","last_undegraded":"2024-05-09T02:18:15.143768+0000","last_fullsized":"2024-05-09T02:18:15.143768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658201+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:15.658201+0000","last_peered":"2024-05-09T02:18:15.658201+0000","last_clean":"2024-05-09T02:18:15.658201+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:15.658201+0000","last_undegraded":"2024-05-09T02:18:15.658201+0000","last_fullsized":"2024-05-09T02:18:15.658201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142480+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:15.142480+0000","last_peered":"2024-05-09T02:18:15.142480+0000","last_clean":"2024-05-09T02:18:15.142480+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:15.142480+0000","last_undegraded":"2024-05-09T02:18:15.142480+0000","last_fullsized":"2024-05-09T02:18:15.142480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.279990+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:15.279990+0000","last_peered":"2024-05-09T02:18:15.279990+0000","last_clean":"2024-05-09T02:18:15.279990+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:15.279990+0000","last_undegraded":"2024-05-09T02:18:15.279990+0000","last_fullsized":"2024-05-09T02:18:15.279990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657314+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:15.657314+0000","last_peered":"2024-05-09T02:18:15.657314+0000","last_clean":"2024-05-09T02:18:15.657314+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:15.657314+0000","last_undegraded":"2024-05-09T02:18:15.657314+0000","last_fullsized":"2024-05-09T02:18:15.657314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658114+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:15.658114+0000","last_peered":"2024-05-09T02:18:15.658114+0000","last_clean":"2024-05-09T02:18:15.658114+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:15.658114+0000","last_undegraded":"2024-05-09T02:18:15.658114+0000","last_fullsized":"2024-05-09T02:18:15.658114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657406+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:15.657406+0000","last_peered":"2024-05-09T02:18:15.657406+0000","last_clean":"2024-05-09T02:18:15.657406+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:15.657406+0000","last_undegraded":"2024-05-09T02:18:15.657406+0000","last_fullsized":"2024-05-09T02:18:15.657406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144238+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:15.144238+0000","last_peered":"2024-05-09T02:18:15.144238+0000","last_clean":"2024-05-09T02:18:15.144238+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:15.144238+0000","last_undegraded":"2024-05-09T02:18:15.144238+0000","last_fullsized":"2024-05-09T02:18:15.144238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270158+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:15.270158+0000","last_peered":"2024-05-09T02:18:15.270158+0000","last_clean":"2024-05-09T02:18:15.270158+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:15.270158+0000","last_undegraded":"2024-05-09T02:18:15.270158+0000","last_fullsized":"2024-05-09T02:18:15.270158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142558+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:15.142558+0000","last_peered":"2024-05-09T02:18:15.142558+0000","last_clean":"2024-05-09T02:18:15.142558+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:15.142558+0000","last_undegraded":"2024-05-09T02:18:15.142558+0000","last_fullsized":"2024-05-09T02:18:15.142558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657514+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:15.657514+0000","last_peered":"2024-05-09T02:18:15.657514+0000","last_clean":"2024-05-09T02:18:15.657514+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:15.657514+0000","last_undegraded":"2024-05-09T02:18:15.657514+0000","last_fullsized":"2024-05-09T02:18:15.657514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657903+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:15.657903+0000","last_peered":"2024-05-09T02:18:15.657903+0000","last_clean":"2024-05-09T02:18:15.657903+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:15.657903+0000","last_undegraded":"2024-05-09T02:18:15.657903+0000","last_fullsized":"2024-05-09T02:18:15.657903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657420+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:15.657420+0000","last_peered":"2024-05-09T02:18:15.657420+0000","last_clean":"2024-05-09T02:18:15.657420+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:15.657420+0000","last_undegraded":"2024-05-09T02:18:15.657420+0000","last_fullsized":"2024-05-09T02:18:15.657420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658367+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:15.658367+0000","last_peered":"2024-05-09T02:18:15.658367+0000","last_clean":"2024-05-09T02:18:15.658367+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:15.658367+0000","last_undegraded":"2024-05-09T02:18:15.658367+0000","last_fullsized":"2024-05-09T02:18:15.658367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270269+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:15.270269+0000","last_peered":"2024-05-09T02:18:15.270269+0000","last_clean":"2024-05-09T02:18:15.270269+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:15.270269+0000","last_undegraded":"2024-05-09T02:18:15.270269+0000","last_fullsized":"2024-05-09T02:18:15.270269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280262+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:15.280262+0000","last_peered":"2024-05-09T02:18:15.280262+0000","last_clean":"2024-05-09T02:18:15.280262+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:15.280262+0000","last_undegraded":"2024-05-09T02:18:15.280262+0000","last_fullsized":"2024-05-09T02:18:15.280262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658337+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:15.658337+0000","last_peered":"2024-05-09T02:18:15.658337+0000","last_clean":"2024-05-09T02:18:15.658337+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:15.658337+0000","last_undegraded":"2024-05-09T02:18:15.658337+0000","last_fullsized":"2024-05-09T02:18:15.658337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142760+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:15.142760+0000","last_peered":"2024-05-09T02:18:15.142760+0000","last_clean":"2024-05-09T02:18:15.142760+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:15.142760+0000","last_undegraded":"2024-05-09T02:18:15.142760+0000","last_fullsized":"2024-05-09T02:18:15.142760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657924+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:15.657924+0000","last_peered":"2024-05-09T02:18:15.657924+0000","last_clean":"2024-05-09T02:18:15.657924+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:15.657924+0000","last_undegraded":"2024-05-09T02:18:15.657924+0000","last_fullsized":"2024-05-09T02:18:15.657924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657258+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:15.657258+0000","last_peered":"2024-05-09T02:18:15.657258+0000","last_clean":"2024-05-09T02:18:15.657258+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:15.657258+0000","last_undegraded":"2024-05-09T02:18:15.657258+0000","last_fullsized":"2024-05-09T02:18:15.657258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270008+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:15.270008+0000","last_peered":"2024-05-09T02:18:15.270008+0000","last_clean":"2024-05-09T02:18:15.270008+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:15.270008+0000","last_undegraded":"2024-05-09T02:18:15.270008+0000","last_fullsized":"2024-05-09T02:18:15.270008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143326+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:15.143326+0000","last_peered":"2024-05-09T02:18:15.143326+0000","last_clean":"2024-05-09T02:18:15.143326+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:15.143326+0000","last_undegraded":"2024-05-09T02:18:15.143326+0000","last_fullsized":"2024-05-09T02:18:15.143326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658346+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:15.658346+0000","last_peered":"2024-05-09T02:18:15.658346+0000","last_clean":"2024-05-09T02:18:15.658346+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:15.658346+0000","last_undegraded":"2024-05-09T02:18:15.658346+0000","last_fullsized":"2024-05-09T02:18:15.658346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142909+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:15.142909+0000","last_peered":"2024-05-09T02:18:15.142909+0000","last_clean":"2024-05-09T02:18:15.142909+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:15.142909+0000","last_undegraded":"2024-05-09T02:18:15.142909+0000","last_fullsized":"2024-05-09T02:18:15.142909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269783+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:15.269783+0000","last_peered":"2024-05-09T02:18:15.269783+0000","last_clean":"2024-05-09T02:18:15.269783+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:15.269783+0000","last_undegraded":"2024-05-09T02:18:15.269783+0000","last_fullsized":"2024-05-09T02:18:15.269783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657832+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:15.657832+0000","last_peered":"2024-05-09T02:18:15.657832+0000","last_clean":"2024-05-09T02:18:15.657832+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:15.657832+0000","last_undegraded":"2024-05-09T02:18:15.657832+0000","last_fullsized":"2024-05-09T02:18:15.657832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657791+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:15.657791+0000","last_peered":"2024-05-09T02:18:15.657791+0000","last_clean":"2024-05-09T02:18:15.657791+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:15.657791+0000","last_undegraded":"2024-05-09T02:18:15.657791+0000","last_fullsized":"2024-05-09T02:18:15.657791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657493+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:15.657493+0000","last_peered":"2024-05-09T02:18:15.657493+0000","last_clean":"2024-05-09T02:18:15.657493+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:15.657493+0000","last_undegraded":"2024-05-09T02:18:15.657493+0000","last_fullsized":"2024-05-09T02:18:15.657493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.279966+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:15.279966+0000","last_peered":"2024-05-09T02:18:15.279966+0000","last_clean":"2024-05-09T02:18:15.279966+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:15.279966+0000","last_undegraded":"2024-05-09T02:18:15.279966+0000","last_fullsized":"2024-05-09T02:18:15.279966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270099+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:15.270099+0000","last_peered":"2024-05-09T02:18:15.270099+0000","last_clean":"2024-05-09T02:18:15.270099+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:15.270099+0000","last_undegraded":"2024-05-09T02:18:15.270099+0000","last_fullsized":"2024-05-09T02:18:15.270099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657843+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:15.657843+0000","last_peered":"2024-05-09T02:18:15.657843+0000","last_clean":"2024-05-09T02:18:15.657843+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:15.657843+0000","last_undegraded":"2024-05-09T02:18:15.657843+0000","last_fullsized":"2024-05-09T02:18:15.657843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657840+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:15.657840+0000","last_peered":"2024-05-09T02:18:15.657840+0000","last_clean":"2024-05-09T02:18:15.657840+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:15.657840+0000","last_undegraded":"2024-05-09T02:18:15.657840+0000","last_fullsized":"2024-05-09T02:18:15.657840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142963+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:15.142963+0000","last_peered":"2024-05-09T02:18:15.142963+0000","last_clean":"2024-05-09T02:18:15.142963+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:15.142963+0000","last_undegraded":"2024-05-09T02:18:15.142963+0000","last_fullsized":"2024-05-09T02:18:15.142963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280035+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:15.280035+0000","last_peered":"2024-05-09T02:18:15.280035+0000","last_clean":"2024-05-09T02:18:15.280035+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:15.280035+0000","last_undegraded":"2024-05-09T02:18:15.280035+0000","last_fullsized":"2024-05-09T02:18:15.280035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143838+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:15.143838+0000","last_peered":"2024-05-09T02:18:15.143838+0000","last_clean":"2024-05-09T02:18:15.143838+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:15.143838+0000","last_undegraded":"2024-05-09T02:18:15.143838+0000","last_fullsized":"2024-05-09T02:18:15.143838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270081+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:15.270081+0000","last_peered":"2024-05-09T02:18:15.270081+0000","last_clean":"2024-05-09T02:18:15.270081+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:15.270081+0000","last_undegraded":"2024-05-09T02:18:15.270081+0000","last_fullsized":"2024-05-09T02:18:15.270081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143242+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:15.143242+0000","last_peered":"2024-05-09T02:18:15.143242+0000","last_clean":"2024-05-09T02:18:15.143242+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:15.143242+0000","last_undegraded":"2024-05-09T02:18:15.143242+0000","last_fullsized":"2024-05-09T02:18:15.143242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142862+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:15.142862+0000","last_peered":"2024-05-09T02:18:15.142862+0000","last_clean":"2024-05-09T02:18:15.142862+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:15.142862+0000","last_undegraded":"2024-05-09T02:18:15.142862+0000","last_fullsized":"2024-05-09T02:18:15.142862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142659+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:15.142659+0000","last_peered":"2024-05-09T02:18:15.142659+0000","last_clean":"2024-05-09T02:18:15.142659+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:15.142659+0000","last_undegraded":"2024-05-09T02:18:15.142659+0000","last_fullsized":"2024-05-09T02:18:15.142659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657779+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:15.657779+0000","last_peered":"2024-05-09T02:18:15.657779+0000","last_clean":"2024-05-09T02:18:15.657779+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:15.657779+0000","last_undegraded":"2024-05-09T02:18:15.657779+0000","last_fullsized":"2024-05-09T02:18:15.657779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143686+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:15.143686+0000","last_peered":"2024-05-09T02:18:15.143686+0000","last_clean":"2024-05-09T02:18:15.143686+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:15.143686+0000","last_undegraded":"2024-05-09T02:18:15.143686+0000","last_fullsized":"2024-05-09T02:18:15.143686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269753+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:15.269753+0000","last_peered":"2024-05-09T02:18:15.269753+0000","last_clean":"2024-05-09T02:18:15.269753+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:15.269753+0000","last_undegraded":"2024-05-09T02:18:15.269753+0000","last_fullsized":"2024-05-09T02:18:15.269753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269880+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:15.269880+0000","last_peered":"2024-05-09T02:18:15.269880+0000","last_clean":"2024-05-09T02:18:15.269880+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:15.269880+0000","last_undegraded":"2024-05-09T02:18:15.269880+0000","last_fullsized":"2024-05-09T02:18:15.269880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657117+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:15.657117+0000","last_peered":"2024-05-09T02:18:15.657117+0000","last_clean":"2024-05-09T02:18:15.657117+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:15.657117+0000","last_undegraded":"2024-05-09T02:18:15.657117+0000","last_fullsized":"2024-05-09T02:18:15.657117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143502+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:15.143502+0000","last_peered":"2024-05-09T02:18:15.143502+0000","last_clean":"2024-05-09T02:18:15.143502+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:15.143502+0000","last_undegraded":"2024-05-09T02:18:15.143502+0000","last_fullsized":"2024-05-09T02:18:15.143502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144031+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:15.144031+0000","last_peered":"2024-05-09T02:18:15.144031+0000","last_clean":"2024-05-09T02:18:15.144031+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:15.144031+0000","last_undegraded":"2024-05-09T02:18:15.144031+0000","last_fullsized":"2024-05-09T02:18:15.144031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144507+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:15.144507+0000","last_peered":"2024-05-09T02:18:15.144507+0000","last_clean":"2024-05-09T02:18:15.144507+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:15.144507+0000","last_undegraded":"2024-05-09T02:18:15.144507+0000","last_fullsized":"2024-05-09T02:18:15.144507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657370+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:15.657370+0000","last_peered":"2024-05-09T02:18:15.657370+0000","last_clean":"2024-05-09T02:18:15.657370+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:15.657370+0000","last_undegraded":"2024-05-09T02:18:15.657370+0000","last_fullsized":"2024-05-09T02:18:15.657370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144765+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:15.144765+0000","last_peered":"2024-05-09T02:18:15.144765+0000","last_clean":"2024-05-09T02:18:15.144765+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:15.144765+0000","last_undegraded":"2024-05-09T02:18:15.144765+0000","last_fullsized":"2024-05-09T02:18:15.144765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280165+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:15.280165+0000","last_peered":"2024-05-09T02:18:15.280165+0000","last_clean":"2024-05-09T02:18:15.280165+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:15.280165+0000","last_undegraded":"2024-05-09T02:18:15.280165+0000","last_fullsized":"2024-05-09T02:18:15.280165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658016+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:15.658016+0000","last_peered":"2024-05-09T02:18:15.658016+0000","last_clean":"2024-05-09T02:18:15.658016+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:15.658016+0000","last_undegraded":"2024-05-09T02:18:15.658016+0000","last_fullsized":"2024-05-09T02:18:15.658016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657311+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:15.657311+0000","last_peered":"2024-05-09T02:18:15.657311+0000","last_clean":"2024-05-09T02:18:15.657311+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:15.657311+0000","last_undegraded":"2024-05-09T02:18:15.657311+0000","last_fullsized":"2024-05-09T02:18:15.657311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143459+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:15.143459+0000","last_peered":"2024-05-09T02:18:15.143459+0000","last_clean":"2024-05-09T02:18:15.143459+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:15.143459+0000","last_undegraded":"2024-05-09T02:18:15.143459+0000","last_fullsized":"2024-05-09T02:18:15.143459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144038+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:15.144038+0000","last_peered":"2024-05-09T02:18:15.144038+0000","last_clean":"2024-05-09T02:18:15.144038+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:15.144038+0000","last_undegraded":"2024-05-09T02:18:15.144038+0000","last_fullsized":"2024-05-09T02:18:15.144038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657405+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:15.657405+0000","last_peered":"2024-05-09T02:18:15.657405+0000","last_clean":"2024-05-09T02:18:15.657405+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:15.657405+0000","last_undegraded":"2024-05-09T02:18:15.657405+0000","last_fullsized":"2024-05-09T02:18:15.657405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658066+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:15.658066+0000","last_peered":"2024-05-09T02:18:15.658066+0000","last_clean":"2024-05-09T02:18:15.658066+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:15.658066+0000","last_undegraded":"2024-05-09T02:18:15.658066+0000","last_fullsized":"2024-05-09T02:18:15.658066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143969+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:15.143969+0000","last_peered":"2024-05-09T02:18:15.143969+0000","last_clean":"2024-05-09T02:18:15.143969+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:15.143969+0000","last_undegraded":"2024-05-09T02:18:15.143969+0000","last_fullsized":"2024-05-09T02:18:15.143969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142466+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:15.142466+0000","last_peered":"2024-05-09T02:18:15.142466+0000","last_clean":"2024-05-09T02:18:15.142466+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:15.142466+0000","last_undegraded":"2024-05-09T02:18:15.142466+0000","last_fullsized":"2024-05-09T02:18:15.142466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657236+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:15.657236+0000","last_peered":"2024-05-09T02:18:15.657236+0000","last_clean":"2024-05-09T02:18:15.657236+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:15.657236+0000","last_undegraded":"2024-05-09T02:18:15.657236+0000","last_fullsized":"2024-05-09T02:18:15.657236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.279988+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:15.279988+0000","last_peered":"2024-05-09T02:18:15.279988+0000","last_clean":"2024-05-09T02:18:15.279988+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:15.279988+0000","last_undegraded":"2024-05-09T02:18:15.279988+0000","last_fullsized":"2024-05-09T02:18:15.279988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658036+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:15.658036+0000","last_peered":"2024-05-09T02:18:15.658036+0000","last_clean":"2024-05-09T02:18:15.658036+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:15.658036+0000","last_undegraded":"2024-05-09T02:18:15.658036+0000","last_fullsized":"2024-05-09T02:18:15.658036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143334+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:15.143334+0000","last_peered":"2024-05-09T02:18:15.143334+0000","last_clean":"2024-05-09T02:18:15.143334+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:15.143334+0000","last_undegraded":"2024-05-09T02:18:15.143334+0000","last_fullsized":"2024-05-09T02:18:15.143334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280104+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:15.280104+0000","last_peered":"2024-05-09T02:18:15.280104+0000","last_clean":"2024-05-09T02:18:15.280104+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:15.280104+0000","last_undegraded":"2024-05-09T02:18:15.280104+0000","last_fullsized":"2024-05-09T02:18:15.280104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657969+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:15.657969+0000","last_peered":"2024-05-09T02:18:15.657969+0000","last_clean":"2024-05-09T02:18:15.657969+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:15.657969+0000","last_undegraded":"2024-05-09T02:18:15.657969+0000","last_fullsized":"2024-05-09T02:18:15.657969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144353+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:15.144353+0000","last_peered":"2024-05-09T02:18:15.144353+0000","last_clean":"2024-05-09T02:18:15.144353+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:15.144353+0000","last_undegraded":"2024-05-09T02:18:15.144353+0000","last_fullsized":"2024-05-09T02:18:15.144353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280133+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:15.280133+0000","last_peered":"2024-05-09T02:18:15.280133+0000","last_clean":"2024-05-09T02:18:15.280133+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:15.280133+0000","last_undegraded":"2024-05-09T02:18:15.280133+0000","last_fullsized":"2024-05-09T02:18:15.280133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280200+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:15.280200+0000","last_peered":"2024-05-09T02:18:15.280200+0000","last_clean":"2024-05-09T02:18:15.280200+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:15.280200+0000","last_undegraded":"2024-05-09T02:18:15.280200+0000","last_fullsized":"2024-05-09T02:18:15.280200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658375+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:15.658375+0000","last_peered":"2024-05-09T02:18:15.658375+0000","last_clean":"2024-05-09T02:18:15.658375+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:15.658375+0000","last_undegraded":"2024-05-09T02:18:15.658375+0000","last_fullsized":"2024-05-09T02:18:15.658375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.270143+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:15.270143+0000","last_peered":"2024-05-09T02:18:15.270143+0000","last_clean":"2024-05-09T02:18:15.270143+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:15.270143+0000","last_undegraded":"2024-05-09T02:18:15.270143+0000","last_fullsized":"2024-05-09T02:18:15.270143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142756+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:15.142756+0000","last_peered":"2024-05-09T02:18:15.142756+0000","last_clean":"2024-05-09T02:18:15.142756+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:15.142756+0000","last_undegraded":"2024-05-09T02:18:15.142756+0000","last_fullsized":"2024-05-09T02:18:15.142756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143783+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:15.143783+0000","last_peered":"2024-05-09T02:18:15.143783+0000","last_clean":"2024-05-09T02:18:15.143783+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:15.143783+0000","last_undegraded":"2024-05-09T02:18:15.143783+0000","last_fullsized":"2024-05-09T02:18:15.143783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144606+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:15.144606+0000","last_peered":"2024-05-09T02:18:15.144606+0000","last_clean":"2024-05-09T02:18:15.144606+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:15.144606+0000","last_undegraded":"2024-05-09T02:18:15.144606+0000","last_fullsized":"2024-05-09T02:18:15.144606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280093+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:15.280093+0000","last_peered":"2024-05-09T02:18:15.280093+0000","last_clean":"2024-05-09T02:18:15.280093+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:15.280093+0000","last_undegraded":"2024-05-09T02:18:15.280093+0000","last_fullsized":"2024-05-09T02:18:15.280093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657943+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:15.657943+0000","last_peered":"2024-05-09T02:18:15.657943+0000","last_clean":"2024-05-09T02:18:15.657943+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:15.657943+0000","last_undegraded":"2024-05-09T02:18:15.657943+0000","last_fullsized":"2024-05-09T02:18:15.657943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.280058+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:15.280058+0000","last_peered":"2024-05-09T02:18:15.280058+0000","last_clean":"2024-05-09T02:18:15.280058+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:15.280058+0000","last_undegraded":"2024-05-09T02:18:15.280058+0000","last_fullsized":"2024-05-09T02:18:15.280058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658279+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:15.658279+0000","last_peered":"2024-05-09T02:18:15.658279+0000","last_clean":"2024-05-09T02:18:15.658279+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:15.658279+0000","last_undegraded":"2024-05-09T02:18:15.658279+0000","last_fullsized":"2024-05-09T02:18:15.658279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143776+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:15.143776+0000","last_peered":"2024-05-09T02:18:15.143776+0000","last_clean":"2024-05-09T02:18:15.143776+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:15.143776+0000","last_undegraded":"2024-05-09T02:18:15.143776+0000","last_fullsized":"2024-05-09T02:18:15.143776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.269946+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:15.269946+0000","last_peered":"2024-05-09T02:18:15.269946+0000","last_clean":"2024-05-09T02:18:15.269946+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:15.269946+0000","last_undegraded":"2024-05-09T02:18:15.269946+0000","last_fullsized":"2024-05-09T02:18:15.269946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657941+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:15.657941+0000","last_peered":"2024-05-09T02:18:15.657941+0000","last_clean":"2024-05-09T02:18:15.657941+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:15.657941+0000","last_undegraded":"2024-05-09T02:18:15.657941+0000","last_fullsized":"2024-05-09T02:18:15.657941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.143320+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:15.143320+0000","last_peered":"2024-05-09T02:18:15.143320+0000","last_clean":"2024-05-09T02:18:15.143320+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:15.143320+0000","last_undegraded":"2024-05-09T02:18:15.143320+0000","last_fullsized":"2024-05-09T02:18:15.143320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.657721+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:15.657721+0000","last_peered":"2024-05-09T02:18:15.657721+0000","last_clean":"2024-05-09T02:18:15.657721+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:15.657721+0000","last_undegraded":"2024-05-09T02:18:15.657721+0000","last_fullsized":"2024-05-09T02:18:15.657721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.144001+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:15.144001+0000","last_peered":"2024-05-09T02:18:15.144001+0000","last_clean":"2024-05-09T02:18:15.144001+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:15.144001+0000","last_undegraded":"2024-05-09T02:18:15.144001+0000","last_fullsized":"2024-05-09T02:18:15.144001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142631+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:15.142631+0000","last_peered":"2024-05-09T02:18:15.142631+0000","last_clean":"2024-05-09T02:18:15.142631+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:15.142631+0000","last_undegraded":"2024-05-09T02:18:15.142631+0000","last_fullsized":"2024-05-09T02:18:15.142631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658401+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:15.658401+0000","last_peered":"2024-05-09T02:18:15.658401+0000","last_clean":"2024-05-09T02:18:15.658401+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:15.658401+0000","last_undegraded":"2024-05-09T02:18:15.658401+0000","last_fullsized":"2024-05-09T02:18:15.658401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.658390+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:15.658390+0000","last_peered":"2024-05-09T02:18:15.658390+0000","last_clean":"2024-05-09T02:18:15.658390+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:15.658390+0000","last_undegraded":"2024-05-09T02:18:15.658390+0000","last_fullsized":"2024-05-09T02:18:15.658390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T02:18:15.142916+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:15.142916+0000","last_peered":"2024-05-09T02:18:15.142916+0000","last_clean":"2024-05-09T02:18:15.142916+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:15.142916+0000","last_undegraded":"2024-05-09T02:18:15.142916+0000","last_fullsized":"2024-05-09T02:18:15.142916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":70862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":69250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:19.627 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T02:18:19.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T02:18:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.778+0000 7f27551e0640 1 Processor -- start 2024-05-09T02:18:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.778+0000 7f27551e0640 1 -- start start 2024-05-09T02:18:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f27551e0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2750155160 0x7f27500c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f27551e0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f275015b3a0 0x7f275015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f27551e0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2750158ae0 con 0x7f27500c84a0 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f27551e0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f2750155570 con 0x7f275015b3a0 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f27551e0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2750157ed0 con 0x7f2750155160 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274e59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f27500c84a0 0x7f27500c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38844/0 (socket says 172.21.15.46:38844) 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274e59c640 1 -- 172.21.15.46:0/18990000 learned_addr learned my addr 172.21.15.46:0/18990000 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274f59e640 1 --2- 172.21.15.46:0/18990000 >> v2:172.21.15.46:3300/0 conn(0x7f275015b3a0 0x7f275015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274ed9d640 1 --2- 172.21.15.46:0/18990000 >> v2:172.21.15.107:3300/0 conn(0x7f2750155160 0x7f27500c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274f59e640 1 -- 172.21.15.46:0/18990000 >> v2:172.21.15.107:3300/0 conn(0x7f2750155160 msgr2=0x7f27500c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274f59e640 1 --2- 172.21.15.46:0/18990000 >> v2:172.21.15.107:3300/0 conn(0x7f2750155160 0x7f27500c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274f59e640 1 -- 172.21.15.46:0/18990000 >> v1:172.21.15.46:6789/0 conn(0x7f27500c84a0 legacy=0x7f27500c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274dd9b640 1 -- 172.21.15.46:0/18990000 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809254477 0 0) 0x7f2750158ae0 con 0x7f27500c84a0 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274f59e640 1 -- 172.21.15.46:0/18990000 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27501581b0 con 0x7f275015b3a0 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.780+0000 7f274ed9d640 1 --2- 172.21.15.46:0/18990000 >> v2:172.21.15.107:3300/0 conn(0x7f2750155160 0x7f27500c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.781+0000 7f274f59e640 1 --2- 172.21.15.46:0/18990000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f275015b7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f275008e810 tx=0x7f274802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9133b365719028 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.781+0000 7f274dd9b640 1 -- 172.21.15.46:0/18990000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748037070 con 0x7f275015b3a0 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.781+0000 7f274dd9b640 1 -- 172.21.15.46:0/18990000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274802add0 con 0x7f275015b3a0 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.781+0000 7f274dd9b640 1 -- 172.21.15.46:0/18990000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748032660 con 0x7f275015b3a0 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 -- 172.21.15.46:0/18990000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 msgr2=0x7f275015b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 --2- 172.21.15.46:0/18990000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f275015b7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f275008e810 tx=0x7f274802a080 comp rx=0 tx=0).stop 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 -- 172.21.15.46:0/18990000 shutdown_connections 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 --2- 172.21.15.46:0/18990000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f275015b7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 --2- 172.21.15.46:0/18990000 >> v2:172.21.15.107:3300/0 conn(0x7f2750155160 0x7f27500c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 -- 172.21.15.46:0/18990000 >> 172.21.15.46:0/18990000 conn(0x7f27500aebe0 msgr2=0x7f27500aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 -- 172.21.15.46:0/18990000 shutdown_connections 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.782+0000 7f27551e0640 1 -- 172.21.15.46:0/18990000 wait complete. 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.784+0000 7f27551e0640 1 Processor -- start 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.784+0000 7f27551e0640 1 -- start start 2024-05-09T02:18:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f27551e0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27500c84a0 0x7f27500c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f27551e0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2750155160 0x7f2750153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f27551e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f27500b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f27551e0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2750157b30 con 0x7f275015b3a0 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f27551e0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2750158770 con 0x7f27500c84a0 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f27551e0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2750157cb0 con 0x7f2750155160 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f27500b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f27500b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44958/0 (socket says 172.21.15.46:44958) 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 -- 172.21.15.46:0/2723086118 learned_addr learned my addr 172.21.15.46:0/2723086118 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274e59c640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2750155160 0x7f2750153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274ed9d640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27500c84a0 0x7f27500c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 -- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2750155160 msgr2=0x7f2750153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2750155160 0x7f2750153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 -- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27500c84a0 msgr2=0x7f27500c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27500c84a0 0x7f27500c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274f59e640 1 -- 172.21.15.46:0/2723086118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500c3c70 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.785+0000 7f274ed9d640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27500c84a0 0x7f27500c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.786+0000 7f274f59e640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f27500b1ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2748009890 tx=0x7f27480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.786+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748037040 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.786+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2748042070 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.786+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27500c3f50 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.786+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274803b650 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.786+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275014e7d0 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.787+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27500c7670 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.788+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f274803b7f0 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.788+0000 7f27477fe640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f27300762d0 0x7f27300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.788+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f27480b7ca0 con 0x7f275015b3a0 2024-05-09T02:18:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.788+0000 7f274ed9d640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f27300762d0 0x7f27300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:19.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.789+0000 7f274ed9d640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f27300762d0 0x7f27300787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f275008e7e0 tx=0x7f2740007a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:19.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.793+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f27500c7670 con 0x7f275015b3a0 2024-05-09T02:18:19.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.984+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f275006a330 con 0x7f275015b3a0 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.984+0000 7f27477fe640 1 -- 172.21.15.46:0/2723086118 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) ==== 84+0+197 (secure 0 0 0) 0x7f2748081620 con 0x7f275015b3a0 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2024-05-09T02:18:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "a_metadata" 2024-05-09T02:18:19.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T02:18:19.990 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-05-09T02:18:19.990 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 3, 2024-05-09T02:18:19.990 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "a_data" 2024-05-09T02:18:19.990 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T02:18:19.990 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f27300762d0 msgr2=0x7f27300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f27300762d0 0x7f27300787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f275008e7e0 tx=0x7f2740007a30 comp rx=0 tx=0).stop 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 msgr2=0x7f27500b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f27500b1ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2748009890 tx=0x7f27480046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 shutdown_connections 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f27300762d0 0x7f27300787e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275015b3a0 0x7f27500b1ed0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2750155160 0x7f2750153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 --2- 172.21.15.46:0/2723086118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27500c84a0 0x7f27500c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:19.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.986+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 >> 172.21.15.46:0/2723086118 conn(0x7f27500aebe0 msgr2=0x7f275015b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:19.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.987+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 shutdown_connections 2024-05-09T02:18:19.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:19.987+0000 7f27551e0640 1 -- 172.21.15.46:0/2723086118 wait complete. 2024-05-09T02:18:20.001 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-05-09T02:18:20.001 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-05-09T02:18:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.121+0000 7fe6252b1640 1 Processor -- start 2024-05-09T02:18:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.121+0000 7fe6252b1640 1 -- start start 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe6252b1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6200c9b00 0x7fe62015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe6252b1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe62015b4f0 0x7fe62015b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe6252b1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62015be40 con 0x7fe6200c6e00 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe6252b1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe620158570 con 0x7fe6200c9b00 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe6252b1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe620158850 con 0x7fe62015b4f0 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6200c9b00 0x7fe62015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6200c9b00 0x7fe62015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44970/0 (socket says 172.21.15.46:44970) 2024-05-09T02:18:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 -- 172.21.15.46:0/2675631739 learned_addr learned my addr 172.21.15.46:0/2675631739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61f7fe640 1 --2- 172.21.15.46:0/2675631739 >> v2:172.21.15.107:3300/0 conn(0x7fe62015b4f0 0x7fe62015b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 -- 172.21.15.46:0/2675631739 >> v2:172.21.15.107:3300/0 conn(0x7fe62015b4f0 msgr2=0x7fe62015b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 --2- 172.21.15.46:0/2675631739 >> v2:172.21.15.107:3300/0 conn(0x7fe62015b4f0 0x7fe62015b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 -- 172.21.15.46:0/2675631739 >> v1:172.21.15.107:6789/0 conn(0x7fe6200c6e00 legacy=0x7fe6200c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.123+0000 7fe61e7fc640 1 -- 172.21.15.46:0/2675631739 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6200c20f0 con 0x7fe6200c9b00 2024-05-09T02:18:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.124+0000 7fe61e7fc640 1 --2- 172.21.15.46:0/2675631739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c9b00 0x7fe62015afb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe62006d5d0 tx=0x7fe60802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc0e666e5acb14a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.124+0000 7fe61dffb640 1 -- 172.21.15.46:0/2675631739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608037070 con 0x7fe6200c9b00 2024-05-09T02:18:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.124+0000 7fe61dffb640 1 -- 172.21.15.46:0/2675631739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe608032440 con 0x7fe6200c9b00 2024-05-09T02:18:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.124+0000 7fe61dffb640 1 -- 172.21.15.46:0/2675631739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608032810 con 0x7fe6200c9b00 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 -- 172.21.15.46:0/2675631739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c9b00 msgr2=0x7fe62015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 --2- 172.21.15.46:0/2675631739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c9b00 0x7fe62015afb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe62006d5d0 tx=0x7fe60802a150 comp rx=0 tx=0).stop 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 -- 172.21.15.46:0/2675631739 shutdown_connections 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 --2- 172.21.15.46:0/2675631739 >> v2:172.21.15.107:3300/0 conn(0x7fe62015b4f0 0x7fe62015b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 --2- 172.21.15.46:0/2675631739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c9b00 0x7fe62015afb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 -- 172.21.15.46:0/2675631739 >> 172.21.15.46:0/2675631739 conn(0x7fe62006e9b0 msgr2=0x7fe62006edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 -- 172.21.15.46:0/2675631739 shutdown_connections 2024-05-09T02:18:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.125+0000 7fe6252b1640 1 -- 172.21.15.46:0/2675631739 wait complete. 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.127+0000 7fe6252b1640 1 Processor -- start 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.127+0000 7fe6252b1640 1 -- start start 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe6252b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 0x7fe62014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe6252b1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6200c9b00 0x7fe6201563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe6252b1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62015b4f0 0x7fe6201f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe6252b1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe6200ca090 con 0x7fe6200c6e00 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe6252b1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6200c9f10 con 0x7fe62015b4f0 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe6252b1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe620155240 con 0x7fe6200c9b00 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 0x7fe62014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 0x7fe62014e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44984/0 (socket says 172.21.15.46:44984) 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 -- 172.21.15.46:0/3626498840 learned_addr learned my addr 172.21.15.46:0/3626498840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61e7fc640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6200c9b00 0x7fe6201563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61f7fe640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62015b4f0 0x7fe6201f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 -- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6200c9b00 msgr2=0x7fe6201563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6200c9b00 0x7fe6201563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 -- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62015b4f0 msgr2=0x7fe6201f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62015b4f0 0x7fe6201f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 -- 172.21.15.46:0/3626498840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6201f1870 con 0x7fe6200c6e00 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.128+0000 7fe61effd640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 0x7fe62014e3a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c6f0 tx=0x7fe61800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.129+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618003970 con 0x7fe6200c6e00 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.129+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe618003b10 con 0x7fe6200c6e00 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.129+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6201f1b10 con 0x7fe6200c6e00 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.129+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61800a850 con 0x7fe6200c6e00 2024-05-09T02:18:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.129+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6201e1690 con 0x7fe6200c6e00 2024-05-09T02:18:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.130+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62006a3a0 con 0x7fe6200c6e00 2024-05-09T02:18:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.130+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe61800a9f0 con 0x7fe6200c6e00 2024-05-09T02:18:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.131+0000 7fe6177fe640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe6000762d0 0x7fe6000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.131+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fe618097480 con 0x7fe6200c6e00 2024-05-09T02:18:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.131+0000 7fe61e7fc640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe6000762d0 0x7fe6000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.132+0000 7fe61e7fc640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe6000762d0 0x7fe6000787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe608034000 tx=0x7fe60802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.136+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe618060df0 con 0x7fe6200c6e00 2024-05-09T02:18:20.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:20.327+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7fe6200c1ed0 con 0x7fe6200c6e00 2024-05-09T02:18:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.172+0000 7fe6177fe640 1 -- 172.21.15.46:0/3626498840 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v22) ==== 128+0+0 (secure 0 0 0) 0x7fe6180606f0 con 0x7fe6200c6e00 2024-05-09T02:18:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'b_metadata' created 2024-05-09T02:18:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.177+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe6000762d0 msgr2=0x7fe6000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.177+0000 7fe6252b1640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe6000762d0 0x7fe6000787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe608034000 tx=0x7fe60802e000 comp rx=0 tx=0).stop 2024-05-09T02:18:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.177+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 msgr2=0x7fe62014e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.177+0000 7fe6252b1640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 0x7fe62014e3a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c6f0 tx=0x7fe61800cbb0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 shutdown_connections 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe6000762d0 0x7fe6000787e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62015b4f0 0x7fe6201f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6200c9b00 0x7fe6201563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 --2- 172.21.15.46:0/3626498840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6200c6e00 0x7fe62014e3a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 >> 172.21.15.46:0/3626498840 conn(0x7fe62006e9b0 msgr2=0x7fe6200c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 shutdown_connections 2024-05-09T02:18:21.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.178+0000 7fe6252b1640 1 -- 172.21.15.46:0/3626498840 wait complete. 2024-05-09T02:18:21.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.324+0000 7f563cad9640 1 Processor -- start 2024-05-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.324+0000 7f563cad9640 1 -- start start 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.325+0000 7f563cad9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56380c2fd0 0x7f56380c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.325+0000 7f563cad9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56380c7d60 0x7f56380c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.325+0000 7f563cad9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56380c1f60 con 0x7f5638158490 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f563cad9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f56380c4470 con 0x7f56380c2fd0 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f563cad9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f56380c3990 con 0x7f56380c7d60 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5635d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56380c2fd0 0x7f56380c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f563659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5638158490 0x7f5638140b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38848/0 (socket says 172.21.15.46:38848) 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5635d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56380c2fd0 0x7f56380c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44992/0 (socket says 172.21.15.46:44992) 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f563659c640 1 -- 172.21.15.46:0/3028962827 learned_addr learned my addr 172.21.15.46:0/3028962827 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5636d9d640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56380c7d60 0x7f56380c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5635d9b640 1 -- 172.21.15.46:0/3028962827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56380c7d60 msgr2=0x7f56380c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5635d9b640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56380c7d60 0x7f56380c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5635d9b640 1 -- 172.21.15.46:0/3028962827 >> v1:172.21.15.46:6789/0 conn(0x7f5638158490 legacy=0x7f5638140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5635d9b640 1 -- 172.21.15.46:0/3028962827 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56380c2210 con 0x7f56380c2fd0 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f563559a640 1 -- 172.21.15.46:0/3028962827 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811426788 0 0) 0x7f56380c1f60 con 0x7f5638158490 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.326+0000 7f5636d9d640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56380c7d60 0x7f56380c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.327+0000 7f5635d9b640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f56380c7820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f56200097a0 tx=0x7f562002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd858b9ebf12298 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.327+0000 7f563559a640 1 -- 172.21.15.46:0/3028962827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620037070 con 0x7f56380c2fd0 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.327+0000 7f563559a640 1 -- 172.21.15.46:0/3028962827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620032440 con 0x7f56380c2fd0 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.327+0000 7f563559a640 1 -- 172.21.15.46:0/3028962827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620032810 con 0x7f56380c2fd0 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 -- 172.21.15.46:0/3028962827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 msgr2=0x7f56380c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f56380c7820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f56200097a0 tx=0x7f562002a180 comp rx=0 tx=0).stop 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 -- 172.21.15.46:0/3028962827 shutdown_connections 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f56380c7d60 0x7f56380c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 --2- 172.21.15.46:0/3028962827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f56380c7820 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 -- 172.21.15.46:0/3028962827 >> 172.21.15.46:0/3028962827 conn(0x7f563806e630 msgr2=0x7f5638068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 -- 172.21.15.46:0/3028962827 shutdown_connections 2024-05-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.328+0000 7f563cad9640 1 -- 172.21.15.46:0/3028962827 wait complete. 2024-05-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.330+0000 7f563cad9640 1 Processor -- start 2024-05-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.330+0000 7f563cad9640 1 -- start start 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563cad9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f5638157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563cad9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56380c7d60 0x7f563815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563cad9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5638158490 0x7f5638155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563cad9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f56381588a0 con 0x7f56380c2fd0 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563cad9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f56380c27d0 con 0x7f56380c7d60 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563cad9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f56380c9df0 con 0x7f5638158490 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f5638157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f5638157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45006/0 (socket says 172.21.15.46:45006) 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 -- 172.21.15.46:0/3270352254 learned_addr learned my addr 172.21.15.46:0/3270352254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f5636d9d640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5638158490 0x7f5638155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f5635d9b640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56380c7d60 0x7f563815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 -- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5638158490 msgr2=0x7f5638155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5638158490 0x7f5638155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 -- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56380c7d60 msgr2=0x7f563815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56380c7d60 0x7f563815b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 -- 172.21.15.46:0/3270352254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56381ed6a0 con 0x7f56380c2fd0 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f5635d9b640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56380c7d60 0x7f563815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.331+0000 7f563659c640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f5638157ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f563000c3f0 tx=0x7f563000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.332+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300074e0 con 0x7f56380c2fd0 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.332+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56300047e0 con 0x7f56380c2fd0 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.332+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56381ed980 con 0x7f56380c2fd0 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.332+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630004bd0 con 0x7f56380c2fd0 2024-05-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.332+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56381edf40 con 0x7f56380c2fd0 2024-05-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.333+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563806a330 con 0x7f56380c2fd0 2024-05-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.333+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5630011070 con 0x7f56380c2fd0 2024-05-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.334+0000 7f562effd640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f56180762d0 0x7f56180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.334+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6054+0+0 (secure 0 0 0) 0x7f5630097390 con 0x7f56380c2fd0 2024-05-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.334+0000 7f5635d9b640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f56180762d0 0x7f56180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.335+0000 7f5635d9b640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f56180762d0 0x7f56180787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5620034000 tx=0x7f562002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.339+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5630060b80 con 0x7f56380c2fd0 2024-05-09T02:18:21.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:21.529+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f56380c9bd0 con 0x7f56380c2fd0 2024-05-09T02:18:22.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.175+0000 7f562effd640 1 -- 172.21.15.46:0/3270352254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v23) ==== 160+0+0 (secure 0 0 0) 0x7f5630060480 con 0x7f56380c2fd0 2024-05-09T02:18:22.178 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'b_data' created 2024-05-09T02:18:22.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f56180762d0 msgr2=0x7f56180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:22.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f56180762d0 0x7f56180787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5620034000 tx=0x7f562002e000 comp rx=0 tx=0).stop 2024-05-09T02:18:22.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 msgr2=0x7f5638157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:22.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f5638157ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f563000c3f0 tx=0x7f563000c8b0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 shutdown_connections 2024-05-09T02:18:22.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f56180762d0 0x7f56180787e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5638158490 0x7f5638155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56380c7d60 0x7f563815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 --2- 172.21.15.46:0/3270352254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56380c2fd0 0x7f5638157ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.179+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 >> 172.21.15.46:0/3270352254 conn(0x7f563806e630 msgr2=0x7f563813fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:22.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.182+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 shutdown_connections 2024-05-09T02:18:22.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.184+0000 7f563cad9640 1 -- 172.21.15.46:0/3270352254 wait complete. 2024-05-09T02:18:22.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-05-09T02:18:22.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.327+0000 7f8c4cd84640 1 Processor -- start 2024-05-09T02:18:22.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.327+0000 7f8c4cd84640 1 -- start start 2024-05-09T02:18:22.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c4cd84640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c480c5f90 0x7f8c480c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:22.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c4cd84640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c48070e80 0x7f8c4815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:22.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c4cd84640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c48071290 con 0x7f8c48070a70 2024-05-09T02:18:22.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c4cd84640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f8c48157b40 con 0x7f8c48070e80 2024-05-09T02:18:22.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c4cd84640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8c48157e20 con 0x7f8c480c5f90 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c46d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c48070e80 0x7f8c4815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c46d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c48070e80 0x7f8c4815b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45008/0 (socket says 172.21.15.46:45008) 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c46d9d640 1 -- 172.21.15.46:0/783350163 learned_addr learned my addr 172.21.15.46:0/783350163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c4659c640 1 --2- 172.21.15.46:0/783350163 >> v2:172.21.15.107:3300/0 conn(0x7f8c480c5f90 0x7f8c480c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c46d9d640 1 -- 172.21.15.46:0/783350163 >> v2:172.21.15.107:3300/0 conn(0x7f8c480c5f90 msgr2=0x7f8c480c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c46d9d640 1 --2- 172.21.15.46:0/783350163 >> v2:172.21.15.107:3300/0 conn(0x7f8c480c5f90 0x7f8c480c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.328+0000 7f8c46d9d640 1 -- 172.21.15.46:0/783350163 >> v1:172.21.15.107:6789/0 conn(0x7f8c48070a70 legacy=0x7f8c4815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.329+0000 7f8c46d9d640 1 -- 172.21.15.46:0/783350163 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48158100 con 0x7f8c48070e80 2024-05-09T02:18:22.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.329+0000 7f8c46d9d640 1 --2- 172.21.15.46:0/783350163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070e80 0x7f8c4815b7c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c48073570 tx=0x7f8c4002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0c13c2099dd0c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:22.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.329+0000 7f8c45d9b640 1 -- 172.21.15.46:0/783350163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40036070 con 0x7f8c48070e80 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.329+0000 7f8c45d9b640 1 -- 172.21.15.46:0/783350163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c40031600 con 0x7f8c48070e80 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.329+0000 7f8c45d9b640 1 -- 172.21.15.46:0/783350163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c400319d0 con 0x7f8c48070e80 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 -- 172.21.15.46:0/783350163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070e80 msgr2=0x7f8c4815b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/783350163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070e80 0x7f8c4815b7c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c48073570 tx=0x7f8c4002a570 comp rx=0 tx=0).stop 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 -- 172.21.15.46:0/783350163 shutdown_connections 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/783350163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070e80 0x7f8c4815b7c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/783350163 >> v2:172.21.15.107:3300/0 conn(0x7f8c480c5f90 0x7f8c480c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 -- 172.21.15.46:0/783350163 >> 172.21.15.46:0/783350163 conn(0x7f8c480c9e50 msgr2=0x7f8c480ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 -- 172.21.15.46:0/783350163 shutdown_connections 2024-05-09T02:18:22.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.330+0000 7f8c4cd84640 1 -- 172.21.15.46:0/783350163 wait complete. 2024-05-09T02:18:22.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.332+0000 7f8c4cd84640 1 Processor -- start 2024-05-09T02:18:22.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.332+0000 7f8c4cd84640 1 -- start start 2024-05-09T02:18:22.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4cd84640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 0x7f8c480adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:22.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4cd84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c48070e80 0x7f8c4814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:22.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4cd84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c480c5f90 0x7f8c4814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:22.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4cd84640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480c63a0 con 0x7f8c48070a70 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4cd84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4815bd00 con 0x7f8c480c5f90 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4cd84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480c6520 con 0x7f8c48070e80 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 0x7f8c480adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 0x7f8c480adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45022/0 (socket says 172.21.15.46:45022) 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.333+0000 7f8c4659c640 1 -- 172.21.15.46:0/1704964918 learned_addr learned my addr 172.21.15.46:0/1704964918 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c46d9d640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c480c5f90 0x7f8c4814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c3dd9b640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c48070e80 0x7f8c4814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4659c640 1 -- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c48070e80 msgr2=0x7f8c4814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4659c640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c48070e80 0x7f8c4814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4659c640 1 -- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c480c5f90 msgr2=0x7f8c4814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4659c640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c480c5f90 0x7f8c4814d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4659c640 1 -- 172.21.15.46:0/1704964918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480c8890 con 0x7f8c48070a70 2024-05-09T02:18:22.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4659c640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 0x7f8c480adee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800d5d0 tx=0x7f8c3800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:22.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004240 con 0x7f8c48070a70 2024-05-09T02:18:22.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c380043e0 con 0x7f8c48070a70 2024-05-09T02:18:22.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38003830 con 0x7f8c48070a70 2024-05-09T02:18:22.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c480c85b0 con 0x7f8c48070a70 2024-05-09T02:18:22.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.334+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c480c8ff0 con 0x7f8c48070a70 2024-05-09T02:18:22.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.335+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4806e8b0 con 0x7f8c48070a70 2024-05-09T02:18:22.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.336+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c380039d0 con 0x7f8c48070a70 2024-05-09T02:18:22.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.336+0000 7f8c3f7fe640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8c280762d0 0x7f8c280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:22.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.337+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6431+0+0 (secure 0 0 0) 0x7f8c38097b10 con 0x7f8c48070a70 2024-05-09T02:18:22.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.337+0000 7f8c3dd9b640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8c280762d0 0x7f8c280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:22.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.337+0000 7f8c3dd9b640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8c280762d0 0x7f8c280787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006fd0 tx=0x7f8c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:22.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.341+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c380611a0 con 0x7f8c48070a70 2024-05-09T02:18:22.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:22.571+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f8c4806a330 con 0x7f8c48070a70 2024-05-09T02:18:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.203+0000 7f8c3f7fe640 1 -- 172.21.15.46:0/1704964918 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v9) ==== 157+0+0 (secure 0 0 0) 0x7f8c38060aa0 con 0x7f8c48070a70 2024-05-09T02:18:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 4 and data pool 5 2024-05-09T02:18:23.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8c280762d0 msgr2=0x7f8c280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8c280762d0 0x7f8c280787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006fd0 tx=0x7f8c30008040 comp rx=0 tx=0).stop 2024-05-09T02:18:23.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 msgr2=0x7f8c480adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 0x7f8c480adee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800d5d0 tx=0x7f8c3800da90 comp rx=0 tx=0).stop 2024-05-09T02:18:23.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 shutdown_connections 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8c280762d0 0x7f8c280787e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c480c5f90 0x7f8c4814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c48070e80 0x7f8c4814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 --2- 172.21.15.46:0/1704964918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c48070a70 0x7f8c480adee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.214+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 >> 172.21.15.46:0/1704964918 conn(0x7f8c480c9e50 msgr2=0x7f8c480c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.215+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 shutdown_connections 2024-05-09T02:18:23.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.215+0000 7f8c4cd84640 1 -- 172.21.15.46:0/1704964918 wait complete. 2024-05-09T02:18:23.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.359+0000 7f815e7b7640 1 Processor -- start 2024-05-09T02:18:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.359+0000 7f815e7b7640 1 -- start start 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f815e7b7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8158155160 0x7f81580c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f815e7b7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8158158ae0 con 0x7f815815b3a0 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f815e7b7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8158155570 con 0x7f81580c84a0 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f815e7b7640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f8158157ed0 con 0x7f8158155160 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f8157fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8158155160 0x7f81580c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f8157fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8158155160 0x7f81580c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45038/0 (socket says 172.21.15.46:45038) 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f8157fff640 1 -- 172.21.15.46:0/2841432667 learned_addr learned my addr 172.21.15.46:0/2841432667 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f8157fff640 1 -- 172.21.15.46:0/2841432667 >> v1:172.21.15.107:6789/0 conn(0x7f81580c84a0 legacy=0x7f81580c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f8157fff640 1 -- 172.21.15.46:0/2841432667 >> v1:172.21.15.46:6789/0 conn(0x7f815815b3a0 legacy=0x7f815815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.361+0000 7f8157fff640 1 -- 172.21.15.46:0/2841432667 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81581581b0 con 0x7f8158155160 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.362+0000 7f8157fff640 1 --2- 172.21.15.46:0/2841432667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81580c7f60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8148009870 tx=0x7f814802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc168bd9e83fca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.362+0000 7f8156ffd640 1 -- 172.21.15.46:0/2841432667 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148037070 con 0x7f8158155160 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.362+0000 7f8156ffd640 1 -- 172.21.15.46:0/2841432667 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8148032440 con 0x7f8158155160 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.362+0000 7f8156ffd640 1 -- 172.21.15.46:0/2841432667 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148032810 con 0x7f8158155160 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 -- 172.21.15.46:0/2841432667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 msgr2=0x7f81580c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 --2- 172.21.15.46:0/2841432667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81580c7f60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8148009870 tx=0x7f814802a1e0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 -- 172.21.15.46:0/2841432667 shutdown_connections 2024-05-09T02:18:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 --2- 172.21.15.46:0/2841432667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81580c7f60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 -- 172.21.15.46:0/2841432667 >> 172.21.15.46:0/2841432667 conn(0x7f81580aebe0 msgr2=0x7f81580aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 -- 172.21.15.46:0/2841432667 shutdown_connections 2024-05-09T02:18:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.363+0000 7f815e7b7640 1 -- 172.21.15.46:0/2841432667 wait complete. 2024-05-09T02:18:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.365+0000 7f815e7b7640 1 Processor -- start 2024-05-09T02:18:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.365+0000 7f815e7b7640 1 -- start start 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815e7b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81580c84a0 0x7f815814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815e7b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81581500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815e7b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f815815b3a0 0x7f81581538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815e7b7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8158157b30 con 0x7f8158155160 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815e7b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8158158770 con 0x7f81580c84a0 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815e7b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8158157cb0 con 0x7f815815b3a0 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f81577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81581500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f81577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81581500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45044/0 (socket says 172.21.15.46:45044) 2024-05-09T02:18:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f81577fe640 1 -- 172.21.15.46:0/380501702 learned_addr learned my addr 172.21.15.46:0/380501702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f8157fff640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81580c84a0 0x7f815814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.366+0000 7f815cd54640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f815815b3a0 0x7f81581538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f81577fe640 1 -- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f815815b3a0 msgr2=0x7f81581538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f81577fe640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f815815b3a0 0x7f81581538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f81577fe640 1 -- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81580c84a0 msgr2=0x7f815814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f81577fe640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81580c84a0 0x7f815814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f81577fe640 1 -- 172.21.15.46:0/380501702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81581472e0 con 0x7f8158155160 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f815cd54640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f815815b3a0 0x7f81581538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f81577fe640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81581500e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c3d0 tx=0x7f814c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c017070 con 0x7f8158155160 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0052d0 con 0x7f8158155160 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81581573f0 con 0x7f8158155160 2024-05-09T02:18:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c003830 con 0x7f8158155160 2024-05-09T02:18:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.367+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815814fa00 con 0x7f8158155160 2024-05-09T02:18:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.368+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815806a330 con 0x7f8158155160 2024-05-09T02:18:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.369+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f814c01a070 con 0x7f8158155160 2024-05-09T02:18:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.370+0000 7f8154ff9640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f81440762d0 0x7f81440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.370+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f814c096cf0 con 0x7f8158155160 2024-05-09T02:18:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.370+0000 7f8157fff640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f81440762d0 0x7f81440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.370+0000 7f8157fff640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f81440762d0 0x7f81440787e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8148034000 tx=0x7f814802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.374+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f814c09b070 con 0x7f8158155160 2024-05-09T02:18:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.565+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81580cb660 con 0x7f8158155160 2024-05-09T02:18:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.566+0000 7f8154ff9640 1 -- 172.21.15.46:0/380501702 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20320 (secure 0 0 0) 0x7f814c068290 con 0x7f8158155160 2024-05-09T02:18:23.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:23.570 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:22.572876+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f81440762d0 msgr2=0x7f81440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f81440762d0 0x7f81440787e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8148034000 tx=0x7f814802e000 comp rx=0 tx=0).stop 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 msgr2=0x7f81581500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81581500e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c3d0 tx=0x7f814c00c890 comp rx=0 tx=0).stop 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 shutdown_connections 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f81440762d0 0x7f81440787e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f815815b3a0 0x7f81581538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8158155160 0x7f81581500e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 --2- 172.21.15.46:0/380501702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81580c84a0 0x7f815814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 >> 172.21.15.46:0/380501702 conn(0x7f81580aebe0 msgr2=0x7f81580c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 shutdown_connections 2024-05-09T02:18:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.569+0000 7f815e7b7640 1 -- 172.21.15.46:0/380501702 wait complete. 2024-05-09T02:18:23.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.694+0000 7fe57b692640 1 Processor -- start 2024-05-09T02:18:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.694+0000 7fe57b692640 1 -- start start 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe57b692640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740c4800 0x7fe574154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe57b692640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5740b17d0 0x7fe5740c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe57b692640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5740b1e60 con 0x7fe5740c8f90 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe57b692640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe57415b950 con 0x7fe5740b17d0 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe57b692640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe57415bde0 con 0x7fe5740c4800 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5740b17d0 0x7fe5740c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5740b17d0 0x7fe5740c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45048/0 (socket says 172.21.15.46:45048) 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 -- 172.21.15.46:0/4214700591 learned_addr learned my addr 172.21.15.46:0/4214700591 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe57942e640 1 --2- 172.21.15.46:0/4214700591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740c4800 0x7fe574154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 -- 172.21.15.46:0/4214700591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740c4800 msgr2=0x7fe574154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 --2- 172.21.15.46:0/4214700591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740c4800 0x7fe574154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 -- 172.21.15.46:0/4214700591 >> v1:172.21.15.107:6789/0 conn(0x7fe5740c8f90 legacy=0x7fe574157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.696+0000 7fe578c2d640 1 -- 172.21.15.46:0/4214700591 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57415b020 con 0x7fe5740b17d0 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.697+0000 7fe578c2d640 1 --2- 172.21.15.46:0/4214700591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740b17d0 0x7fe5740c8a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe57415bad0 tx=0x7fe56402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35a76ddc2fd0d66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.697+0000 7fe56bfff640 1 -- 172.21.15.46:0/4214700591 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe564037070 con 0x7fe5740b17d0 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.697+0000 7fe56bfff640 1 -- 172.21.15.46:0/4214700591 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe564032440 con 0x7fe5740b17d0 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.697+0000 7fe56bfff640 1 -- 172.21.15.46:0/4214700591 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe564032810 con 0x7fe5740b17d0 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 -- 172.21.15.46:0/4214700591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740b17d0 msgr2=0x7fe5740c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 --2- 172.21.15.46:0/4214700591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740b17d0 0x7fe5740c8a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe57415bad0 tx=0x7fe56402a1c0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 -- 172.21.15.46:0/4214700591 shutdown_connections 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 --2- 172.21.15.46:0/4214700591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740b17d0 0x7fe5740c8a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 --2- 172.21.15.46:0/4214700591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740c4800 0x7fe574154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 -- 172.21.15.46:0/4214700591 >> 172.21.15.46:0/4214700591 conn(0x7fe574068ec0 msgr2=0x7fe5740cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 -- 172.21.15.46:0/4214700591 shutdown_connections 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.698+0000 7fe57b692640 1 -- 172.21.15.46:0/4214700591 wait complete. 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.699+0000 7fe57b692640 1 Processor -- start 2024-05-09T02:18:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.700+0000 7fe57b692640 1 -- start start 2024-05-09T02:18:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57b692640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740b17d0 0x7fe5741530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57b692640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5740c4800 0x7fe5741e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57b692640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 0x7fe574145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57b692640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe57406ee40 con 0x7fe5740c8f90 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57b692640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe57415b5e0 con 0x7fe5740c4800 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57b692640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5740b2120 con 0x7fe5740b17d0 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 0x7fe574145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 0x7fe574145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45056/0 (socket says 172.21.15.46:45056) 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 -- 172.21.15.46:0/1565332413 learned_addr learned my addr 172.21.15.46:0/1565332413 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe578c2d640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5740c4800 0x7fe5741e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe57942e640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740b17d0 0x7fe5741530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 -- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740b17d0 msgr2=0x7fe5741530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740b17d0 0x7fe5741530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 -- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5740c4800 msgr2=0x7fe5741e13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5740c4800 0x7fe5741e13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 -- 172.21.15.46:0/1565332413 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe574153610 con 0x7fe5740c8f90 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe579c2f640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 0x7fe574145410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe56c002230 tx=0x7fe56c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.701+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003b70 con 0x7fe5740c8f90 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.702+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56c003d10 con 0x7fe5740c8f90 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.702+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5741545d0 con 0x7fe5740c8f90 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.702+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0052d0 con 0x7fe5740c8f90 2024-05-09T02:18:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.702+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe574145ea0 con 0x7fe5740c8f90 2024-05-09T02:18:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.703+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57406a330 con 0x7fe5740c8f90 2024-05-09T02:18:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.703+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe56c005680 con 0x7fe5740c8f90 2024-05-09T02:18:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.704+0000 7fe569ffb640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe5580762d0 0x7fe5580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.704+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe56c0977d0 con 0x7fe5740c8f90 2024-05-09T02:18:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.704+0000 7fe57942e640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe5580762d0 0x7fe5580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.705+0000 7fe57942e640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe5580762d0 0x7fe5580787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5740695f0 tx=0x7fe570009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.709+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe56c060840 con 0x7fe5740c8f90 2024-05-09T02:18:23.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.898+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe574151620 con 0x7fe5740c8f90 2024-05-09T02:18:23.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.900+0000 7fe569ffb640 1 -- 172.21.15.46:0/1565332413 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20320 (secure 0 0 0) 0x7fe56c064b40 con 0x7fe5740c8f90 2024-05-09T02:18:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:23.903 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:22.572876+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe5580762d0 msgr2=0x7fe5580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe5580762d0 0x7fe5580787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5740695f0 tx=0x7fe570009190 comp rx=0 tx=0).stop 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 msgr2=0x7fe574145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 0x7fe574145410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe56c002230 tx=0x7fe56c00cb90 comp rx=0 tx=0).stop 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 shutdown_connections 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe5580762d0 0x7fe5580787e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740c8f90 0x7fe574145410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5740c4800 0x7fe5741e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 --2- 172.21.15.46:0/1565332413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5740b17d0 0x7fe5741530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:23.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 >> 172.21.15.46:0/1565332413 conn(0x7fe574068ec0 msgr2=0x7fe57406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:23.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 shutdown_connections 2024-05-09T02:18:23.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:23.902+0000 7fe57b692640 1 -- 172.21.15.46:0/1565332413 wait complete. 2024-05-09T02:18:23.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-05-09T02:18:24.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.031+0000 7f9995f27640 1 Processor -- start 2024-05-09T02:18:24.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.031+0000 7f9995f27640 1 -- start start 2024-05-09T02:18:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f9995f27640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f99900a9530 0x7f999014e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f9995f27640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f99900c3f60 0x7f9990071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f9995f27640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9990070570 con 0x7f99900715c0 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f9995f27640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f99900c9220 con 0x7f99900a9530 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f9995f27640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f99900c5f80 con 0x7f99900c3f60 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f99900a9530 0x7f999014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f99900a9530 0x7f999014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45060/0 (socket says 172.21.15.46:45060) 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 -- 172.21.15.46:0/340122840 learned_addr learned my addr 172.21.15.46:0/340122840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998effd640 1 --2- 172.21.15.46:0/340122840 >> v2:172.21.15.107:3300/0 conn(0x7f99900c3f60 0x7f9990071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 -- 172.21.15.46:0/340122840 >> v2:172.21.15.107:3300/0 conn(0x7f99900c3f60 msgr2=0x7f9990071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 --2- 172.21.15.46:0/340122840 >> v2:172.21.15.107:3300/0 conn(0x7f99900c3f60 0x7f9990071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 -- 172.21.15.46:0/340122840 >> v1:172.21.15.107:6789/0 conn(0x7f99900715c0 legacy=0x7f9990154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.032+0000 7f998f7fe640 1 -- 172.21.15.46:0/340122840 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99900c9470 con 0x7f99900a9530 2024-05-09T02:18:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.033+0000 7f998effd640 1 --2- 172.21.15.46:0/340122840 >> v2:172.21.15.107:3300/0 conn(0x7f99900c3f60 0x7f9990071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.033+0000 7f998f7fe640 1 --2- 172.21.15.46:0/340122840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900a9530 0x7f999014e730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99900c9170 tx=0x7f998002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e058d60c4f54a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.033+0000 7f998e7fc640 1 -- 172.21.15.46:0/340122840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980036070 con 0x7f99900a9530 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.033+0000 7f998e7fc640 1 -- 172.21.15.46:0/340122840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9980031600 con 0x7f99900a9530 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.033+0000 7f998e7fc640 1 -- 172.21.15.46:0/340122840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99800319d0 con 0x7f99900a9530 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 -- 172.21.15.46:0/340122840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900a9530 msgr2=0x7f999014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 --2- 172.21.15.46:0/340122840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900a9530 0x7f999014e730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99900c9170 tx=0x7f998002a730 comp rx=0 tx=0).stop 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 -- 172.21.15.46:0/340122840 shutdown_connections 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 --2- 172.21.15.46:0/340122840 >> v2:172.21.15.107:3300/0 conn(0x7f99900c3f60 0x7f9990071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 --2- 172.21.15.46:0/340122840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900a9530 0x7f999014e730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 -- 172.21.15.46:0/340122840 >> 172.21.15.46:0/340122840 conn(0x7f99900ca0d0 msgr2=0x7f99900ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 -- 172.21.15.46:0/340122840 shutdown_connections 2024-05-09T02:18:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.034+0000 7f9995f27640 1 -- 172.21.15.46:0/340122840 wait complete. 2024-05-09T02:18:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.036+0000 7f9995f27640 1 Processor -- start 2024-05-09T02:18:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.036+0000 7f9995f27640 1 -- start start 2024-05-09T02:18:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f9995f27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 0x7f99900c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f9995f27640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99900a9530 0x7f9990160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f9995f27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99900c3f60 0x7f9990147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f9995f27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f99900c5c10 con 0x7f99900715c0 2024-05-09T02:18:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f9995f27640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99900c5930 con 0x7f99900a9530 2024-05-09T02:18:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f9995f27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99900c6410 con 0x7f99900c3f60 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f998f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 0x7f99900c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f998f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 0x7f99900c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45066/0 (socket says 172.21.15.46:45066) 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.037+0000 7f998f7fe640 1 -- 172.21.15.46:0/3324383108 learned_addr learned my addr 172.21.15.46:0/3324383108 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998effd640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99900a9530 0x7f9990160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998ffff640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99900c3f60 0x7f9990147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998f7fe640 1 -- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99900c3f60 msgr2=0x7f9990147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998f7fe640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99900c3f60 0x7f9990147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998f7fe640 1 -- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99900a9530 msgr2=0x7f9990160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998f7fe640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99900a9530 0x7f9990160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998f7fe640 1 -- 172.21.15.46:0/3324383108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9990161990 con 0x7f99900715c0 2024-05-09T02:18:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998effd640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99900a9530 0x7f9990160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f998f7fe640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 0x7f99900c32f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f998002ad20 tx=0x7f9980004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980036030 con 0x7f99900715c0 2024-05-09T02:18:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9980040070 con 0x7f99900715c0 2024-05-09T02:18:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9990160170 con 0x7f99900715c0 2024-05-09T02:18:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980009510 con 0x7f99900715c0 2024-05-09T02:18:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.038+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9990160730 con 0x7f99900715c0 2024-05-09T02:18:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.039+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999006a330 con 0x7f99900715c0 2024-05-09T02:18:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.040+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9980007c50 con 0x7f99900715c0 2024-05-09T02:18:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.041+0000 7f9987fff640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9970076300 0x7f9970078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.041+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f99800b8130 con 0x7f99900715c0 2024-05-09T02:18:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.041+0000 7f998effd640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9970076300 0x7f9970078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.042+0000 7f998effd640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9970076300 0x7f9970078810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99900ca910 tx=0x7f9978008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:24.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.046+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9980081760 con 0x7f99900715c0 2024-05-09T02:18:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:24.282+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9990070e60 con 0x7f99900715c0 2024-05-09T02:18:25.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.213+0000 7f9987fff640 1 -- 172.21.15.46:0/3324383108 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 113+0+0 (secure 0 0 0) 0x7f9980081060 con 0x7f99900715c0 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9970076300 msgr2=0x7f9970078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9970076300 0x7f9970078810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99900ca910 tx=0x7f9978008040 comp rx=0 tx=0).stop 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 msgr2=0x7f99900c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 0x7f99900c32f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f998002ad20 tx=0x7f9980004a40 comp rx=0 tx=0).stop 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 shutdown_connections 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9970076300 0x7f9970078810 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99900c3f60 0x7f9990147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99900a9530 0x7f9990160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 --2- 172.21.15.46:0/3324383108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99900715c0 0x7f99900c32f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 >> 172.21.15.46:0/3324383108 conn(0x7f99900ca0d0 msgr2=0x7f999015f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:25.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.216+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 shutdown_connections 2024-05-09T02:18:25.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.217+0000 7f9995f27640 1 -- 172.21.15.46:0/3324383108 wait complete. 2024-05-09T02:18:25.233 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-09T02:18:25.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-05-09T02:18:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.355+0000 7f8a32e43640 1 Processor -- start 2024-05-09T02:18:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.355+0000 7f8a32e43640 1 -- start start 2024-05-09T02:18:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a32e43640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a2c155170 0x7f8a2c0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a32e43640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a32e43640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8a2c157fd0 0x7f8a2c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a32e43640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2c15c000 con 0x7f8a2c155170 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a32e43640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2c0c94d0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a32e43640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c0cb6a0 con 0x7f8a2c0cc230 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a2c155170 0x7f8a2c0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a2c155170 0x7f8a2c0c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45080/0 (socket says 172.21.15.46:45080) 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 -- 172.21.15.46:0/1351232268 learned_addr learned my addr 172.21.15.46:0/1351232268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a2bfff640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a313e0640 1 --2- 172.21.15.46:0/1351232268 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c157fd0 0x7f8a2c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 -- 172.21.15.46:0/1351232268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 msgr2=0x7f8a2c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 -- 172.21.15.46:0/1351232268 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c157fd0 msgr2=0x7f8a2c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 --2- 172.21.15.46:0/1351232268 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c157fd0 0x7f8a2c1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a30bdf640 1 -- 172.21.15.46:0/1351232268 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c0cb980 con 0x7f8a2c155170 2024-05-09T02:18:25.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.356+0000 7f8a2bfff640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:25.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.357+0000 7f8a30bdf640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c155170 0x7f8a2c0c82b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0cb8b0 tx=0x7f8a1c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133c51aced3b7864 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.357+0000 7f8a2b7fe640 1 -- 172.21.15.46:0/1351232268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c036070 con 0x7f8a2c155170 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.357+0000 7f8a2b7fe640 1 -- 172.21.15.46:0/1351232268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c031600 con 0x7f8a2c155170 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.357+0000 7f8a2b7fe640 1 -- 172.21.15.46:0/1351232268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0319d0 con 0x7f8a2c155170 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 -- 172.21.15.46:0/1351232268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c155170 msgr2=0x7f8a2c0c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c155170 0x7f8a2c0c82b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0cb8b0 tx=0x7f8a1c02a5f0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 -- 172.21.15.46:0/1351232268 shutdown_connections 2024-05-09T02:18:25.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1351232268 >> v2:172.21.15.107:3300/0 conn(0x7f8a2c157fd0 0x7f8a2c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1351232268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c155170 0x7f8a2c0c82b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 -- 172.21.15.46:0/1351232268 >> 172.21.15.46:0/1351232268 conn(0x7f8a2c0aea70 msgr2=0x7f8a2c0aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 -- 172.21.15.46:0/1351232268 shutdown_connections 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.358+0000 7f8a32e43640 1 -- 172.21.15.46:0/1351232268 wait complete. 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.360+0000 7f8a32e43640 1 Processor -- start 2024-05-09T02:18:25.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.360+0000 7f8a32e43640 1 -- start start 2024-05-09T02:18:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a32e43640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c1f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a32e43640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c155170 0x7f8a2c1e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a32e43640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 0x7f8a2c0c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a32e43640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c15b030 con 0x7f8a2c157fd0 2024-05-09T02:18:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a32e43640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c0cbf40 con 0x7f8a2c155170 2024-05-09T02:18:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a32e43640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c157a40 con 0x7f8a2c0cc230 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a313e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 0x7f8a2c0c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a313e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 0x7f8a2c0c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45084/0 (socket says 172.21.15.46:45084) 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a313e0640 1 -- 172.21.15.46:0/1382960101 learned_addr learned my addr 172.21.15.46:0/1382960101 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a30bdf640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c1f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.361+0000 7f8a2bfff640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c155170 0x7f8a2c1e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a313e0640 1 -- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 msgr2=0x7f8a2c1f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a313e0640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c1f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a313e0640 1 -- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c155170 msgr2=0x7f8a2c1e3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a313e0640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c155170 0x7f8a2c1e3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a313e0640 1 -- 172.21.15.46:0/1382960101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c1e4f80 con 0x7f8a2c157fd0 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a2bfff640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c155170 0x7f8a2c1e3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a313e0640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 0x7f8a2c0c6cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400d5d0 tx=0x7f8a2400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240125f0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a24019070 con 0x7f8a2c157fd0 2024-05-09T02:18:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240129f0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c1e4ca0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.362+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c1525d0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.363+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c0c88c0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.364+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a24012b90 con 0x7f8a2c157fd0 2024-05-09T02:18:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.364+0000 7f8a297fa640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a0c0762d0 0x7f8a0c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.365+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8a24097b50 con 0x7f8a2c157fd0 2024-05-09T02:18:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.365+0000 7f8a30bdf640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a0c0762d0 0x7f8a0c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.365+0000 7f8a30bdf640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a0c0762d0 0x7f8a0c0787e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c033000 tx=0x7f8a1c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:25.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.369+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8a2c0c88c0 con 0x7f8a2c157fd0 2024-05-09T02:18:25.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:25.601+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8a2c06a330 con 0x7f8a2c157fd0 2024-05-09T02:18:26.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.215+0000 7f8a297fa640 1 -- 172.21.15.46:0/1382960101 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 117+0+0 (secure 0 0 0) 0x7f8a24060b40 con 0x7f8a2c157fd0 2024-05-09T02:18:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.217+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a0c0762d0 msgr2=0x7f8a0c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:26.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.217+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a0c0762d0 0x7f8a0c0787e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c033000 tx=0x7f8a1c009000 comp rx=0 tx=0).stop 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.217+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 msgr2=0x7f8a2c0c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 0x7f8a2c0c6cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400d5d0 tx=0x7f8a2400da90 comp rx=0 tx=0).stop 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 shutdown_connections 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a0c0762d0 0x7f8a0c0787e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a2c157fd0 0x7f8a2c0c6cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a2c155170 0x7f8a2c1e3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 --2- 172.21.15.46:0/1382960101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a2c0cc230 0x7f8a2c1f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 >> 172.21.15.46:0/1382960101 conn(0x7f8a2c0aea70 msgr2=0x7f8a2c1583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 shutdown_connections 2024-05-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.218+0000 7f8a32e43640 1 -- 172.21.15.46:0/1382960101 wait complete. 2024-05-09T02:18:26.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-05-09T02:18:26.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.357+0000 7f5fa1001640 1 Processor -- start 2024-05-09T02:18:26.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.357+0000 7f5fa1001640 1 -- start start 2024-05-09T02:18:26.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5fa1001640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5f9c154f10 0x7f5f9c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:26.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5fa1001640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f9c0cb000 0x7f5f9c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:26.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5fa1001640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9c0c94c0 con 0x7f5f9c0c7f30 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5fa1001640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9c155320 con 0x7f5f9c0cb000 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5fa1001640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9c15ba80 con 0x7f5f9c154f10 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5f9b59e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f9c0cb000 0x7f5f9c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5f9b59e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f9c0cb000 0x7f5f9c0cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35836/0 (socket says 172.21.15.46:35836) 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5f9b59e640 1 -- 172.21.15.46:0/1017821427 learned_addr learned my addr 172.21.15.46:0/1017821427 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.358+0000 7f5f9a59c640 1 --2- 172.21.15.46:0/1017821427 >> v2:172.21.15.107:3300/0 conn(0x7f5f9c154f10 0x7f5f9c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f9b59e640 1 -- 172.21.15.46:0/1017821427 >> v2:172.21.15.107:3300/0 conn(0x7f5f9c154f10 msgr2=0x7f5f9c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f9b59e640 1 --2- 172.21.15.46:0/1017821427 >> v2:172.21.15.107:3300/0 conn(0x7f5f9c154f10 0x7f5f9c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f9b59e640 1 -- 172.21.15.46:0/1017821427 >> v1:172.21.15.107:6789/0 conn(0x7f5f9c0c7f30 legacy=0x7f5f9c0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f9b59e640 1 -- 172.21.15.46:0/1017821427 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c15ae70 con 0x7f5f9c0cb000 2024-05-09T02:18:26.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f9a59c640 1 --2- 172.21.15.46:0/1017821427 >> v2:172.21.15.107:3300/0 conn(0x7f5f9c154f10 0x7f5f9c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f9b59e640 1 --2- 172.21.15.46:0/1017821427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c0cb410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c08ed50 tx=0x7f5f9402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743293f778582b7a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.359+0000 7f5f99d9b640 1 -- 172.21.15.46:0/1017821427 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94036070 con 0x7f5f9c0cb000 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5f99d9b640 1 -- 172.21.15.46:0/1017821427 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f94031600 con 0x7f5f9c0cb000 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5f99d9b640 1 -- 172.21.15.46:0/1017821427 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f940319d0 con 0x7f5f9c0cb000 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 -- 172.21.15.46:0/1017821427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 msgr2=0x7f5f9c0cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 --2- 172.21.15.46:0/1017821427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c0cb410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c08ed50 tx=0x7f5f9402a610 comp rx=0 tx=0).stop 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 -- 172.21.15.46:0/1017821427 shutdown_connections 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 --2- 172.21.15.46:0/1017821427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c0cb410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 --2- 172.21.15.46:0/1017821427 >> v2:172.21.15.107:3300/0 conn(0x7f5f9c154f10 0x7f5f9c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 -- 172.21.15.46:0/1017821427 >> 172.21.15.46:0/1017821427 conn(0x7f5f9c0aec50 msgr2=0x7f5f9c0af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:26.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 -- 172.21.15.46:0/1017821427 shutdown_connections 2024-05-09T02:18:26.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.360+0000 7f5fa1001640 1 -- 172.21.15.46:0/1017821427 wait complete. 2024-05-09T02:18:26.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.362+0000 7f5fa1001640 1 Processor -- start 2024-05-09T02:18:26.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.362+0000 7f5fa1001640 1 -- start start 2024-05-09T02:18:26.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.363+0000 7f5fa1001640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f9c0c7f30 0x7f5f9c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.363+0000 7f5fa1001640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c1ee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5fa1001640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f9c154f10 0x7f5f9c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5fa1001640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c15b710 con 0x7f5f9c0cb000 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5fa1001640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c15b430 con 0x7f5f9c154f10 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5fa1001640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c0ca300 con 0x7f5f9c0c7f30 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c1ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c1ee380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35840/0 (socket says 172.21.15.46:35840) 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 -- 172.21.15.46:0/4286605504 learned_addr learned my addr 172.21.15.46:0/4286605504 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9b59e640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f9c154f10 0x7f5f9c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9ad9d640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f9c0c7f30 0x7f5f9c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 -- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f9c0c7f30 msgr2=0x7f5f9c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:26.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f9c0c7f30 0x7f5f9c0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 -- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f9c154f10 msgr2=0x7f5f9c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f9c154f10 0x7f5f9c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 -- 172.21.15.46:0/4286605504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c1edbc0 con 0x7f5f9c0cb000 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f9a59c640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c1ee380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400c820 tx=0x7f5f8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84015070 con 0x7f5f9c0cb000 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84007a30 con 0x7f5f9c0cb000 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.364+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84007e00 con 0x7f5f9c0cb000 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.365+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c0b14d0 con 0x7f5f9c0cb000 2024-05-09T02:18:26.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.365+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c1ede60 con 0x7f5f9c0cb000 2024-05-09T02:18:26.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.365+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c06a330 con 0x7f5f9c0cb000 2024-05-09T02:18:26.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.366+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f84018070 con 0x7f5f9c0cb000 2024-05-09T02:18:26.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.367+0000 7f5f937fe640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5f7c0762d0 0x7f5f7c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:26.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.367+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f5f84097740 con 0x7f5f9c0cb000 2024-05-09T02:18:26.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.367+0000 7f5f9ad9d640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5f7c0762d0 0x7f5f7c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:26.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.368+0000 7f5f9ad9d640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5f7c0762d0 0x7f5f7c0787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c006fd0 tx=0x7f5f8c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:26.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.372+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5f9c06a330 con 0x7f5f9c0cb000 2024-05-09T02:18:26.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:26.601+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5f9c0cd490 con 0x7f5f9c0cb000 2024-05-09T02:18:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.224+0000 7f5f937fe640 1 -- 172.21.15.46:0/4286605504 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v14) ==== 110+0+0 (secure 0 0 0) 0x7f5f9c0cd490 con 0x7f5f9c0cb000 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5f7c0762d0 msgr2=0x7f5f7c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5f7c0762d0 0x7f5f7c0787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c006fd0 tx=0x7f5f8c009060 comp rx=0 tx=0).stop 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 msgr2=0x7f5f9c1ee380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c1ee380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400c820 tx=0x7f5f8400cce0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 shutdown_connections 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5f7c0762d0 0x7f5f7c0787e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f9c154f10 0x7f5f9c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f9c0cb000 0x7f5f9c1ee380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 --2- 172.21.15.46:0/4286605504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5f9c0c7f30 0x7f5f9c0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 >> 172.21.15.46:0/4286605504 conn(0x7f5f9c0aec50 msgr2=0x7f5f9c06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 shutdown_connections 2024-05-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.227+0000 7f5fa1001640 1 -- 172.21.15.46:0/4286605504 wait complete. 2024-05-09T02:18:27.243 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-05-09T02:18:27.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:27.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.362+0000 7f9a31b3f640 1 Processor -- start 2024-05-09T02:18:27.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.362+0000 7f9a31b3f640 1 -- start start 2024-05-09T02:18:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.363+0000 7f9a31b3f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a2c0c96c0 0x7f9a2c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a31b3f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2c158ae0 con 0x7f9a2c155160 2024-05-09T02:18:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a31b3f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2c155570 con 0x7f9a2c15b3a0 2024-05-09T02:18:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a31b3f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9a2c157ed0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a2c155160 0x7f9a2c0c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44064/0 (socket says 172.21.15.46:44064) 2024-05-09T02:18:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2b7fe640 1 -- 172.21.15.46:0/613870349 learned_addr learned my addr 172.21.15.46:0/613870349 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2affd640 1 --2- 172.21.15.46:0/613870349 >> v2:172.21.15.107:3300/0 conn(0x7f9a2c0c96c0 0x7f9a2c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889611943 0 0) 0x7f9a2c158ae0 con 0x7f9a2c155160 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a14003520 con 0x7f9a2c155160 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888403211 0 0) 0x7f9a2c155570 con 0x7f9a2c15b3a0 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a2c158ae0 con 0x7f9a2c15b3a0 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1258583544 0 0) 0x7f9a14003520 con 0x7f9a2c155160 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2affd640 1 -- 172.21.15.46:0/613870349 >> v1:172.21.15.107:6789/0 conn(0x7f9a2c15b3a0 legacy=0x7f9a2c15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2affd640 1 -- 172.21.15.46:0/613870349 >> v1:172.21.15.46:6789/0 conn(0x7f9a2c155160 legacy=0x7f9a2c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.364+0000 7f9a2affd640 1 -- 172.21.15.46:0/613870349 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2c1581b0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.365+0000 7f9a2affd640 1 --2- 172.21.15.46:0/613870349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c0c9ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097a0 tx=0x7f9a2002a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a35e16cbdedf6e16 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:27.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.365+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20037070 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.365+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2002ab30 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.365+0000 7f9a2a7fc640 1 -- 172.21.15.46:0/613870349 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0016f0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 -- 172.21.15.46:0/613870349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c0c96c0 msgr2=0x7f9a2c0c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/613870349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c0c9ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097a0 tx=0x7f9a2002a0a0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 -- 172.21.15.46:0/613870349 shutdown_connections 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/613870349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c0c9ad0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 -- 172.21.15.46:0/613870349 >> 172.21.15.46:0/613870349 conn(0x7f9a2c0aebe0 msgr2=0x7f9a2c0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 -- 172.21.15.46:0/613870349 shutdown_connections 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.366+0000 7f9a31b3f640 1 -- 172.21.15.46:0/613870349 wait complete. 2024-05-09T02:18:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.368+0000 7f9a31b3f640 1 Processor -- start 2024-05-09T02:18:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.368+0000 7f9a31b3f640 1 -- start start 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a31b3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c1f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a31b3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c155160 0x7f9a2c0adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a31b3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a2c15b3a0 0x7f9a2c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a31b3f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2c0c8670 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a31b3f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2c158770 con 0x7f9a2c155160 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a31b3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2c157b30 con 0x7f9a2c15b3a0 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c1f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c1f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35854/0 (socket says 172.21.15.46:35854) 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a2b7fe640 1 -- 172.21.15.46:0/2333277873 learned_addr learned my addr 172.21.15.46:0/2333277873 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a2affd640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c155160 0x7f9a2c0adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a2bfff640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a2c15b3a0 0x7f9a2c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.369+0000 7f9a2b7fe640 1 -- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a2c15b3a0 msgr2=0x7f9a2c14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a2b7fe640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a2c15b3a0 0x7f9a2c14e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a2b7fe640 1 -- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c155160 msgr2=0x7f9a2c0adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a2b7fe640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c155160 0x7f9a2c0adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a2b7fe640 1 -- 172.21.15.46:0/2333277873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2c1506f0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a2affd640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c155160 0x7f9a2c0adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a2b7fe640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c1f1bc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0013c0 tx=0x7f9a1c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c017070 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00ce50 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2c1509d0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c005cf0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.370+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a2c1f2100 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.371+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a2c06a330 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.372+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a1c01a070 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.372+0000 7f9a13fff640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9a18076300 0x7f9a18078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.372+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9a1c096ad0 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.372+0000 7f9a2affd640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9a18076300 0x7f9a18078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.373+0000 7f9a2affd640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9a18076300 0x7f9a18078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a20034000 tx=0x7f9a2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:27.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.377+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9a1c05fb40 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.606+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a2c0cb100 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.606+0000 7f9a13fff640 1 -- 172.21.15.46:0/2333277873 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f9a1c063e40 con 0x7f9a2c0c96c0 2024-05-09T02:18:27.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:27.609 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:27.609 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9a18076300 msgr2=0x7f9a18078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9a18076300 0x7f9a18078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a20034000 tx=0x7f9a2002e000 comp rx=0 tx=0).stop 2024-05-09T02:18:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 msgr2=0x7f9a2c1f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c1f1bc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0013c0 tx=0x7f9a1c00cb10 comp rx=0 tx=0).stop 2024-05-09T02:18:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 shutdown_connections 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9a18076300 0x7f9a18078810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a2c15b3a0 0x7f9a2c14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a2c155160 0x7f9a2c0adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 --2- 172.21.15.46:0/2333277873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a2c0c96c0 0x7f9a2c1f1bc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 >> 172.21.15.46:0/2333277873 conn(0x7f9a2c0aebe0 msgr2=0x7f9a2c0c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 shutdown_connections 2024-05-09T02:18:27.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.608+0000 7f9a31b3f640 1 -- 172.21.15.46:0/2333277873 wait complete. 2024-05-09T02:18:27.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.733+0000 7fee98fe8640 1 Processor -- start 2024-05-09T02:18:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.733+0000 7fee98fe8640 1 -- start start 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee98fe8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee940c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee98fe8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fee940c84a0 0x7fee940c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee98fe8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fee940c9c00 0x7fee9415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee98fe8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fee94158ae0 con 0x7fee940c84a0 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee98fe8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fee94155570 con 0x7fee940c9c00 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee98fe8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fee94157ed0 con 0x7fee94155160 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fee940c84a0 0x7fee940c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fee940c84a0 0x7fee940c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35870/0 (socket says 172.21.15.46:35870) 2024-05-09T02:18:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 -- 172.21.15.46:0/3814827275 learned_addr learned my addr 172.21.15.46:0/3814827275 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee9259c640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee940c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee92d9d640 1 --2- 172.21.15.46:0/3814827275 >> v2:172.21.15.107:3300/0 conn(0x7fee940c9c00 0x7fee9415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 -- 172.21.15.46:0/3814827275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 msgr2=0x7fee940c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee940c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 -- 172.21.15.46:0/3814827275 >> v2:172.21.15.107:3300/0 conn(0x7fee940c9c00 msgr2=0x7fee9415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 --2- 172.21.15.46:0/3814827275 >> v2:172.21.15.107:3300/0 conn(0x7fee940c9c00 0x7fee9415b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee91d9b640 1 -- 172.21.15.46:0/3814827275 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee941581b0 con 0x7fee940c84a0 2024-05-09T02:18:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.735+0000 7fee9259c640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee940c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.736+0000 7fee91d9b640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee940c96c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee940c73d0 tx=0x7fee7c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd10b2ec32a1d06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.736+0000 7fee9159a640 1 -- 172.21.15.46:0/3814827275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c037070 con 0x7fee940c84a0 2024-05-09T02:18:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.736+0000 7fee9159a640 1 -- 172.21.15.46:0/3814827275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c02ae00 con 0x7fee940c84a0 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.736+0000 7fee9159a640 1 -- 172.21.15.46:0/3814827275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c032660 con 0x7fee940c84a0 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 -- 172.21.15.46:0/3814827275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 msgr2=0x7fee940c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee940c96c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee940c73d0 tx=0x7fee7c02a0b0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 -- 172.21.15.46:0/3814827275 shutdown_connections 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 --2- 172.21.15.46:0/3814827275 >> v2:172.21.15.107:3300/0 conn(0x7fee940c9c00 0x7fee9415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee940c96c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 --2- 172.21.15.46:0/3814827275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee940c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 -- 172.21.15.46:0/3814827275 >> 172.21.15.46:0/3814827275 conn(0x7fee940aebe0 msgr2=0x7fee940aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 -- 172.21.15.46:0/3814827275 shutdown_connections 2024-05-09T02:18:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.737+0000 7fee98fe8640 1 -- 172.21.15.46:0/3814827275 wait complete. 2024-05-09T02:18:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.739+0000 7fee98fe8640 1 Processor -- start 2024-05-09T02:18:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.739+0000 7fee98fe8640 1 -- start start 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee98fe8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee9415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee98fe8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee940c9c00 0x7fee9414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee98fe8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee941f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee98fe8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fee94157b30 con 0x7fee940c84a0 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee98fe8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fee94158770 con 0x7fee940c9c00 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee98fe8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fee94157cb0 con 0x7fee94155160 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee9415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee9415a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35882/0 (socket says 172.21.15.46:35882) 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 -- 172.21.15.46:0/2624985962 learned_addr learned my addr 172.21.15.46:0/2624985962 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee92d9d640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee941f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee91d9b640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee940c9c00 0x7fee9414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 -- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 msgr2=0x7fee941f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee941f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 -- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee940c9c00 msgr2=0x7fee9414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee940c9c00 0x7fee9414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 -- 172.21.15.46:0/2624985962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9415ae80 con 0x7fee940c84a0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.740+0000 7fee9259c640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee9415a940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee8400cde0 tx=0x7fee8400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.741+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8400f680 con 0x7fee940c84a0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.741+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8400f820 con 0x7fee940c84a0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.741+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8400fc10 con 0x7fee940c84a0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.741+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9415a1f0 con 0x7fee940c84a0 2024-05-09T02:18:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.741+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee94151110 con 0x7fee940c84a0 2024-05-09T02:18:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.742+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee9406a330 con 0x7fee940c84a0 2024-05-09T02:18:27.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.742+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee84018400 con 0x7fee940c84a0 2024-05-09T02:18:27.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.743+0000 7fee8affd640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fee740762d0 0x7fee740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:27.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.743+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fee84098630 con 0x7fee940c84a0 2024-05-09T02:18:27.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.743+0000 7fee91d9b640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fee740762d0 0x7fee740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:27.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.744+0000 7fee91d9b640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fee740762d0 0x7fee740787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fee7c034000 tx=0x7fee7c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:27.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.747+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fee84014030 con 0x7fee940c84a0 2024-05-09T02:18:27.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.939+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee940cb100 con 0x7fee940c84a0 2024-05-09T02:18:27.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.941+0000 7fee8affd640 1 -- 172.21.15.46:0/2624985962 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7fee84061580 con 0x7fee940c84a0 2024-05-09T02:18:27.944 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:27.944 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fee740762d0 msgr2=0x7fee740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fee740762d0 0x7fee740787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fee7c034000 tx=0x7fee7c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 msgr2=0x7fee9415a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee9415a940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee8400cde0 tx=0x7fee8400a650 comp rx=0 tx=0).stop 2024-05-09T02:18:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 shutdown_connections 2024-05-09T02:18:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fee740762d0 0x7fee740787e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fee94155160 0x7fee941f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee940c9c00 0x7fee9414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 --2- 172.21.15.46:0/2624985962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee940c84a0 0x7fee9415a940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:27.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 >> 172.21.15.46:0/2624985962 conn(0x7fee940aebe0 msgr2=0x7fee940c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:27.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 shutdown_connections 2024-05-09T02:18:27.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:27.943+0000 7fee98fe8640 1 -- 172.21.15.46:0/2624985962 wait complete. 2024-05-09T02:18:27.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T02:18:27.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.069+0000 7f4edd889640 1 Processor -- start 2024-05-09T02:18:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.069+0000 7f4edd889640 1 -- start start 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.070+0000 7f4edd889640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ed80c96c0 0x7f4ed80c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.070+0000 7f4edd889640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ed815b3a0 0x7f4ed815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.070+0000 7f4edd889640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ed8158ae0 con 0x7f4ed8155160 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.070+0000 7f4edd889640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed8155570 con 0x7f4ed815b3a0 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.070+0000 7f4edd889640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed8157ed0 con 0x7f4ed80c96c0 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ed815b3a0 0x7f4ed815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed6ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4ed8155160 0x7f4ed80c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44078/0 (socket says 172.21.15.46:44078) 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed6ffd640 1 -- 172.21.15.46:0/706847144 learned_addr learned my addr 172.21.15.46:0/706847144 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed67fc640 1 --2- 172.21.15.46:0/706847144 >> v2:172.21.15.107:3300/0 conn(0x7f4ed80c96c0 0x7f4ed80c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed77fe640 1 -- 172.21.15.46:0/706847144 >> v2:172.21.15.107:3300/0 conn(0x7f4ed80c96c0 msgr2=0x7f4ed80c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed77fe640 1 --2- 172.21.15.46:0/706847144 >> v2:172.21.15.107:3300/0 conn(0x7f4ed80c96c0 0x7f4ed80c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed77fe640 1 -- 172.21.15.46:0/706847144 >> v1:172.21.15.46:6789/0 conn(0x7f4ed8155160 legacy=0x7f4ed80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.071+0000 7f4ed77fe640 1 -- 172.21.15.46:0/706847144 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed81581b0 con 0x7f4ed815b3a0 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.072+0000 7f4ed77fe640 1 --2- 172.21.15.46:0/706847144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed815b3a0 0x7f4ed815b7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b2fc0 tx=0x7f4ec802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfa8ab71f69c903 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.072+0000 7f4ed5ffb640 1 -- 172.21.15.46:0/706847144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8007740 con 0x7f4ed815b3a0 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.072+0000 7f4ed5ffb640 1 -- 172.21.15.46:0/706847144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec80078e0 con 0x7f4ed815b3a0 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.072+0000 7f4ed5ffb640 1 -- 172.21.15.46:0/706847144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8007cb0 con 0x7f4ed815b3a0 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 -- 172.21.15.46:0/706847144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed815b3a0 msgr2=0x7f4ed815b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 --2- 172.21.15.46:0/706847144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed815b3a0 0x7f4ed815b7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b2fc0 tx=0x7f4ec802a560 comp rx=0 tx=0).stop 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 -- 172.21.15.46:0/706847144 shutdown_connections 2024-05-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 --2- 172.21.15.46:0/706847144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed815b3a0 0x7f4ed815b7b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 --2- 172.21.15.46:0/706847144 >> v2:172.21.15.107:3300/0 conn(0x7f4ed80c96c0 0x7f4ed80c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 -- 172.21.15.46:0/706847144 >> 172.21.15.46:0/706847144 conn(0x7f4ed80aebe0 msgr2=0x7f4ed80aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 -- 172.21.15.46:0/706847144 shutdown_connections 2024-05-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.073+0000 7f4edd889640 1 -- 172.21.15.46:0/706847144 wait complete. 2024-05-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.074+0000 7f4edd889640 1 Processor -- start 2024-05-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.075+0000 7f4edd889640 1 -- start start 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 0x7f4ed80c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ed8155160 0x7f4ed814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ed815b3a0 0x7f4ed814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed80c8670 con 0x7f4ed80c96c0 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed8158770 con 0x7f4ed815b3a0 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed8157b30 con 0x7f4ed8155160 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 0x7f4ed80c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 0x7f4ed80c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35910/0 (socket says 172.21.15.46:35910) 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 -- 172.21.15.46:0/3019973048 learned_addr learned my addr 172.21.15.46:0/3019973048 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed67fc640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ed8155160 0x7f4ed814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed77fe640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ed815b3a0 0x7f4ed814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 -- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ed8155160 msgr2=0x7f4ed814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ed8155160 0x7f4ed814b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 -- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ed815b3a0 msgr2=0x7f4ed814dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ed815b3a0 0x7f4ed814dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 -- 172.21.15.46:0/3019973048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed8157500 con 0x7f4ed80c96c0 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ed6ffd640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 0x7f4ed80c5df0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c370 tx=0x7f4ed000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0017070 con 0x7f4ed80c96c0 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005ce0 con 0x7f4ed80c96c0 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed814f630 con 0x7f4ed80c96c0 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.076+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00072f0 con 0x7f4ed80c96c0 2024-05-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.077+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed814f910 con 0x7f4ed80c96c0 2024-05-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.077+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed806a330 con 0x7f4ed80c96c0 2024-05-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.078+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4ed001a070 con 0x7f4ed80c96c0 2024-05-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.079+0000 7f4ecffff640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4eb80762d0 0x7f4eb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.079+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4ed0096bc0 con 0x7f4ed80c96c0 2024-05-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.079+0000 7f4ed67fc640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4eb80762d0 0x7f4eb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.080+0000 7f4ed67fc640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4eb80762d0 0x7f4eb80787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80cc8c0 tx=0x7f4ec0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.084+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4ed0060280 con 0x7f4ed80c96c0 2024-05-09T02:18:28.112 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-05-09T02:18:28.109+0000 7fef5b4cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:18:28.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.273+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ed80cb100 con 0x7f4eb80762d0 2024-05-09T02:18:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.286+0000 7f4ecffff640 1 -- 172.21.15.46:0/3019973048 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+478321 (secure 0 0 0) 0x7f4ed80cb100 con 0x7f4eb80762d0 2024-05-09T02:18:28.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:28.297 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:28.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4eb80762d0 msgr2=0x7f4eb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4eb80762d0 0x7f4eb80787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80cc8c0 tx=0x7f4ec0008040 comp rx=0 tx=0).stop 2024-05-09T02:18:28.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 msgr2=0x7f4ed80c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 0x7f4ed80c5df0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c370 tx=0x7f4ed000c830 comp rx=0 tx=0).stop 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 shutdown_connections 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4eb80762d0 0x7f4eb80787e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ed815b3a0 0x7f4ed814dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ed8155160 0x7f4ed814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 --2- 172.21.15.46:0/3019973048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ed80c96c0 0x7f4ed80c5df0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 >> 172.21.15.46:0/3019973048 conn(0x7f4ed80aebe0 msgr2=0x7f4ed80c2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 shutdown_connections 2024-05-09T02:18:28.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.290+0000 7f4edd889640 1 -- 172.21.15.46:0/3019973048 wait complete. 2024-05-09T02:18:28.304 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-09T02:18:26.500982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235768,"kb_used_data":2968,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738952,"statfs":{"total":773094113280,"available":772852686848,"internally_reserved":0,"allocated":3039232,"data_stored":1816312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.326140"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177783+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:21.177783+0000","last_peered":"2024-05-09T02:18:21.177783+0000","last_clean":"2024-05-09T02:18:21.177783+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:21.177783+0000","last_undegraded":"2024-05-09T02:18:21.177783+0000","last_fullsized":"2024-05-09T02:18:21.177783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181452+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:21.181452+0000","last_peered":"2024-05-09T02:18:21.181452+0000","last_clean":"2024-05-09T02:18:21.181452+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:21.181452+0000","last_undegraded":"2024-05-09T02:18:21.181452+0000","last_fullsized":"2024-05-09T02:18:21.181452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181599+0000","last_change":"2024-05-09T02:18:21.181599+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181599+0000","last_undegraded":"2024-05-09T02:18:21.181599+0000","last_fullsized":"2024-05-09T02:18:21.181599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181584+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:21.181584+0000","last_peered":"2024-05-09T02:18:21.181584+0000","last_clean":"2024-05-09T02:18:21.181584+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:21.181584+0000","last_undegraded":"2024-05-09T02:18:21.181584+0000","last_fullsized":"2024-05-09T02:18:21.181584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177608+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:21.177608+0000","last_peered":"2024-05-09T02:18:21.177608+0000","last_clean":"2024-05-09T02:18:21.177608+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:21.177608+0000","last_undegraded":"2024-05-09T02:18:21.177608+0000","last_fullsized":"2024-05-09T02:18:21.177608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.176951+0000","last_change":"2024-05-09T02:18:21.176951+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.176951+0000","last_undegraded":"2024-05-09T02:18:21.176951+0000","last_fullsized":"2024-05-09T02:18:21.176951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185326+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:21.185326+0000","last_peered":"2024-05-09T02:18:21.185326+0000","last_clean":"2024-05-09T02:18:21.185326+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:21.185326+0000","last_undegraded":"2024-05-09T02:18:21.185326+0000","last_fullsized":"2024-05-09T02:18:21.185326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182418+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:21.182418+0000","last_peered":"2024-05-09T02:18:21.182418+0000","last_clean":"2024-05-09T02:18:21.182418+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:21.182418+0000","last_undegraded":"2024-05-09T02:18:21.182418+0000","last_fullsized":"2024-05-09T02:18:21.182418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.177659+0000","last_change":"2024-05-09T02:18:21.177659+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.177659+0000","last_undegraded":"2024-05-09T02:18:21.177659+0000","last_fullsized":"2024-05-09T02:18:21.177659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184834+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:21.184834+0000","last_peered":"2024-05-09T02:18:21.184834+0000","last_clean":"2024-05-09T02:18:21.184834+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:21.184834+0000","last_undegraded":"2024-05-09T02:18:21.184834+0000","last_fullsized":"2024-05-09T02:18:21.184834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182824+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:21.182824+0000","last_peered":"2024-05-09T02:18:21.182824+0000","last_clean":"2024-05-09T02:18:21.182824+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:21.182824+0000","last_undegraded":"2024-05-09T02:18:21.182824+0000","last_fullsized":"2024-05-09T02:18:21.182824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.177463+0000","last_change":"2024-05-09T02:18:21.177463+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.177463+0000","last_undegraded":"2024-05-09T02:18:21.177463+0000","last_fullsized":"2024-05-09T02:18:21.177463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183418+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:21.183418+0000","last_peered":"2024-05-09T02:18:21.183418+0000","last_clean":"2024-05-09T02:18:21.183418+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:21.183418+0000","last_undegraded":"2024-05-09T02:18:21.183418+0000","last_fullsized":"2024-05-09T02:18:21.183418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184950+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:21.184950+0000","last_peered":"2024-05-09T02:18:21.184950+0000","last_clean":"2024-05-09T02:18:21.184950+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:21.184950+0000","last_undegraded":"2024-05-09T02:18:21.184950+0000","last_fullsized":"2024-05-09T02:18:21.184950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.177218+0000","last_change":"2024-05-09T02:18:21.177218+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.177218+0000","last_undegraded":"2024-05-09T02:18:21.177218+0000","last_fullsized":"2024-05-09T02:18:21.177218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182479+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:21.182479+0000","last_peered":"2024-05-09T02:18:21.182479+0000","last_clean":"2024-05-09T02:18:21.182479+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:21.182479+0000","last_undegraded":"2024-05-09T02:18:21.182479+0000","last_fullsized":"2024-05-09T02:18:21.182479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181486+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:21.181486+0000","last_peered":"2024-05-09T02:18:21.181486+0000","last_clean":"2024-05-09T02:18:21.181486+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:21.181486+0000","last_undegraded":"2024-05-09T02:18:21.181486+0000","last_fullsized":"2024-05-09T02:18:21.181486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.176941+0000","last_change":"2024-05-09T02:18:21.176941+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.176941+0000","last_undegraded":"2024-05-09T02:18:21.176941+0000","last_fullsized":"2024-05-09T02:18:21.176941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183893+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:21.183893+0000","last_peered":"2024-05-09T02:18:21.183893+0000","last_clean":"2024-05-09T02:18:21.183893+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:21.183893+0000","last_undegraded":"2024-05-09T02:18:21.183893+0000","last_fullsized":"2024-05-09T02:18:21.183893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180481+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:21.180481+0000","last_peered":"2024-05-09T02:18:21.180481+0000","last_clean":"2024-05-09T02:18:21.180481+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:21.180481+0000","last_undegraded":"2024-05-09T02:18:21.180481+0000","last_fullsized":"2024-05-09T02:18:21.180481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181890+0000","last_change":"2024-05-09T02:18:21.181890+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181890+0000","last_undegraded":"2024-05-09T02:18:21.181890+0000","last_fullsized":"2024-05-09T02:18:21.181890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.178990+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:21.178990+0000","last_peered":"2024-05-09T02:18:21.178990+0000","last_clean":"2024-05-09T02:18:21.178990+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:21.178990+0000","last_undegraded":"2024-05-09T02:18:21.178990+0000","last_fullsized":"2024-05-09T02:18:21.178990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184422+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:21.184422+0000","last_peered":"2024-05-09T02:18:21.184422+0000","last_clean":"2024-05-09T02:18:21.184422+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:21.184422+0000","last_undegraded":"2024-05-09T02:18:21.184422+0000","last_fullsized":"2024-05-09T02:18:21.184422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.176987+0000","last_change":"2024-05-09T02:18:21.176987+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.176987+0000","last_undegraded":"2024-05-09T02:18:21.176987+0000","last_fullsized":"2024-05-09T02:18:21.176987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177281+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:21.177281+0000","last_peered":"2024-05-09T02:18:21.177281+0000","last_clean":"2024-05-09T02:18:21.177281+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:21.177281+0000","last_undegraded":"2024-05-09T02:18:21.177281+0000","last_fullsized":"2024-05-09T02:18:21.177281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184396+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:21.184396+0000","last_peered":"2024-05-09T02:18:21.184396+0000","last_clean":"2024-05-09T02:18:21.184396+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:21.184396+0000","last_undegraded":"2024-05-09T02:18:21.184396+0000","last_fullsized":"2024-05-09T02:18:21.184396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.177048+0000","last_change":"2024-05-09T02:18:21.177048+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.177048+0000","last_undegraded":"2024-05-09T02:18:21.177048+0000","last_fullsized":"2024-05-09T02:18:21.177048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183132+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:21.183132+0000","last_peered":"2024-05-09T02:18:21.183132+0000","last_clean":"2024-05-09T02:18:21.183132+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:21.183132+0000","last_undegraded":"2024-05-09T02:18:21.183132+0000","last_fullsized":"2024-05-09T02:18:21.183132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180654+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:21.180654+0000","last_peered":"2024-05-09T02:18:21.180654+0000","last_clean":"2024-05-09T02:18:21.180654+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:21.180654+0000","last_undegraded":"2024-05-09T02:18:21.180654+0000","last_fullsized":"2024-05-09T02:18:21.180654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.183121+0000","last_change":"2024-05-09T02:18:21.183121+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.183121+0000","last_undegraded":"2024-05-09T02:18:21.183121+0000","last_fullsized":"2024-05-09T02:18:21.183121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181317+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:21.181317+0000","last_peered":"2024-05-09T02:18:21.181317+0000","last_clean":"2024-05-09T02:18:21.181317+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:21.181317+0000","last_undegraded":"2024-05-09T02:18:21.181317+0000","last_fullsized":"2024-05-09T02:18:21.181317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185434+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:21.185434+0000","last_peered":"2024-05-09T02:18:21.185434+0000","last_clean":"2024-05-09T02:18:21.185434+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:21.185434+0000","last_undegraded":"2024-05-09T02:18:21.185434+0000","last_fullsized":"2024-05-09T02:18:21.185434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.179196+0000","last_change":"2024-05-09T02:18:21.179196+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.179196+0000","last_undegraded":"2024-05-09T02:18:21.179196+0000","last_fullsized":"2024-05-09T02:18:21.179196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182708+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:21.182708+0000","last_peered":"2024-05-09T02:18:21.182708+0000","last_clean":"2024-05-09T02:18:21.182708+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:21.182708+0000","last_undegraded":"2024-05-09T02:18:21.182708+0000","last_fullsized":"2024-05-09T02:18:21.182708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181452+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:21.181452+0000","last_peered":"2024-05-09T02:18:21.181452+0000","last_clean":"2024-05-09T02:18:21.181452+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:21.181452+0000","last_undegraded":"2024-05-09T02:18:21.181452+0000","last_fullsized":"2024-05-09T02:18:21.181452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180581+0000","last_change":"2024-05-09T02:18:21.180581+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180581+0000","last_undegraded":"2024-05-09T02:18:21.180581+0000","last_fullsized":"2024-05-09T02:18:21.180581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.179262+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:21.179262+0000","last_peered":"2024-05-09T02:18:21.179262+0000","last_clean":"2024-05-09T02:18:21.179262+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:21.179262+0000","last_undegraded":"2024-05-09T02:18:21.179262+0000","last_fullsized":"2024-05-09T02:18:21.179262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183541+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:21.183541+0000","last_peered":"2024-05-09T02:18:21.183541+0000","last_clean":"2024-05-09T02:18:21.183541+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:21.183541+0000","last_undegraded":"2024-05-09T02:18:21.183541+0000","last_fullsized":"2024-05-09T02:18:21.183541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180961+0000","last_change":"2024-05-09T02:18:21.180961+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180961+0000","last_undegraded":"2024-05-09T02:18:21.180961+0000","last_fullsized":"2024-05-09T02:18:21.180961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180542+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:21.180542+0000","last_peered":"2024-05-09T02:18:21.180542+0000","last_clean":"2024-05-09T02:18:21.180542+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:21.180542+0000","last_undegraded":"2024-05-09T02:18:21.180542+0000","last_fullsized":"2024-05-09T02:18:21.180542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177737+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:21.177737+0000","last_peered":"2024-05-09T02:18:21.177737+0000","last_clean":"2024-05-09T02:18:21.177737+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:21.177737+0000","last_undegraded":"2024-05-09T02:18:21.177737+0000","last_fullsized":"2024-05-09T02:18:21.177737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180286+0000","last_change":"2024-05-09T02:18:21.180286+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180286+0000","last_undegraded":"2024-05-09T02:18:21.180286+0000","last_fullsized":"2024-05-09T02:18:21.180286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.176719+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:21.176719+0000","last_peered":"2024-05-09T02:18:21.176719+0000","last_clean":"2024-05-09T02:18:21.176719+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:21.176719+0000","last_undegraded":"2024-05-09T02:18:21.176719+0000","last_fullsized":"2024-05-09T02:18:21.176719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184511+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:21.184511+0000","last_peered":"2024-05-09T02:18:21.184511+0000","last_clean":"2024-05-09T02:18:21.184511+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:21.184511+0000","last_undegraded":"2024-05-09T02:18:21.184511+0000","last_fullsized":"2024-05-09T02:18:21.184511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.179231+0000","last_change":"2024-05-09T02:18:21.179231+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.179231+0000","last_undegraded":"2024-05-09T02:18:21.179231+0000","last_fullsized":"2024-05-09T02:18:21.179231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182305+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:21.182305+0000","last_peered":"2024-05-09T02:18:21.182305+0000","last_clean":"2024-05-09T02:18:21.182305+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:21.182305+0000","last_undegraded":"2024-05-09T02:18:21.182305+0000","last_fullsized":"2024-05-09T02:18:21.182305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182292+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:21.182292+0000","last_peered":"2024-05-09T02:18:21.182292+0000","last_clean":"2024-05-09T02:18:21.182292+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:21.182292+0000","last_undegraded":"2024-05-09T02:18:21.182292+0000","last_fullsized":"2024-05-09T02:18:21.182292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184604+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:21.184604+0000","last_peered":"2024-05-09T02:18:21.184604+0000","last_clean":"2024-05-09T02:18:21.184604+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:21.184604+0000","last_undegraded":"2024-05-09T02:18:21.184604+0000","last_fullsized":"2024-05-09T02:18:21.184604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181386+0000","last_change":"2024-05-09T02:18:21.181386+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181386+0000","last_undegraded":"2024-05-09T02:18:21.181386+0000","last_fullsized":"2024-05-09T02:18:21.181386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185240+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:21.185240+0000","last_peered":"2024-05-09T02:18:21.185240+0000","last_clean":"2024-05-09T02:18:21.185240+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:21.185240+0000","last_undegraded":"2024-05-09T02:18:21.185240+0000","last_fullsized":"2024-05-09T02:18:21.185240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.178107+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:21.178107+0000","last_peered":"2024-05-09T02:18:21.178107+0000","last_clean":"2024-05-09T02:18:21.178107+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:21.178107+0000","last_undegraded":"2024-05-09T02:18:21.178107+0000","last_fullsized":"2024-05-09T02:18:21.178107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.182202+0000","last_change":"2024-05-09T02:18:21.182202+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.182202+0000","last_undegraded":"2024-05-09T02:18:21.182202+0000","last_fullsized":"2024-05-09T02:18:21.182202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182550+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:21.182550+0000","last_peered":"2024-05-09T02:18:21.182550+0000","last_clean":"2024-05-09T02:18:21.182550+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:21.182550+0000","last_undegraded":"2024-05-09T02:18:21.182550+0000","last_fullsized":"2024-05-09T02:18:21.182550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181167+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:21.181167+0000","last_peered":"2024-05-09T02:18:21.181167+0000","last_clean":"2024-05-09T02:18:21.181167+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:21.181167+0000","last_undegraded":"2024-05-09T02:18:21.181167+0000","last_fullsized":"2024-05-09T02:18:21.181167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180117+0000","last_change":"2024-05-09T02:18:21.180117+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180117+0000","last_undegraded":"2024-05-09T02:18:21.180117+0000","last_fullsized":"2024-05-09T02:18:21.180117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185426+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:21.185426+0000","last_peered":"2024-05-09T02:18:21.185426+0000","last_clean":"2024-05-09T02:18:21.185426+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:21.185426+0000","last_undegraded":"2024-05-09T02:18:21.185426+0000","last_fullsized":"2024-05-09T02:18:21.185426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.178142+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:21.178142+0000","last_peered":"2024-05-09T02:18:21.178142+0000","last_clean":"2024-05-09T02:18:21.178142+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:21.178142+0000","last_undegraded":"2024-05-09T02:18:21.178142+0000","last_fullsized":"2024-05-09T02:18:21.178142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181195+0000","last_change":"2024-05-09T02:18:21.181195+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181195+0000","last_undegraded":"2024-05-09T02:18:21.181195+0000","last_fullsized":"2024-05-09T02:18:21.181195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185294+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:21.185294+0000","last_peered":"2024-05-09T02:18:21.185294+0000","last_clean":"2024-05-09T02:18:21.185294+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:21.185294+0000","last_undegraded":"2024-05-09T02:18:21.185294+0000","last_fullsized":"2024-05-09T02:18:21.185294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.179402+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:21.179402+0000","last_peered":"2024-05-09T02:18:21.179402+0000","last_clean":"2024-05-09T02:18:21.179402+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:21.179402+0000","last_undegraded":"2024-05-09T02:18:21.179402+0000","last_fullsized":"2024-05-09T02:18:21.179402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.177677+0000","last_change":"2024-05-09T02:18:21.177677+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.177677+0000","last_undegraded":"2024-05-09T02:18:21.177677+0000","last_fullsized":"2024-05-09T02:18:21.177677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184599+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:21.184599+0000","last_peered":"2024-05-09T02:18:21.184599+0000","last_clean":"2024-05-09T02:18:21.184599+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:21.184599+0000","last_undegraded":"2024-05-09T02:18:21.184599+0000","last_fullsized":"2024-05-09T02:18:21.184599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177486+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:21.177486+0000","last_peered":"2024-05-09T02:18:21.177486+0000","last_clean":"2024-05-09T02:18:21.177486+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:21.177486+0000","last_undegraded":"2024-05-09T02:18:21.177486+0000","last_fullsized":"2024-05-09T02:18:21.177486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180192+0000","last_change":"2024-05-09T02:18:21.180192+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180192+0000","last_undegraded":"2024-05-09T02:18:21.180192+0000","last_fullsized":"2024-05-09T02:18:21.180192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182895+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:21.182895+0000","last_peered":"2024-05-09T02:18:21.182895+0000","last_clean":"2024-05-09T02:18:21.182895+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:21.182895+0000","last_undegraded":"2024-05-09T02:18:21.182895+0000","last_fullsized":"2024-05-09T02:18:21.182895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182644+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:21.182644+0000","last_peered":"2024-05-09T02:18:21.182644+0000","last_clean":"2024-05-09T02:18:21.182644+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:21.182644+0000","last_undegraded":"2024-05-09T02:18:21.182644+0000","last_fullsized":"2024-05-09T02:18:21.182644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.182384+0000","last_change":"2024-05-09T02:18:21.182384+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.182384+0000","last_undegraded":"2024-05-09T02:18:21.182384+0000","last_fullsized":"2024-05-09T02:18:21.182384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184844+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:21.184844+0000","last_peered":"2024-05-09T02:18:21.184844+0000","last_clean":"2024-05-09T02:18:21.184844+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:21.184844+0000","last_undegraded":"2024-05-09T02:18:21.184844+0000","last_fullsized":"2024-05-09T02:18:21.184844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183497+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:21.183497+0000","last_peered":"2024-05-09T02:18:21.183497+0000","last_clean":"2024-05-09T02:18:21.183497+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:21.183497+0000","last_undegraded":"2024-05-09T02:18:21.183497+0000","last_fullsized":"2024-05-09T02:18:21.183497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.182735+0000","last_change":"2024-05-09T02:18:21.182735+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.182735+0000","last_undegraded":"2024-05-09T02:18:21.182735+0000","last_fullsized":"2024-05-09T02:18:21.182735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177046+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:21.177046+0000","last_peered":"2024-05-09T02:18:21.177046+0000","last_clean":"2024-05-09T02:18:21.177046+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:21.177046+0000","last_undegraded":"2024-05-09T02:18:21.177046+0000","last_fullsized":"2024-05-09T02:18:21.177046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177670+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:21.177670+0000","last_peered":"2024-05-09T02:18:21.177670+0000","last_clean":"2024-05-09T02:18:21.177670+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:21.177670+0000","last_undegraded":"2024-05-09T02:18:21.177670+0000","last_fullsized":"2024-05-09T02:18:21.177670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181291+0000","last_change":"2024-05-09T02:18:21.181291+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181291+0000","last_undegraded":"2024-05-09T02:18:21.181291+0000","last_fullsized":"2024-05-09T02:18:21.181291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185090+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:21.185090+0000","last_peered":"2024-05-09T02:18:21.185090+0000","last_clean":"2024-05-09T02:18:21.185090+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:21.185090+0000","last_undegraded":"2024-05-09T02:18:21.185090+0000","last_fullsized":"2024-05-09T02:18:21.185090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183305+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:21.183305+0000","last_peered":"2024-05-09T02:18:21.183305+0000","last_clean":"2024-05-09T02:18:21.183305+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:21.183305+0000","last_undegraded":"2024-05-09T02:18:21.183305+0000","last_fullsized":"2024-05-09T02:18:21.183305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181082+0000","last_change":"2024-05-09T02:18:21.181082+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181082+0000","last_undegraded":"2024-05-09T02:18:21.181082+0000","last_fullsized":"2024-05-09T02:18:21.181082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.179310+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:21.179310+0000","last_peered":"2024-05-09T02:18:21.179310+0000","last_clean":"2024-05-09T02:18:21.179310+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:21.179310+0000","last_undegraded":"2024-05-09T02:18:21.179310+0000","last_fullsized":"2024-05-09T02:18:21.179310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181031+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:21.181031+0000","last_peered":"2024-05-09T02:18:21.181031+0000","last_clean":"2024-05-09T02:18:21.181031+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:21.181031+0000","last_undegraded":"2024-05-09T02:18:21.181031+0000","last_fullsized":"2024-05-09T02:18:21.181031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.176959+0000","last_change":"2024-05-09T02:18:21.176959+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.176959+0000","last_undegraded":"2024-05-09T02:18:21.176959+0000","last_fullsized":"2024-05-09T02:18:21.176959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177655+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:21.177655+0000","last_peered":"2024-05-09T02:18:21.177655+0000","last_clean":"2024-05-09T02:18:21.177655+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:21.177655+0000","last_undegraded":"2024-05-09T02:18:21.177655+0000","last_fullsized":"2024-05-09T02:18:21.177655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183009+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:21.183009+0000","last_peered":"2024-05-09T02:18:21.183009+0000","last_clean":"2024-05-09T02:18:21.183009+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:21.183009+0000","last_undegraded":"2024-05-09T02:18:21.183009+0000","last_fullsized":"2024-05-09T02:18:21.183009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.182220+0000","last_change":"2024-05-09T02:18:21.182220+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.182220+0000","last_undegraded":"2024-05-09T02:18:21.182220+0000","last_fullsized":"2024-05-09T02:18:21.182220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182824+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:21.182824+0000","last_peered":"2024-05-09T02:18:21.182824+0000","last_clean":"2024-05-09T02:18:21.182824+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:21.182824+0000","last_undegraded":"2024-05-09T02:18:21.182824+0000","last_fullsized":"2024-05-09T02:18:21.182824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184478+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:21.184478+0000","last_peered":"2024-05-09T02:18:21.184478+0000","last_clean":"2024-05-09T02:18:21.184478+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:21.184478+0000","last_undegraded":"2024-05-09T02:18:21.184478+0000","last_fullsized":"2024-05-09T02:18:21.184478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.182897+0000","last_change":"2024-05-09T02:18:21.182897+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.182897+0000","last_undegraded":"2024-05-09T02:18:21.182897+0000","last_fullsized":"2024-05-09T02:18:21.182897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180873+0000","last_change":"2024-05-09T02:18:21.180873+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180873+0000","last_undegraded":"2024-05-09T02:18:21.180873+0000","last_fullsized":"2024-05-09T02:18:21.180873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180215+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:21.180215+0000","last_peered":"2024-05-09T02:18:21.180215+0000","last_clean":"2024-05-09T02:18:21.180215+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:21.180215+0000","last_undegraded":"2024-05-09T02:18:21.180215+0000","last_fullsized":"2024-05-09T02:18:21.180215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182089+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:21.182089+0000","last_peered":"2024-05-09T02:18:21.182089+0000","last_clean":"2024-05-09T02:18:21.182089+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:21.182089+0000","last_undegraded":"2024-05-09T02:18:21.182089+0000","last_fullsized":"2024-05-09T02:18:21.182089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.181743+0000","last_change":"2024-05-09T02:18:21.181743+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.181743+0000","last_undegraded":"2024-05-09T02:18:21.181743+0000","last_fullsized":"2024-05-09T02:18:21.181743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183924+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:21.183924+0000","last_peered":"2024-05-09T02:18:21.183924+0000","last_clean":"2024-05-09T02:18:21.183924+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:21.183924+0000","last_undegraded":"2024-05-09T02:18:21.183924+0000","last_fullsized":"2024-05-09T02:18:21.183924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183870+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:21.183870+0000","last_peered":"2024-05-09T02:18:21.183870+0000","last_clean":"2024-05-09T02:18:21.183870+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:21.183870+0000","last_undegraded":"2024-05-09T02:18:21.183870+0000","last_fullsized":"2024-05-09T02:18:21.183870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183213+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:21.183213+0000","last_peered":"2024-05-09T02:18:21.183213+0000","last_clean":"2024-05-09T02:18:21.183213+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:21.183213+0000","last_undegraded":"2024-05-09T02:18:21.183213+0000","last_fullsized":"2024-05-09T02:18:21.183213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177546+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:21.177546+0000","last_peered":"2024-05-09T02:18:21.177546+0000","last_clean":"2024-05-09T02:18:21.177546+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:21.177546+0000","last_undegraded":"2024-05-09T02:18:21.177546+0000","last_fullsized":"2024-05-09T02:18:21.177546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.176919+0000","last_change":"2024-05-09T02:18:21.176919+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.176919+0000","last_undegraded":"2024-05-09T02:18:21.176919+0000","last_fullsized":"2024-05-09T02:18:21.176919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182838+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:21.182838+0000","last_peered":"2024-05-09T02:18:21.182838+0000","last_clean":"2024-05-09T02:18:21.182838+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:21.182838+0000","last_undegraded":"2024-05-09T02:18:21.182838+0000","last_fullsized":"2024-05-09T02:18:21.182838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.178983+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:21.178983+0000","last_peered":"2024-05-09T02:18:21.178983+0000","last_clean":"2024-05-09T02:18:21.178983+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:21.178983+0000","last_undegraded":"2024-05-09T02:18:21.178983+0000","last_fullsized":"2024-05-09T02:18:21.178983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-05-09T02:18:21.180670+0000","last_change":"2024-05-09T02:18:21.180670+0000","last_active":"2024-05-09T02:18:21.168013+0000","last_peered":"2024-05-09T02:18:21.168013+0000","last_clean":"2024-05-09T02:18:21.168013+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:21.180670+0000","last_undegraded":"2024-05-09T02:18:21.180670+0000","last_fullsized":"2024-05-09T02:18:21.180670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182777+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:21.182777+0000","last_peered":"2024-05-09T02:18:21.182777+0000","last_clean":"2024-05-09T02:18:21.182777+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:21.182777+0000","last_undegraded":"2024-05-09T02:18:21.182777+0000","last_fullsized":"2024-05-09T02:18:21.182777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177623+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:21.177623+0000","last_peered":"2024-05-09T02:18:21.177623+0000","last_clean":"2024-05-09T02:18:21.177623+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:21.177623+0000","last_undegraded":"2024-05-09T02:18:21.177623+0000","last_fullsized":"2024-05-09T02:18:21.177623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183409+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:21.183409+0000","last_peered":"2024-05-09T02:18:21.183409+0000","last_clean":"2024-05-09T02:18:21.183409+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:21.183409+0000","last_undegraded":"2024-05-09T02:18:21.183409+0000","last_fullsized":"2024-05-09T02:18:21.183409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177440+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:21.177440+0000","last_peered":"2024-05-09T02:18:21.177440+0000","last_clean":"2024-05-09T02:18:21.177440+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:21.177440+0000","last_undegraded":"2024-05-09T02:18:21.177440+0000","last_fullsized":"2024-05-09T02:18:21.177440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183597+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:21.183597+0000","last_peered":"2024-05-09T02:18:21.183597+0000","last_clean":"2024-05-09T02:18:21.183597+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:21.183597+0000","last_undegraded":"2024-05-09T02:18:21.183597+0000","last_fullsized":"2024-05-09T02:18:21.183597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180898+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:21.180898+0000","last_peered":"2024-05-09T02:18:21.180898+0000","last_clean":"2024-05-09T02:18:21.180898+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:21.180898+0000","last_undegraded":"2024-05-09T02:18:21.180898+0000","last_fullsized":"2024-05-09T02:18:21.180898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184087+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:21.184087+0000","last_peered":"2024-05-09T02:18:21.184087+0000","last_clean":"2024-05-09T02:18:21.184087+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:21.184087+0000","last_undegraded":"2024-05-09T02:18:21.184087+0000","last_fullsized":"2024-05-09T02:18:21.184087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182779+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:21.182779+0000","last_peered":"2024-05-09T02:18:21.182779+0000","last_clean":"2024-05-09T02:18:21.182779+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:21.182779+0000","last_undegraded":"2024-05-09T02:18:21.182779+0000","last_fullsized":"2024-05-09T02:18:21.182779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181972+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:21.181972+0000","last_peered":"2024-05-09T02:18:21.181972+0000","last_clean":"2024-05-09T02:18:21.181972+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:21.181972+0000","last_undegraded":"2024-05-09T02:18:21.181972+0000","last_fullsized":"2024-05-09T02:18:21.181972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183719+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:21.183719+0000","last_peered":"2024-05-09T02:18:21.183719+0000","last_clean":"2024-05-09T02:18:21.183719+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:21.183719+0000","last_undegraded":"2024-05-09T02:18:21.183719+0000","last_fullsized":"2024-05-09T02:18:21.183719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183367+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:21.183367+0000","last_peered":"2024-05-09T02:18:21.183367+0000","last_clean":"2024-05-09T02:18:21.183367+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:21.183367+0000","last_undegraded":"2024-05-09T02:18:21.183367+0000","last_fullsized":"2024-05-09T02:18:21.183367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177331+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:21.177331+0000","last_peered":"2024-05-09T02:18:21.177331+0000","last_clean":"2024-05-09T02:18:21.177331+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:21.177331+0000","last_undegraded":"2024-05-09T02:18:21.177331+0000","last_fullsized":"2024-05-09T02:18:21.177331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183216+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:21.183216+0000","last_peered":"2024-05-09T02:18:21.183216+0000","last_clean":"2024-05-09T02:18:21.183216+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:21.183216+0000","last_undegraded":"2024-05-09T02:18:21.183216+0000","last_fullsized":"2024-05-09T02:18:21.183216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185425+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:21.185425+0000","last_peered":"2024-05-09T02:18:21.185425+0000","last_clean":"2024-05-09T02:18:21.185425+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:21.185425+0000","last_undegraded":"2024-05-09T02:18:21.185425+0000","last_fullsized":"2024-05-09T02:18:21.185425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.178305+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:21.178305+0000","last_peered":"2024-05-09T02:18:21.178305+0000","last_clean":"2024-05-09T02:18:21.178305+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:21.178305+0000","last_undegraded":"2024-05-09T02:18:21.178305+0000","last_fullsized":"2024-05-09T02:18:21.178305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183161+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:21.183161+0000","last_peered":"2024-05-09T02:18:21.183161+0000","last_clean":"2024-05-09T02:18:21.183161+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:21.183161+0000","last_undegraded":"2024-05-09T02:18:21.183161+0000","last_fullsized":"2024-05-09T02:18:21.183161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.181841+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:21.181841+0000","last_peered":"2024-05-09T02:18:21.181841+0000","last_clean":"2024-05-09T02:18:21.181841+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:21.181841+0000","last_undegraded":"2024-05-09T02:18:21.181841+0000","last_fullsized":"2024-05-09T02:18:21.181841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180352+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:21.180352+0000","last_peered":"2024-05-09T02:18:21.180352+0000","last_clean":"2024-05-09T02:18:21.180352+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:21.180352+0000","last_undegraded":"2024-05-09T02:18:21.180352+0000","last_fullsized":"2024-05-09T02:18:21.180352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.176958+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:21.176958+0000","last_peered":"2024-05-09T02:18:21.176958+0000","last_clean":"2024-05-09T02:18:21.176958+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:21.176958+0000","last_undegraded":"2024-05-09T02:18:21.176958+0000","last_fullsized":"2024-05-09T02:18:21.176958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182277+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:21.182277+0000","last_peered":"2024-05-09T02:18:21.182277+0000","last_clean":"2024-05-09T02:18:21.182277+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:21.182277+0000","last_undegraded":"2024-05-09T02:18:21.182277+0000","last_fullsized":"2024-05-09T02:18:21.182277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.179216+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:21.179216+0000","last_peered":"2024-05-09T02:18:21.179216+0000","last_clean":"2024-05-09T02:18:21.179216+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:21.179216+0000","last_undegraded":"2024-05-09T02:18:21.179216+0000","last_fullsized":"2024-05-09T02:18:21.179216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183277+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:21.183277+0000","last_peered":"2024-05-09T02:18:21.183277+0000","last_clean":"2024-05-09T02:18:21.183277+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:21.183277+0000","last_undegraded":"2024-05-09T02:18:21.183277+0000","last_fullsized":"2024-05-09T02:18:21.183277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183970+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:21.183970+0000","last_peered":"2024-05-09T02:18:21.183970+0000","last_clean":"2024-05-09T02:18:21.183970+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:21.183970+0000","last_undegraded":"2024-05-09T02:18:21.183970+0000","last_fullsized":"2024-05-09T02:18:21.183970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185346+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:21.185346+0000","last_peered":"2024-05-09T02:18:21.185346+0000","last_clean":"2024-05-09T02:18:21.185346+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:21.185346+0000","last_undegraded":"2024-05-09T02:18:21.185346+0000","last_fullsized":"2024-05-09T02:18:21.185346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183770+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:21.183770+0000","last_peered":"2024-05-09T02:18:21.183770+0000","last_clean":"2024-05-09T02:18:21.183770+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:21.183770+0000","last_undegraded":"2024-05-09T02:18:21.183770+0000","last_fullsized":"2024-05-09T02:18:21.183770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184546+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:21.184546+0000","last_peered":"2024-05-09T02:18:21.184546+0000","last_clean":"2024-05-09T02:18:21.184546+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:21.184546+0000","last_undegraded":"2024-05-09T02:18:21.184546+0000","last_fullsized":"2024-05-09T02:18:21.184546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.183261+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:21.183261+0000","last_peered":"2024-05-09T02:18:21.183261+0000","last_clean":"2024-05-09T02:18:21.183261+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:21.183261+0000","last_undegraded":"2024-05-09T02:18:21.183261+0000","last_fullsized":"2024-05-09T02:18:21.183261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.184841+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:21.184841+0000","last_peered":"2024-05-09T02:18:21.184841+0000","last_clean":"2024-05-09T02:18:21.184841+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:21.184841+0000","last_undegraded":"2024-05-09T02:18:21.184841+0000","last_fullsized":"2024-05-09T02:18:21.184841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.182413+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:21.182413+0000","last_peered":"2024-05-09T02:18:21.182413+0000","last_clean":"2024-05-09T02:18:21.182413+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:21.182413+0000","last_undegraded":"2024-05-09T02:18:21.182413+0000","last_fullsized":"2024-05-09T02:18:21.182413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.177046+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:21.177046+0000","last_peered":"2024-05-09T02:18:21.177046+0000","last_clean":"2024-05-09T02:18:21.177046+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:21.177046+0000","last_undegraded":"2024-05-09T02:18:21.177046+0000","last_fullsized":"2024-05-09T02:18:21.177046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.180162+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:21.180162+0000","last_peered":"2024-05-09T02:18:21.180162+0000","last_clean":"2024-05-09T02:18:21.180162+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:21.180162+0000","last_undegraded":"2024-05-09T02:18:21.180162+0000","last_fullsized":"2024-05-09T02:18:21.180162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T02:18:22.174035+0000","last_change":"2024-05-09T02:18:22.174035+0000","last_active":"2024-05-09T02:18:22.174035+0000","last_peered":"2024-05-09T02:18:22.174035+0000","last_clean":"2024-05-09T02:18:22.174035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T02:18:22.174035+0000","last_undegraded":"2024-05-09T02:18:22.174035+0000","last_fullsized":"2024-05-09T02:18:22.174035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-09T02:18:21.185297+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:21.185297+0000","last_peered":"2024-05-09T02:18:21.185297+0000","last_clean":"2024-05-09T02:18:21.185297+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:21.185297+0000","last_undegraded":"2024-05-09T02:18:21.185297+0000","last_fullsized":"2024-05-09T02:18:21.185297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":83776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":82290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":82164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":673170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:28.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.456+0000 7fe56f75e640 1 Processor -- start 2024-05-09T02:18:28.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.457+0000 7fe56f75e640 1 -- start start 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56f75e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 0x7fe56815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56f75e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe568158ae0 con 0x7fe5680c96c0 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56f75e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe568155570 con 0x7fe568155160 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56f75e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe568157ed0 con 0x7fe5680c9ad0 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56ccf9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe5680c96c0 0x7fe56815b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44086/0 (socket says 172.21.15.46:44086) 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56ccf9640 1 -- 172.21.15.46:0/2166125427 learned_addr learned my addr 172.21.15.46:0/2166125427 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193311981 0 0) 0x7fe568158ae0 con 0x7fe5680c96c0 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe554003520 con 0x7fe5680c96c0 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.458+0000 7fe56dcfb640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 0x7fe56815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2507199140 0 0) 0x7fe554003520 con 0x7fe5680c96c0 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 msgr2=0x7fe56815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 0x7fe56815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 >> v1:172.21.15.107:6789/0 conn(0x7fe568155160 legacy=0x7fe5680c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5681581b0 con 0x7fe5680c96c0 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7fe5580016f0 con 0x7fe5680c96c0 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 >> v1:172.21.15.46:6789/0 conn(0x7fe5680c96c0 legacy=0x7fe56815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe554003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 0x7fe554004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe554004e60 0x7fe554005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe568157ed0 con 0x7fe554003a30 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe55400bcc0 con 0x7fe554004e60 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe55400bec0 con 0x7fe5680c9ad0 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe554003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56ccf9640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 0x7fe554004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56dcfb640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe554004e60 0x7fe554005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 msgr2=0x7fe554004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5680c9ad0 0x7fe554004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe554004e60 msgr2=0x7fe554005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe554004e60 0x7fe554005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.459+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2166125427 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554003520 con 0x7fe554003a30 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.460+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe554003ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c33b0 tx=0x7fe554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90c4c61c8a80bed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.460+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5640013b0 con 0x7fe554003a30 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.460+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5640052d0 con 0x7fe554003a30 2024-05-09T02:18:28.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.460+0000 7fe55ffff640 1 -- 172.21.15.46:0/2166125427 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56402aa70 con 0x7fe554003a30 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56f75e640 1 -- 172.21.15.46:0/2166125427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 msgr2=0x7fe554003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2166125427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe554003ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c33b0 tx=0x7fe554005830 comp rx=0 tx=0).stop 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56dcfb640 1 -- 172.21.15.46:0/2166125427 reap_dead start 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56f75e640 1 -- 172.21.15.46:0/2166125427 shutdown_connections 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56f75e640 1 -- 172.21.15.46:0/2166125427 >> 172.21.15.46:0/2166125427 conn(0x7fe5680aebe0 msgr2=0x7fe5680aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56f75e640 1 -- 172.21.15.46:0/2166125427 shutdown_connections 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.461+0000 7fe56f75e640 1 -- 172.21.15.46:0/2166125427 wait complete. 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.462+0000 7fe56f75e640 1 Processor -- start 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.463+0000 7fe56f75e640 1 -- start start 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56f75e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe5681edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56f75e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe568148410 0x7fe56814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56f75e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5681ee100 0x7fe56814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56f75e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe5680c8670 con 0x7fe554003a30 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56f75e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe568158770 con 0x7fe568148410 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56f75e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5680c9ee0 con 0x7fe5681ee100 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe5681edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe5681edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35922/0 (socket says 172.21.15.46:35922) 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2217800244 learned_addr learned my addr 172.21.15.46:0/2217800244 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56dcfb640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5681ee100 0x7fe56814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56ccf9640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe568148410 0x7fe56814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5681ee100 msgr2=0x7fe56814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5681ee100 0x7fe56814bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe568148410 msgr2=0x7fe56814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe568148410 0x7fe56814b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 -- 172.21.15.46:0/2217800244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5680cb550 con 0x7fe554003a30 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe56d4fa640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe5681edbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe564005040 tx=0x7fe564001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe564037040 con 0x7fe554003a30 2024-05-09T02:18:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.464+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe564005480 con 0x7fe554003a30 2024-05-09T02:18:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.465+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5680ccff0 con 0x7fe554003a30 2024-05-09T02:18:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.465+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5640013b0 con 0x7fe554003a30 2024-05-09T02:18:28.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.465+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5680cd5b0 con 0x7fe554003a30 2024-05-09T02:18:28.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.466+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5680cb720 con 0x7fe554003a30 2024-05-09T02:18:28.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.467+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe564044020 con 0x7fe554003a30 2024-05-09T02:18:28.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.467+0000 7fe55dffb640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe54c0762d0 0x7fe54c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.467+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fe5640b8060 con 0x7fe554003a30 2024-05-09T02:18:28.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.467+0000 7fe56ccf9640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe54c0762d0 0x7fe54c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.468+0000 7fe56ccf9640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe54c0762d0 0x7fe54c0787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe558001240 tx=0x7fe558009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.471+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe56404f3e0 con 0x7fe554003a30 2024-05-09T02:18:28.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.657+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe56806a330 con 0x7fe54c0762d0 2024-05-09T02:18:28.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.668+0000 7fe55dffb640 1 -- 172.21.15.46:0/2217800244 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490408 (secure 0 0 0) 0x7fe56806a330 con 0x7fe54c0762d0 2024-05-09T02:18:28.676 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:28.679 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.672+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe54c0762d0 msgr2=0x7fe54c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.672+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe54c0762d0 0x7fe54c0787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe558001240 tx=0x7fe558009040 comp rx=0 tx=0).stop 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.672+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 msgr2=0x7fe5681edbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.672+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe5681edbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe564005040 tx=0x7fe564001120 comp rx=0 tx=0).stop 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 shutdown_connections 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe54c0762d0 0x7fe54c0787e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5681ee100 0x7fe56814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe568148410 0x7fe56814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 --2- 172.21.15.46:0/2217800244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe554003a30 0x7fe5681edbc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 >> 172.21.15.46:0/2217800244 conn(0x7fe5680aebe0 msgr2=0x7fe568157390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:28.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 shutdown_connections 2024-05-09T02:18:28.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.673+0000 7fe56f75e640 1 -- 172.21.15.46:0/2217800244 wait complete. 2024-05-09T02:18:28.686 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-09T02:18:28.501508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":354,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2021832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.323734"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199693+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:18:24.199693+0000","last_peered":"2024-05-09T02:18:24.199693+0000","last_clean":"2024-05-09T02:18:24.199693+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:18:24.199693+0000","last_undegraded":"2024-05-09T02:18:24.199693+0000","last_fullsized":"2024-05-09T02:18:24.199693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194809+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:24.194809+0000","last_peered":"2024-05-09T02:18:24.194809+0000","last_clean":"2024-05-09T02:18:24.194809+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:24.194809+0000","last_undegraded":"2024-05-09T02:18:24.194809+0000","last_fullsized":"2024-05-09T02:18:24.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200366+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:24.200366+0000","last_peered":"2024-05-09T02:18:24.200366+0000","last_clean":"2024-05-09T02:18:24.200366+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:24.200366+0000","last_undegraded":"2024-05-09T02:18:24.200366+0000","last_fullsized":"2024-05-09T02:18:24.200366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199237+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:18:24.199237+0000","last_peered":"2024-05-09T02:18:24.199237+0000","last_clean":"2024-05-09T02:18:24.199237+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:18:24.199237+0000","last_undegraded":"2024-05-09T02:18:24.199237+0000","last_fullsized":"2024-05-09T02:18:24.199237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212516+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:18:24.212516+0000","last_peered":"2024-05-09T02:18:24.212516+0000","last_clean":"2024-05-09T02:18:24.212516+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:18:24.212516+0000","last_undegraded":"2024-05-09T02:18:24.212516+0000","last_fullsized":"2024-05-09T02:18:24.212516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200409+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:24.200409+0000","last_peered":"2024-05-09T02:18:24.200409+0000","last_clean":"2024-05-09T02:18:24.200409+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:24.200409+0000","last_undegraded":"2024-05-09T02:18:24.200409+0000","last_fullsized":"2024-05-09T02:18:24.200409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194737+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:24.194737+0000","last_peered":"2024-05-09T02:18:24.194737+0000","last_clean":"2024-05-09T02:18:24.194737+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:24.194737+0000","last_undegraded":"2024-05-09T02:18:24.194737+0000","last_fullsized":"2024-05-09T02:18:24.194737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199565+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:18:24.199565+0000","last_peered":"2024-05-09T02:18:24.199565+0000","last_clean":"2024-05-09T02:18:24.199565+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:18:24.199565+0000","last_undegraded":"2024-05-09T02:18:24.199565+0000","last_fullsized":"2024-05-09T02:18:24.199565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117680+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:25.117680+0000","last_peered":"2024-05-09T02:18:25.117680+0000","last_clean":"2024-05-09T02:18:25.117680+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:25.117680+0000","last_undegraded":"2024-05-09T02:18:25.117680+0000","last_fullsized":"2024-05-09T02:18:25.117680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545151+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:24.545151+0000","last_peered":"2024-05-09T02:18:24.545151+0000","last_clean":"2024-05-09T02:18:24.545151+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:24.545151+0000","last_undegraded":"2024-05-09T02:18:24.545151+0000","last_fullsized":"2024-05-09T02:18:24.545151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199967+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:18:24.199967+0000","last_peered":"2024-05-09T02:18:24.199967+0000","last_clean":"2024-05-09T02:18:24.199967+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:18:24.199967+0000","last_undegraded":"2024-05-09T02:18:24.199967+0000","last_fullsized":"2024-05-09T02:18:24.199967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544707+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:18:24.544707+0000","last_peered":"2024-05-09T02:18:24.544707+0000","last_clean":"2024-05-09T02:18:24.544707+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:18:24.544707+0000","last_undegraded":"2024-05-09T02:18:24.544707+0000","last_fullsized":"2024-05-09T02:18:24.544707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117346+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:25.117346+0000","last_peered":"2024-05-09T02:18:25.117346+0000","last_clean":"2024-05-09T02:18:25.117346+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:25.117346+0000","last_undegraded":"2024-05-09T02:18:25.117346+0000","last_fullsized":"2024-05-09T02:18:25.117346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545312+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:24.545312+0000","last_peered":"2024-05-09T02:18:24.545312+0000","last_clean":"2024-05-09T02:18:24.545312+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:24.545312+0000","last_undegraded":"2024-05-09T02:18:24.545312+0000","last_fullsized":"2024-05-09T02:18:24.545312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199878+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:18:24.199878+0000","last_peered":"2024-05-09T02:18:24.199878+0000","last_clean":"2024-05-09T02:18:24.199878+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:18:24.199878+0000","last_undegraded":"2024-05-09T02:18:24.199878+0000","last_fullsized":"2024-05-09T02:18:24.199878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213230+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:18:24.213230+0000","last_peered":"2024-05-09T02:18:24.213230+0000","last_clean":"2024-05-09T02:18:24.213230+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:18:24.213230+0000","last_undegraded":"2024-05-09T02:18:24.213230+0000","last_fullsized":"2024-05-09T02:18:24.213230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116725+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:25.116725+0000","last_peered":"2024-05-09T02:18:25.116725+0000","last_clean":"2024-05-09T02:18:25.116725+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:25.116725+0000","last_undegraded":"2024-05-09T02:18:25.116725+0000","last_fullsized":"2024-05-09T02:18:25.116725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117491+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:25.117491+0000","last_peered":"2024-05-09T02:18:25.117491+0000","last_clean":"2024-05-09T02:18:25.117491+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:25.117491+0000","last_undegraded":"2024-05-09T02:18:25.117491+0000","last_fullsized":"2024-05-09T02:18:25.117491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200557+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:18:24.200557+0000","last_peered":"2024-05-09T02:18:24.200557+0000","last_clean":"2024-05-09T02:18:24.200557+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:18:24.200557+0000","last_undegraded":"2024-05-09T02:18:24.200557+0000","last_fullsized":"2024-05-09T02:18:24.200557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117023+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:18:25.117023+0000","last_peered":"2024-05-09T02:18:25.117023+0000","last_clean":"2024-05-09T02:18:25.117023+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:18:25.117023+0000","last_undegraded":"2024-05-09T02:18:25.117023+0000","last_fullsized":"2024-05-09T02:18:25.117023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199802+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:24.199802+0000","last_peered":"2024-05-09T02:18:24.199802+0000","last_clean":"2024-05-09T02:18:24.199802+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:24.199802+0000","last_undegraded":"2024-05-09T02:18:24.199802+0000","last_fullsized":"2024-05-09T02:18:24.199802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212930+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:24.212930+0000","last_peered":"2024-05-09T02:18:24.212930+0000","last_clean":"2024-05-09T02:18:24.212930+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:24.212930+0000","last_undegraded":"2024-05-09T02:18:24.212930+0000","last_fullsized":"2024-05-09T02:18:24.212930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200551+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:18:24.200551+0000","last_peered":"2024-05-09T02:18:24.200551+0000","last_clean":"2024-05-09T02:18:24.200551+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:18:24.200551+0000","last_undegraded":"2024-05-09T02:18:24.200551+0000","last_fullsized":"2024-05-09T02:18:24.200551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200686+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:18:24.200686+0000","last_peered":"2024-05-09T02:18:24.200686+0000","last_clean":"2024-05-09T02:18:24.200686+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:18:24.200686+0000","last_undegraded":"2024-05-09T02:18:24.200686+0000","last_fullsized":"2024-05-09T02:18:24.200686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200229+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:24.200229+0000","last_peered":"2024-05-09T02:18:24.200229+0000","last_clean":"2024-05-09T02:18:24.200229+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:24.200229+0000","last_undegraded":"2024-05-09T02:18:24.200229+0000","last_fullsized":"2024-05-09T02:18:24.200229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212619+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:24.212619+0000","last_peered":"2024-05-09T02:18:24.212619+0000","last_clean":"2024-05-09T02:18:24.212619+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:24.212619+0000","last_undegraded":"2024-05-09T02:18:24.212619+0000","last_fullsized":"2024-05-09T02:18:24.212619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213272+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:18:24.213272+0000","last_peered":"2024-05-09T02:18:24.213272+0000","last_clean":"2024-05-09T02:18:24.213272+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:18:24.213272+0000","last_undegraded":"2024-05-09T02:18:24.213272+0000","last_fullsized":"2024-05-09T02:18:24.213272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545447+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:18:24.545447+0000","last_peered":"2024-05-09T02:18:24.545447+0000","last_clean":"2024-05-09T02:18:24.545447+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:18:24.545447+0000","last_undegraded":"2024-05-09T02:18:24.545447+0000","last_fullsized":"2024-05-09T02:18:24.545447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200114+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:24.200114+0000","last_peered":"2024-05-09T02:18:24.200114+0000","last_clean":"2024-05-09T02:18:24.200114+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:24.200114+0000","last_undegraded":"2024-05-09T02:18:24.200114+0000","last_fullsized":"2024-05-09T02:18:24.200114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117121+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:25.117121+0000","last_peered":"2024-05-09T02:18:25.117121+0000","last_clean":"2024-05-09T02:18:25.117121+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:25.117121+0000","last_undegraded":"2024-05-09T02:18:25.117121+0000","last_fullsized":"2024-05-09T02:18:25.117121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200694+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:18:24.200694+0000","last_peered":"2024-05-09T02:18:24.200694+0000","last_clean":"2024-05-09T02:18:24.200694+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:18:24.200694+0000","last_undegraded":"2024-05-09T02:18:24.200694+0000","last_fullsized":"2024-05-09T02:18:24.200694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199079+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:18:24.199079+0000","last_peered":"2024-05-09T02:18:24.199079+0000","last_clean":"2024-05-09T02:18:24.199079+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:18:24.199079+0000","last_undegraded":"2024-05-09T02:18:24.199079+0000","last_fullsized":"2024-05-09T02:18:24.199079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194623+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:24.194623+0000","last_peered":"2024-05-09T02:18:24.194623+0000","last_clean":"2024-05-09T02:18:24.194623+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:24.194623+0000","last_undegraded":"2024-05-09T02:18:24.194623+0000","last_fullsized":"2024-05-09T02:18:24.194623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118230+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:25.118230+0000","last_peered":"2024-05-09T02:18:25.118230+0000","last_clean":"2024-05-09T02:18:25.118230+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:25.118230+0000","last_undegraded":"2024-05-09T02:18:25.118230+0000","last_fullsized":"2024-05-09T02:18:25.118230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199762+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:18:24.199762+0000","last_peered":"2024-05-09T02:18:24.199762+0000","last_clean":"2024-05-09T02:18:24.199762+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:18:24.199762+0000","last_undegraded":"2024-05-09T02:18:24.199762+0000","last_fullsized":"2024-05-09T02:18:24.199762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199671+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:18:24.199671+0000","last_peered":"2024-05-09T02:18:24.199671+0000","last_clean":"2024-05-09T02:18:24.199671+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:18:24.199671+0000","last_undegraded":"2024-05-09T02:18:24.199671+0000","last_fullsized":"2024-05-09T02:18:24.199671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200278+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:24.200278+0000","last_peered":"2024-05-09T02:18:24.200278+0000","last_clean":"2024-05-09T02:18:24.200278+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:24.200278+0000","last_undegraded":"2024-05-09T02:18:24.200278+0000","last_fullsized":"2024-05-09T02:18:24.200278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213294+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:24.213294+0000","last_peered":"2024-05-09T02:18:24.213294+0000","last_clean":"2024-05-09T02:18:24.213294+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:24.213294+0000","last_undegraded":"2024-05-09T02:18:24.213294+0000","last_fullsized":"2024-05-09T02:18:24.213294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199015+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:18:24.199015+0000","last_peered":"2024-05-09T02:18:24.199015+0000","last_clean":"2024-05-09T02:18:24.199015+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:18:24.199015+0000","last_undegraded":"2024-05-09T02:18:24.199015+0000","last_fullsized":"2024-05-09T02:18:24.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116593+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:18:25.116593+0000","last_peered":"2024-05-09T02:18:25.116593+0000","last_clean":"2024-05-09T02:18:25.116593+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:18:25.116593+0000","last_undegraded":"2024-05-09T02:18:25.116593+0000","last_fullsized":"2024-05-09T02:18:25.116593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213438+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:24.213438+0000","last_peered":"2024-05-09T02:18:24.213438+0000","last_clean":"2024-05-09T02:18:24.213438+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:24.213438+0000","last_undegraded":"2024-05-09T02:18:24.213438+0000","last_fullsized":"2024-05-09T02:18:24.213438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117923+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:25.117923+0000","last_peered":"2024-05-09T02:18:25.117923+0000","last_clean":"2024-05-09T02:18:25.117923+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:25.117923+0000","last_undegraded":"2024-05-09T02:18:25.117923+0000","last_fullsized":"2024-05-09T02:18:25.117923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194343+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:18:24.194343+0000","last_peered":"2024-05-09T02:18:24.194343+0000","last_clean":"2024-05-09T02:18:24.194343+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:18:24.194343+0000","last_undegraded":"2024-05-09T02:18:24.194343+0000","last_fullsized":"2024-05-09T02:18:24.194343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194795+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:18:24.194795+0000","last_peered":"2024-05-09T02:18:24.194795+0000","last_clean":"2024-05-09T02:18:24.194795+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:18:24.194795+0000","last_undegraded":"2024-05-09T02:18:24.194795+0000","last_fullsized":"2024-05-09T02:18:24.194795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545446+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:24.545446+0000","last_peered":"2024-05-09T02:18:24.545446+0000","last_clean":"2024-05-09T02:18:24.545446+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:24.545446+0000","last_undegraded":"2024-05-09T02:18:24.545446+0000","last_fullsized":"2024-05-09T02:18:24.545446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213541+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:24.213541+0000","last_peered":"2024-05-09T02:18:24.213541+0000","last_clean":"2024-05-09T02:18:24.213541+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:24.213541+0000","last_undegraded":"2024-05-09T02:18:24.213541+0000","last_fullsized":"2024-05-09T02:18:24.213541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212698+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:18:24.212698+0000","last_peered":"2024-05-09T02:18:24.212698+0000","last_clean":"2024-05-09T02:18:24.212698+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:18:24.212698+0000","last_undegraded":"2024-05-09T02:18:24.212698+0000","last_fullsized":"2024-05-09T02:18:24.212698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194413+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:18:24.194413+0000","last_peered":"2024-05-09T02:18:24.194413+0000","last_clean":"2024-05-09T02:18:24.194413+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:18:24.194413+0000","last_undegraded":"2024-05-09T02:18:24.194413+0000","last_fullsized":"2024-05-09T02:18:24.194413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200494+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:24.200494+0000","last_peered":"2024-05-09T02:18:24.200494+0000","last_clean":"2024-05-09T02:18:24.200494+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:24.200494+0000","last_undegraded":"2024-05-09T02:18:24.200494+0000","last_fullsized":"2024-05-09T02:18:24.200494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545086+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:24.545086+0000","last_peered":"2024-05-09T02:18:24.545086+0000","last_clean":"2024-05-09T02:18:24.545086+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:24.545086+0000","last_undegraded":"2024-05-09T02:18:24.545086+0000","last_fullsized":"2024-05-09T02:18:24.545086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213293+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:18:24.213293+0000","last_peered":"2024-05-09T02:18:24.213293+0000","last_clean":"2024-05-09T02:18:24.213293+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:18:24.213293+0000","last_undegraded":"2024-05-09T02:18:24.213293+0000","last_fullsized":"2024-05-09T02:18:24.213293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117109+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:18:25.117109+0000","last_peered":"2024-05-09T02:18:25.117109+0000","last_clean":"2024-05-09T02:18:25.117109+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:18:25.117109+0000","last_undegraded":"2024-05-09T02:18:25.117109+0000","last_fullsized":"2024-05-09T02:18:25.117109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212497+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:24.212497+0000","last_peered":"2024-05-09T02:18:24.212497+0000","last_clean":"2024-05-09T02:18:24.212497+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:24.212497+0000","last_undegraded":"2024-05-09T02:18:24.212497+0000","last_fullsized":"2024-05-09T02:18:24.212497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116723+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:25.116723+0000","last_peered":"2024-05-09T02:18:25.116723+0000","last_clean":"2024-05-09T02:18:25.116723+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:25.116723+0000","last_undegraded":"2024-05-09T02:18:25.116723+0000","last_fullsized":"2024-05-09T02:18:25.116723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213274+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:18:24.213274+0000","last_peered":"2024-05-09T02:18:24.213274+0000","last_clean":"2024-05-09T02:18:24.213274+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:18:24.213274+0000","last_undegraded":"2024-05-09T02:18:24.213274+0000","last_fullsized":"2024-05-09T02:18:24.213274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545598+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:18:24.545598+0000","last_peered":"2024-05-09T02:18:24.545598+0000","last_clean":"2024-05-09T02:18:24.545598+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:18:24.545598+0000","last_undegraded":"2024-05-09T02:18:24.545598+0000","last_fullsized":"2024-05-09T02:18:24.545598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193902+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:24.193902+0000","last_peered":"2024-05-09T02:18:24.193902+0000","last_clean":"2024-05-09T02:18:24.193902+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:24.193902+0000","last_undegraded":"2024-05-09T02:18:24.193902+0000","last_fullsized":"2024-05-09T02:18:24.193902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117239+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:25.117239+0000","last_peered":"2024-05-09T02:18:25.117239+0000","last_clean":"2024-05-09T02:18:25.117239+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:25.117239+0000","last_undegraded":"2024-05-09T02:18:25.117239+0000","last_fullsized":"2024-05-09T02:18:25.117239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194546+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:18:24.194546+0000","last_peered":"2024-05-09T02:18:24.194546+0000","last_clean":"2024-05-09T02:18:24.194546+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:18:24.194546+0000","last_undegraded":"2024-05-09T02:18:24.194546+0000","last_fullsized":"2024-05-09T02:18:24.194546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117439+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:18:25.117439+0000","last_peered":"2024-05-09T02:18:25.117439+0000","last_clean":"2024-05-09T02:18:25.117439+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:18:25.117439+0000","last_undegraded":"2024-05-09T02:18:25.117439+0000","last_fullsized":"2024-05-09T02:18:25.117439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199819+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:24.199819+0000","last_peered":"2024-05-09T02:18:24.199819+0000","last_clean":"2024-05-09T02:18:24.199819+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:24.199819+0000","last_undegraded":"2024-05-09T02:18:24.199819+0000","last_fullsized":"2024-05-09T02:18:24.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544691+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:24.544691+0000","last_peered":"2024-05-09T02:18:24.544691+0000","last_clean":"2024-05-09T02:18:24.544691+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:24.544691+0000","last_undegraded":"2024-05-09T02:18:24.544691+0000","last_fullsized":"2024-05-09T02:18:24.544691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117558+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:25.117558+0000","last_peered":"2024-05-09T02:18:25.117558+0000","last_clean":"2024-05-09T02:18:25.117558+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:25.117558+0000","last_undegraded":"2024-05-09T02:18:25.117558+0000","last_fullsized":"2024-05-09T02:18:25.117558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117570+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:25.117570+0000","last_peered":"2024-05-09T02:18:25.117570+0000","last_clean":"2024-05-09T02:18:25.117570+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:25.117570+0000","last_undegraded":"2024-05-09T02:18:25.117570+0000","last_fullsized":"2024-05-09T02:18:25.117570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117008+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:25.117008+0000","last_peered":"2024-05-09T02:18:25.117008+0000","last_clean":"2024-05-09T02:18:25.117008+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:25.117008+0000","last_undegraded":"2024-05-09T02:18:25.117008+0000","last_fullsized":"2024-05-09T02:18:25.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116656+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:18:25.116656+0000","last_peered":"2024-05-09T02:18:25.116656+0000","last_clean":"2024-05-09T02:18:25.116656+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:18:25.116656+0000","last_undegraded":"2024-05-09T02:18:25.116656+0000","last_fullsized":"2024-05-09T02:18:25.116656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545429+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:24.545429+0000","last_peered":"2024-05-09T02:18:24.545429+0000","last_clean":"2024-05-09T02:18:24.545429+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:24.545429+0000","last_undegraded":"2024-05-09T02:18:24.545429+0000","last_fullsized":"2024-05-09T02:18:24.545429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213599+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:24.213599+0000","last_peered":"2024-05-09T02:18:24.213599+0000","last_clean":"2024-05-09T02:18:24.213599+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:24.213599+0000","last_undegraded":"2024-05-09T02:18:24.213599+0000","last_fullsized":"2024-05-09T02:18:24.213599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194066+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:18:24.194066+0000","last_peered":"2024-05-09T02:18:24.194066+0000","last_clean":"2024-05-09T02:18:24.194066+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:18:24.194066+0000","last_undegraded":"2024-05-09T02:18:24.194066+0000","last_fullsized":"2024-05-09T02:18:24.194066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118369+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:25.118369+0000","last_peered":"2024-05-09T02:18:25.118369+0000","last_clean":"2024-05-09T02:18:25.118369+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:25.118369+0000","last_undegraded":"2024-05-09T02:18:25.118369+0000","last_fullsized":"2024-05-09T02:18:25.118369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117107+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:25.117107+0000","last_peered":"2024-05-09T02:18:25.117107+0000","last_clean":"2024-05-09T02:18:25.117107+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:25.117107+0000","last_undegraded":"2024-05-09T02:18:25.117107+0000","last_fullsized":"2024-05-09T02:18:25.117107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544340+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:18:24.544340+0000","last_peered":"2024-05-09T02:18:24.544340+0000","last_clean":"2024-05-09T02:18:24.544340+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:18:24.544340+0000","last_undegraded":"2024-05-09T02:18:24.544340+0000","last_fullsized":"2024-05-09T02:18:24.544340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116753+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:18:25.116753+0000","last_peered":"2024-05-09T02:18:25.116753+0000","last_clean":"2024-05-09T02:18:25.116753+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:18:25.116753+0000","last_undegraded":"2024-05-09T02:18:25.116753+0000","last_fullsized":"2024-05-09T02:18:25.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117832+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:25.117832+0000","last_peered":"2024-05-09T02:18:25.117832+0000","last_clean":"2024-05-09T02:18:25.117832+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:25.117832+0000","last_undegraded":"2024-05-09T02:18:25.117832+0000","last_fullsized":"2024-05-09T02:18:25.117832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201043+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:24.201043+0000","last_peered":"2024-05-09T02:18:24.201043+0000","last_clean":"2024-05-09T02:18:24.201043+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:24.201043+0000","last_undegraded":"2024-05-09T02:18:24.201043+0000","last_fullsized":"2024-05-09T02:18:24.201043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199591+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:18:24.199591+0000","last_peered":"2024-05-09T02:18:24.199591+0000","last_clean":"2024-05-09T02:18:24.199591+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:18:24.199591+0000","last_undegraded":"2024-05-09T02:18:24.199591+0000","last_fullsized":"2024-05-09T02:18:24.199591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200090+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:18:24.200090+0000","last_peered":"2024-05-09T02:18:24.200090+0000","last_clean":"2024-05-09T02:18:24.200090+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:18:24.200090+0000","last_undegraded":"2024-05-09T02:18:24.200090+0000","last_fullsized":"2024-05-09T02:18:24.200090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116454+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:25.116454+0000","last_peered":"2024-05-09T02:18:25.116454+0000","last_clean":"2024-05-09T02:18:25.116454+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:25.116454+0000","last_undegraded":"2024-05-09T02:18:25.116454+0000","last_fullsized":"2024-05-09T02:18:25.116454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194601+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:18:24.194601+0000","last_peered":"2024-05-09T02:18:24.194601+0000","last_clean":"2024-05-09T02:18:24.194601+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:18:24.194601+0000","last_undegraded":"2024-05-09T02:18:24.194601+0000","last_fullsized":"2024-05-09T02:18:24.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545288+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:18:24.545288+0000","last_peered":"2024-05-09T02:18:24.545288+0000","last_clean":"2024-05-09T02:18:24.545288+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:18:24.545288+0000","last_undegraded":"2024-05-09T02:18:24.545288+0000","last_fullsized":"2024-05-09T02:18:24.545288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116481+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:25.116481+0000","last_peered":"2024-05-09T02:18:25.116481+0000","last_clean":"2024-05-09T02:18:25.116481+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:25.116481+0000","last_undegraded":"2024-05-09T02:18:25.116481+0000","last_fullsized":"2024-05-09T02:18:25.116481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117146+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:25.117146+0000","last_peered":"2024-05-09T02:18:25.117146+0000","last_clean":"2024-05-09T02:18:25.117146+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:25.117146+0000","last_undegraded":"2024-05-09T02:18:25.117146+0000","last_fullsized":"2024-05-09T02:18:25.117146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200150+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:18:24.200150+0000","last_peered":"2024-05-09T02:18:24.200150+0000","last_clean":"2024-05-09T02:18:24.200150+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:18:24.200150+0000","last_undegraded":"2024-05-09T02:18:24.200150+0000","last_fullsized":"2024-05-09T02:18:24.200150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544937+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:18:24.544937+0000","last_peered":"2024-05-09T02:18:24.544937+0000","last_clean":"2024-05-09T02:18:24.544937+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:18:24.544937+0000","last_undegraded":"2024-05-09T02:18:24.544937+0000","last_fullsized":"2024-05-09T02:18:24.544937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117143+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:25.117143+0000","last_peered":"2024-05-09T02:18:25.117143+0000","last_clean":"2024-05-09T02:18:25.117143+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:25.117143+0000","last_undegraded":"2024-05-09T02:18:25.117143+0000","last_fullsized":"2024-05-09T02:18:25.117143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545038+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:24.545038+0000","last_peered":"2024-05-09T02:18:24.545038+0000","last_clean":"2024-05-09T02:18:24.545038+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:24.545038+0000","last_undegraded":"2024-05-09T02:18:24.545038+0000","last_fullsized":"2024-05-09T02:18:24.545038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199798+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:18:24.199798+0000","last_peered":"2024-05-09T02:18:24.199798+0000","last_clean":"2024-05-09T02:18:24.199798+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:18:24.199798+0000","last_undegraded":"2024-05-09T02:18:24.199798+0000","last_fullsized":"2024-05-09T02:18:24.199798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200009+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:18:24.200009+0000","last_peered":"2024-05-09T02:18:24.200009+0000","last_clean":"2024-05-09T02:18:24.200009+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:18:24.200009+0000","last_undegraded":"2024-05-09T02:18:24.200009+0000","last_fullsized":"2024-05-09T02:18:24.200009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194050+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:24.194050+0000","last_peered":"2024-05-09T02:18:24.194050+0000","last_clean":"2024-05-09T02:18:24.194050+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:24.194050+0000","last_undegraded":"2024-05-09T02:18:24.194050+0000","last_fullsized":"2024-05-09T02:18:24.194050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194934+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:24.194934+0000","last_peered":"2024-05-09T02:18:24.194934+0000","last_clean":"2024-05-09T02:18:24.194934+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:24.194934+0000","last_undegraded":"2024-05-09T02:18:24.194934+0000","last_fullsized":"2024-05-09T02:18:24.194934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545295+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:18:24.545295+0000","last_peered":"2024-05-09T02:18:24.545295+0000","last_clean":"2024-05-09T02:18:24.545295+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:18:24.545295+0000","last_undegraded":"2024-05-09T02:18:24.545295+0000","last_fullsized":"2024-05-09T02:18:24.545295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199929+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:18:24.199929+0000","last_peered":"2024-05-09T02:18:24.199929+0000","last_clean":"2024-05-09T02:18:24.199929+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:18:24.199929+0000","last_undegraded":"2024-05-09T02:18:24.199929+0000","last_fullsized":"2024-05-09T02:18:24.199929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117435+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:25.117435+0000","last_peered":"2024-05-09T02:18:25.117435+0000","last_clean":"2024-05-09T02:18:25.117435+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:25.117435+0000","last_undegraded":"2024-05-09T02:18:25.117435+0000","last_fullsized":"2024-05-09T02:18:25.117435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117643+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:25.117643+0000","last_peered":"2024-05-09T02:18:25.117643+0000","last_clean":"2024-05-09T02:18:25.117643+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:25.117643+0000","last_undegraded":"2024-05-09T02:18:25.117643+0000","last_fullsized":"2024-05-09T02:18:25.117643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212549+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:18:24.212549+0000","last_peered":"2024-05-09T02:18:24.212549+0000","last_clean":"2024-05-09T02:18:24.212549+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:18:24.212549+0000","last_undegraded":"2024-05-09T02:18:24.212549+0000","last_fullsized":"2024-05-09T02:18:24.212549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212872+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:18:24.212872+0000","last_peered":"2024-05-09T02:18:24.212872+0000","last_clean":"2024-05-09T02:18:24.212872+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:18:24.212872+0000","last_undegraded":"2024-05-09T02:18:24.212872+0000","last_fullsized":"2024-05-09T02:18:24.212872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201035+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:24.201035+0000","last_peered":"2024-05-09T02:18:24.201035+0000","last_clean":"2024-05-09T02:18:24.201035+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:24.201035+0000","last_undegraded":"2024-05-09T02:18:24.201035+0000","last_fullsized":"2024-05-09T02:18:24.201035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213593+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:24.213593+0000","last_peered":"2024-05-09T02:18:24.213593+0000","last_clean":"2024-05-09T02:18:24.213593+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:24.213593+0000","last_undegraded":"2024-05-09T02:18:24.213593+0000","last_fullsized":"2024-05-09T02:18:24.213593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200111+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:18:24.200111+0000","last_peered":"2024-05-09T02:18:24.200111+0000","last_clean":"2024-05-09T02:18:24.200111+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:18:24.200111+0000","last_undegraded":"2024-05-09T02:18:24.200111+0000","last_fullsized":"2024-05-09T02:18:24.200111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117015+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:18:25.117015+0000","last_peered":"2024-05-09T02:18:25.117015+0000","last_clean":"2024-05-09T02:18:25.117015+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:18:25.117015+0000","last_undegraded":"2024-05-09T02:18:25.117015+0000","last_fullsized":"2024-05-09T02:18:25.117015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194791+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:24.194791+0000","last_peered":"2024-05-09T02:18:24.194791+0000","last_clean":"2024-05-09T02:18:24.194791+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:24.194791+0000","last_undegraded":"2024-05-09T02:18:24.194791+0000","last_fullsized":"2024-05-09T02:18:24.194791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545365+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:24.545365+0000","last_peered":"2024-05-09T02:18:24.545365+0000","last_clean":"2024-05-09T02:18:24.545365+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:24.545365+0000","last_undegraded":"2024-05-09T02:18:24.545365+0000","last_fullsized":"2024-05-09T02:18:24.545365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199144+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:18:24.199144+0000","last_peered":"2024-05-09T02:18:24.199144+0000","last_clean":"2024-05-09T02:18:24.199144+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:18:24.199144+0000","last_undegraded":"2024-05-09T02:18:24.199144+0000","last_fullsized":"2024-05-09T02:18:24.199144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117861+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:18:25.117861+0000","last_peered":"2024-05-09T02:18:25.117861+0000","last_clean":"2024-05-09T02:18:25.117861+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:18:25.117861+0000","last_undegraded":"2024-05-09T02:18:25.117861+0000","last_fullsized":"2024-05-09T02:18:25.117861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545293+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:24.545293+0000","last_peered":"2024-05-09T02:18:24.545293+0000","last_clean":"2024-05-09T02:18:24.545293+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:24.545293+0000","last_undegraded":"2024-05-09T02:18:24.545293+0000","last_fullsized":"2024-05-09T02:18:24.545293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118231+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:25.118231+0000","last_peered":"2024-05-09T02:18:25.118231+0000","last_clean":"2024-05-09T02:18:25.118231+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:25.118231+0000","last_undegraded":"2024-05-09T02:18:25.118231+0000","last_fullsized":"2024-05-09T02:18:25.118231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199116+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:18:24.199116+0000","last_peered":"2024-05-09T02:18:24.199116+0000","last_clean":"2024-05-09T02:18:24.199116+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:18:24.199116+0000","last_undegraded":"2024-05-09T02:18:24.199116+0000","last_fullsized":"2024-05-09T02:18:24.199116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118154+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:18:25.118154+0000","last_peered":"2024-05-09T02:18:25.118154+0000","last_clean":"2024-05-09T02:18:25.118154+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:18:25.118154+0000","last_undegraded":"2024-05-09T02:18:25.118154+0000","last_fullsized":"2024-05-09T02:18:25.118154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194363+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:18:24.194363+0000","last_peered":"2024-05-09T02:18:24.194363+0000","last_clean":"2024-05-09T02:18:24.194363+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:18:24.194363+0000","last_undegraded":"2024-05-09T02:18:24.194363+0000","last_fullsized":"2024-05-09T02:18:24.194363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212490+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:24.212490+0000","last_peered":"2024-05-09T02:18:24.212490+0000","last_clean":"2024-05-09T02:18:24.212490+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:24.212490+0000","last_undegraded":"2024-05-09T02:18:24.212490+0000","last_fullsized":"2024-05-09T02:18:24.212490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194441+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:18:24.194441+0000","last_peered":"2024-05-09T02:18:24.194441+0000","last_clean":"2024-05-09T02:18:24.194441+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:18:24.194441+0000","last_undegraded":"2024-05-09T02:18:24.194441+0000","last_fullsized":"2024-05-09T02:18:24.194441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118101+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:18:25.118101+0000","last_peered":"2024-05-09T02:18:25.118101+0000","last_clean":"2024-05-09T02:18:25.118101+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:18:25.118101+0000","last_undegraded":"2024-05-09T02:18:25.118101+0000","last_fullsized":"2024-05-09T02:18:25.118101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199684+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:24.199684+0000","last_peered":"2024-05-09T02:18:24.199684+0000","last_clean":"2024-05-09T02:18:24.199684+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:24.199684+0000","last_undegraded":"2024-05-09T02:18:24.199684+0000","last_fullsized":"2024-05-09T02:18:24.199684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199561+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:24.199561+0000","last_peered":"2024-05-09T02:18:24.199561+0000","last_clean":"2024-05-09T02:18:24.199561+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:24.199561+0000","last_undegraded":"2024-05-09T02:18:24.199561+0000","last_fullsized":"2024-05-09T02:18:24.199561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213468+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:18:24.213468+0000","last_peered":"2024-05-09T02:18:24.213468+0000","last_clean":"2024-05-09T02:18:24.213468+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:18:24.213468+0000","last_undegraded":"2024-05-09T02:18:24.213468+0000","last_fullsized":"2024-05-09T02:18:24.213468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116796+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:25.116796+0000","last_peered":"2024-05-09T02:18:25.116796+0000","last_clean":"2024-05-09T02:18:25.116796+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:25.116796+0000","last_undegraded":"2024-05-09T02:18:25.116796+0000","last_fullsized":"2024-05-09T02:18:25.116796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194815+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:24.194815+0000","last_peered":"2024-05-09T02:18:24.194815+0000","last_clean":"2024-05-09T02:18:24.194815+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:24.194815+0000","last_undegraded":"2024-05-09T02:18:24.194815+0000","last_fullsized":"2024-05-09T02:18:24.194815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116805+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:18:25.116805+0000","last_peered":"2024-05-09T02:18:25.116805+0000","last_clean":"2024-05-09T02:18:25.116805+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:18:25.116805+0000","last_undegraded":"2024-05-09T02:18:25.116805+0000","last_fullsized":"2024-05-09T02:18:25.116805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200413+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:18:24.200413+0000","last_peered":"2024-05-09T02:18:24.200413+0000","last_clean":"2024-05-09T02:18:24.200413+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:18:24.200413+0000","last_undegraded":"2024-05-09T02:18:24.200413+0000","last_fullsized":"2024-05-09T02:18:24.200413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200002+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:24.200002+0000","last_peered":"2024-05-09T02:18:24.200002+0000","last_clean":"2024-05-09T02:18:24.200002+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:24.200002+0000","last_undegraded":"2024-05-09T02:18:24.200002+0000","last_fullsized":"2024-05-09T02:18:24.200002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200154+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:24.200154+0000","last_peered":"2024-05-09T02:18:24.200154+0000","last_clean":"2024-05-09T02:18:24.200154+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:24.200154+0000","last_undegraded":"2024-05-09T02:18:24.200154+0000","last_fullsized":"2024-05-09T02:18:24.200154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199852+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:18:24.199852+0000","last_peered":"2024-05-09T02:18:24.199852+0000","last_clean":"2024-05-09T02:18:24.199852+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:18:24.199852+0000","last_undegraded":"2024-05-09T02:18:24.199852+0000","last_fullsized":"2024-05-09T02:18:24.199852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200142+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:18:24.200142+0000","last_peered":"2024-05-09T02:18:24.200142+0000","last_clean":"2024-05-09T02:18:24.200142+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:18:24.200142+0000","last_undegraded":"2024-05-09T02:18:24.200142+0000","last_fullsized":"2024-05-09T02:18:24.200142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116363+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:25.116363+0000","last_peered":"2024-05-09T02:18:25.116363+0000","last_clean":"2024-05-09T02:18:25.116363+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:25.116363+0000","last_undegraded":"2024-05-09T02:18:25.116363+0000","last_fullsized":"2024-05-09T02:18:25.116363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213190+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:18:24.213190+0000","last_peered":"2024-05-09T02:18:24.213190+0000","last_clean":"2024-05-09T02:18:24.213190+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:18:24.213190+0000","last_undegraded":"2024-05-09T02:18:24.213190+0000","last_fullsized":"2024-05-09T02:18:24.213190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116452+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:25.116452+0000","last_peered":"2024-05-09T02:18:25.116452+0000","last_clean":"2024-05-09T02:18:25.116452+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:25.116452+0000","last_undegraded":"2024-05-09T02:18:25.116452+0000","last_fullsized":"2024-05-09T02:18:25.116452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544873+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:18:24.544873+0000","last_peered":"2024-05-09T02:18:24.544873+0000","last_clean":"2024-05-09T02:18:24.544873+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:18:24.544873+0000","last_undegraded":"2024-05-09T02:18:24.544873+0000","last_fullsized":"2024-05-09T02:18:24.544873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544891+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:24.544891+0000","last_peered":"2024-05-09T02:18:24.544891+0000","last_clean":"2024-05-09T02:18:24.544891+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:24.544891+0000","last_undegraded":"2024-05-09T02:18:24.544891+0000","last_fullsized":"2024-05-09T02:18:24.544891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213449+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:18:24.213449+0000","last_peered":"2024-05-09T02:18:24.213449+0000","last_clean":"2024-05-09T02:18:24.213449+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:18:24.213449+0000","last_undegraded":"2024-05-09T02:18:24.213449+0000","last_fullsized":"2024-05-09T02:18:24.213449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194691+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:24.194691+0000","last_peered":"2024-05-09T02:18:24.194691+0000","last_clean":"2024-05-09T02:18:24.194691+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:24.194691+0000","last_undegraded":"2024-05-09T02:18:24.194691+0000","last_fullsized":"2024-05-09T02:18:24.194691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116786+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:18:25.116786+0000","last_peered":"2024-05-09T02:18:25.116786+0000","last_clean":"2024-05-09T02:18:25.116786+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:18:25.116786+0000","last_undegraded":"2024-05-09T02:18:25.116786+0000","last_fullsized":"2024-05-09T02:18:25.116786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200069+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:24.200069+0000","last_peered":"2024-05-09T02:18:24.200069+0000","last_clean":"2024-05-09T02:18:24.200069+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:24.200069+0000","last_undegraded":"2024-05-09T02:18:24.200069+0000","last_fullsized":"2024-05-09T02:18:24.200069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199888+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:18:24.199888+0000","last_peered":"2024-05-09T02:18:24.199888+0000","last_clean":"2024-05-09T02:18:24.199888+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:18:24.199888+0000","last_undegraded":"2024-05-09T02:18:24.199888+0000","last_fullsized":"2024-05-09T02:18:24.199888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213517+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:24.213517+0000","last_peered":"2024-05-09T02:18:24.213517+0000","last_clean":"2024-05-09T02:18:24.213517+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:24.213517+0000","last_undegraded":"2024-05-09T02:18:24.213517+0000","last_fullsized":"2024-05-09T02:18:24.213517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116516+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:18:25.116516+0000","last_peered":"2024-05-09T02:18:25.116516+0000","last_clean":"2024-05-09T02:18:25.116516+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:18:25.116516+0000","last_undegraded":"2024-05-09T02:18:25.116516+0000","last_fullsized":"2024-05-09T02:18:25.116516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117856+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:25.117856+0000","last_peered":"2024-05-09T02:18:25.117856+0000","last_clean":"2024-05-09T02:18:25.117856+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:25.117856+0000","last_undegraded":"2024-05-09T02:18:25.117856+0000","last_fullsized":"2024-05-09T02:18:25.117856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116831+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:18:25.116831+0000","last_peered":"2024-05-09T02:18:25.116831+0000","last_clean":"2024-05-09T02:18:25.116831+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:18:25.116831+0000","last_undegraded":"2024-05-09T02:18:25.116831+0000","last_fullsized":"2024-05-09T02:18:25.116831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200256+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:24.200256+0000","last_peered":"2024-05-09T02:18:24.200256+0000","last_clean":"2024-05-09T02:18:24.200256+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:24.200256+0000","last_undegraded":"2024-05-09T02:18:24.200256+0000","last_fullsized":"2024-05-09T02:18:24.200256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200283+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:18:24.200283+0000","last_peered":"2024-05-09T02:18:24.200283+0000","last_clean":"2024-05-09T02:18:24.200283+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:18:24.200283+0000","last_undegraded":"2024-05-09T02:18:24.200283+0000","last_fullsized":"2024-05-09T02:18:24.200283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544524+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:24.544524+0000","last_peered":"2024-05-09T02:18:24.544524+0000","last_clean":"2024-05-09T02:18:24.544524+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:24.544524+0000","last_undegraded":"2024-05-09T02:18:24.544524+0000","last_fullsized":"2024-05-09T02:18:24.544524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118322+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:18:25.118322+0000","last_peered":"2024-05-09T02:18:25.118322+0000","last_clean":"2024-05-09T02:18:25.118322+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:18:25.118322+0000","last_undegraded":"2024-05-09T02:18:25.118322+0000","last_fullsized":"2024-05-09T02:18:25.118322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199333+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:24.199333+0000","last_peered":"2024-05-09T02:18:24.199333+0000","last_clean":"2024-05-09T02:18:24.199333+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:24.199333+0000","last_undegraded":"2024-05-09T02:18:24.199333+0000","last_fullsized":"2024-05-09T02:18:24.199333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116756+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:18:25.116756+0000","last_peered":"2024-05-09T02:18:25.116756+0000","last_clean":"2024-05-09T02:18:25.116756+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:18:25.116756+0000","last_undegraded":"2024-05-09T02:18:25.116756+0000","last_fullsized":"2024-05-09T02:18:25.116756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544741+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:24.544741+0000","last_peered":"2024-05-09T02:18:24.544741+0000","last_clean":"2024-05-09T02:18:24.544741+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:24.544741+0000","last_undegraded":"2024-05-09T02:18:24.544741+0000","last_fullsized":"2024-05-09T02:18:24.544741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199644+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:18:24.199644+0000","last_peered":"2024-05-09T02:18:24.199644+0000","last_clean":"2024-05-09T02:18:24.199644+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:18:24.199644+0000","last_undegraded":"2024-05-09T02:18:24.199644+0000","last_fullsized":"2024-05-09T02:18:24.199644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194548+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:24.194548+0000","last_peered":"2024-05-09T02:18:24.194548+0000","last_clean":"2024-05-09T02:18:24.194548+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:24.194548+0000","last_undegraded":"2024-05-09T02:18:24.194548+0000","last_fullsized":"2024-05-09T02:18:24.194548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200449+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:18:24.200449+0000","last_peered":"2024-05-09T02:18:24.200449+0000","last_clean":"2024-05-09T02:18:24.200449+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:18:24.200449+0000","last_undegraded":"2024-05-09T02:18:24.200449+0000","last_fullsized":"2024-05-09T02:18:24.200449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117511+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:25.117511+0000","last_peered":"2024-05-09T02:18:25.117511+0000","last_clean":"2024-05-09T02:18:25.117511+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:25.117511+0000","last_undegraded":"2024-05-09T02:18:25.117511+0000","last_fullsized":"2024-05-09T02:18:25.117511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199759+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:18:24.199759+0000","last_peered":"2024-05-09T02:18:24.199759+0000","last_clean":"2024-05-09T02:18:24.199759+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:18:24.199759+0000","last_undegraded":"2024-05-09T02:18:24.199759+0000","last_fullsized":"2024-05-09T02:18:24.199759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117792+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:25.117792+0000","last_peered":"2024-05-09T02:18:25.117792+0000","last_clean":"2024-05-09T02:18:25.117792+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:25.117792+0000","last_undegraded":"2024-05-09T02:18:25.117792+0000","last_fullsized":"2024-05-09T02:18:25.117792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544399+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:18:24.544399+0000","last_peered":"2024-05-09T02:18:24.544399+0000","last_clean":"2024-05-09T02:18:24.544399+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:18:24.544399+0000","last_undegraded":"2024-05-09T02:18:24.544399+0000","last_fullsized":"2024-05-09T02:18:24.544399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116838+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:25.116838+0000","last_peered":"2024-05-09T02:18:25.116838+0000","last_clean":"2024-05-09T02:18:25.116838+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:25.116838+0000","last_undegraded":"2024-05-09T02:18:25.116838+0000","last_fullsized":"2024-05-09T02:18:25.116838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193965+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:18:24.193965+0000","last_peered":"2024-05-09T02:18:24.193965+0000","last_clean":"2024-05-09T02:18:24.193965+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:18:24.193965+0000","last_undegraded":"2024-05-09T02:18:24.193965+0000","last_fullsized":"2024-05-09T02:18:24.193965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545650+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:24.545650+0000","last_peered":"2024-05-09T02:18:24.545650+0000","last_clean":"2024-05-09T02:18:24.545650+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:24.545650+0000","last_undegraded":"2024-05-09T02:18:24.545650+0000","last_fullsized":"2024-05-09T02:18:24.545650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213025+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:18:24.213025+0000","last_peered":"2024-05-09T02:18:24.213025+0000","last_clean":"2024-05-09T02:18:24.213025+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:18:24.213025+0000","last_undegraded":"2024-05-09T02:18:24.213025+0000","last_fullsized":"2024-05-09T02:18:24.213025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544509+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:24.544509+0000","last_peered":"2024-05-09T02:18:24.544509+0000","last_clean":"2024-05-09T02:18:24.544509+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:24.544509+0000","last_undegraded":"2024-05-09T02:18:24.544509+0000","last_fullsized":"2024-05-09T02:18:24.544509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200878+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:18:24.200878+0000","last_peered":"2024-05-09T02:18:24.200878+0000","last_clean":"2024-05-09T02:18:24.200878+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:18:24.200878+0000","last_undegraded":"2024-05-09T02:18:24.200878+0000","last_fullsized":"2024-05-09T02:18:24.200878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212585+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:24.212585+0000","last_peered":"2024-05-09T02:18:24.212585+0000","last_clean":"2024-05-09T02:18:24.212585+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:24.212585+0000","last_undegraded":"2024-05-09T02:18:24.212585+0000","last_fullsized":"2024-05-09T02:18:24.212585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544885+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:18:24.544885+0000","last_peered":"2024-05-09T02:18:24.544885+0000","last_clean":"2024-05-09T02:18:24.544885+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:18:24.544885+0000","last_undegraded":"2024-05-09T02:18:24.544885+0000","last_fullsized":"2024-05-09T02:18:24.544885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194082+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:24.194082+0000","last_peered":"2024-05-09T02:18:24.194082+0000","last_clean":"2024-05-09T02:18:24.194082+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:24.194082+0000","last_undegraded":"2024-05-09T02:18:24.194082+0000","last_fullsized":"2024-05-09T02:18:24.194082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118000+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:18:25.118000+0000","last_peered":"2024-05-09T02:18:25.118000+0000","last_clean":"2024-05-09T02:18:25.118000+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:18:25.118000+0000","last_undegraded":"2024-05-09T02:18:25.118000+0000","last_fullsized":"2024-05-09T02:18:25.118000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199427+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:24.199427+0000","last_peered":"2024-05-09T02:18:24.199427+0000","last_clean":"2024-05-09T02:18:24.199427+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:24.199427+0000","last_undegraded":"2024-05-09T02:18:24.199427+0000","last_fullsized":"2024-05-09T02:18:24.199427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199676+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:18:24.199676+0000","last_peered":"2024-05-09T02:18:24.199676+0000","last_clean":"2024-05-09T02:18:24.199676+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:18:24.199676+0000","last_undegraded":"2024-05-09T02:18:24.199676+0000","last_fullsized":"2024-05-09T02:18:24.199676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200953+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:24.200953+0000","last_peered":"2024-05-09T02:18:24.200953+0000","last_clean":"2024-05-09T02:18:24.200953+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:24.200953+0000","last_undegraded":"2024-05-09T02:18:24.200953+0000","last_fullsized":"2024-05-09T02:18:24.200953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116902+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:18:25.116902+0000","last_peered":"2024-05-09T02:18:25.116902+0000","last_clean":"2024-05-09T02:18:25.116902+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:18:25.116902+0000","last_undegraded":"2024-05-09T02:18:25.116902+0000","last_fullsized":"2024-05-09T02:18:25.116902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117232+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:25.117232+0000","last_peered":"2024-05-09T02:18:25.117232+0000","last_clean":"2024-05-09T02:18:25.117232+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:25.117232+0000","last_undegraded":"2024-05-09T02:18:25.117232+0000","last_fullsized":"2024-05-09T02:18:25.117232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117481+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:18:25.117481+0000","last_peered":"2024-05-09T02:18:25.117481+0000","last_clean":"2024-05-09T02:18:25.117481+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:18:25.117481+0000","last_undegraded":"2024-05-09T02:18:25.117481+0000","last_fullsized":"2024-05-09T02:18:25.117481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117736+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:25.117736+0000","last_peered":"2024-05-09T02:18:25.117736+0000","last_clean":"2024-05-09T02:18:25.117736+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:25.117736+0000","last_undegraded":"2024-05-09T02:18:25.117736+0000","last_fullsized":"2024-05-09T02:18:25.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544734+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:18:24.544734+0000","last_peered":"2024-05-09T02:18:24.544734+0000","last_clean":"2024-05-09T02:18:24.544734+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:18:24.544734+0000","last_undegraded":"2024-05-09T02:18:24.544734+0000","last_fullsized":"2024-05-09T02:18:24.544734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118260+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:25.118260+0000","last_peered":"2024-05-09T02:18:25.118260+0000","last_clean":"2024-05-09T02:18:25.118260+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:25.118260+0000","last_undegraded":"2024-05-09T02:18:25.118260+0000","last_fullsized":"2024-05-09T02:18:25.118260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199800+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:18:24.199800+0000","last_peered":"2024-05-09T02:18:24.199800+0000","last_clean":"2024-05-09T02:18:24.199800+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:18:24.199800+0000","last_undegraded":"2024-05-09T02:18:24.199800+0000","last_fullsized":"2024-05-09T02:18:24.199800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199349+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:24.199349+0000","last_peered":"2024-05-09T02:18:24.199349+0000","last_clean":"2024-05-09T02:18:24.199349+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:24.199349+0000","last_undegraded":"2024-05-09T02:18:24.199349+0000","last_fullsized":"2024-05-09T02:18:24.199349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118052+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:18:25.118052+0000","last_peered":"2024-05-09T02:18:25.118052+0000","last_clean":"2024-05-09T02:18:25.118052+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:18:25.118052+0000","last_undegraded":"2024-05-09T02:18:25.118052+0000","last_fullsized":"2024-05-09T02:18:25.118052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116863+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:25.116863+0000","last_peered":"2024-05-09T02:18:25.116863+0000","last_clean":"2024-05-09T02:18:25.116863+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:25.116863+0000","last_undegraded":"2024-05-09T02:18:25.116863+0000","last_fullsized":"2024-05-09T02:18:25.116863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213378+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:18:24.213378+0000","last_peered":"2024-05-09T02:18:24.213378+0000","last_clean":"2024-05-09T02:18:24.213378+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:18:24.213378+0000","last_undegraded":"2024-05-09T02:18:24.213378+0000","last_fullsized":"2024-05-09T02:18:24.213378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545227+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:18:24.545227+0000","last_peered":"2024-05-09T02:18:24.545227+0000","last_clean":"2024-05-09T02:18:24.545227+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:18:24.545227+0000","last_undegraded":"2024-05-09T02:18:24.545227+0000","last_fullsized":"2024-05-09T02:18:24.545227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199515+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:18:24.199515+0000","last_peered":"2024-05-09T02:18:24.199515+0000","last_clean":"2024-05-09T02:18:24.199515+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:18:24.199515+0000","last_undegraded":"2024-05-09T02:18:24.199515+0000","last_fullsized":"2024-05-09T02:18:24.199515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545003+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:24.545003+0000","last_peered":"2024-05-09T02:18:24.545003+0000","last_clean":"2024-05-09T02:18:24.545003+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:24.545003+0000","last_undegraded":"2024-05-09T02:18:24.545003+0000","last_fullsized":"2024-05-09T02:18:24.545003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116685+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:18:25.116685+0000","last_peered":"2024-05-09T02:18:25.116685+0000","last_clean":"2024-05-09T02:18:25.116685+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:18:25.116685+0000","last_undegraded":"2024-05-09T02:18:25.116685+0000","last_fullsized":"2024-05-09T02:18:25.116685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194258+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:24.194258+0000","last_peered":"2024-05-09T02:18:24.194258+0000","last_clean":"2024-05-09T02:18:24.194258+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:24.194258+0000","last_undegraded":"2024-05-09T02:18:24.194258+0000","last_fullsized":"2024-05-09T02:18:24.194258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116880+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:18:25.116880+0000","last_peered":"2024-05-09T02:18:25.116880+0000","last_clean":"2024-05-09T02:18:25.116880+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:18:25.116880+0000","last_undegraded":"2024-05-09T02:18:25.116880+0000","last_fullsized":"2024-05-09T02:18:25.116880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213092+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:24.213092+0000","last_peered":"2024-05-09T02:18:24.213092+0000","last_clean":"2024-05-09T02:18:24.213092+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:24.213092+0000","last_undegraded":"2024-05-09T02:18:24.213092+0000","last_fullsized":"2024-05-09T02:18:24.213092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116857+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:18:25.116857+0000","last_peered":"2024-05-09T02:18:25.116857+0000","last_clean":"2024-05-09T02:18:25.116857+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:18:25.116857+0000","last_undegraded":"2024-05-09T02:18:25.116857+0000","last_fullsized":"2024-05-09T02:18:25.116857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118184+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:25.118184+0000","last_peered":"2024-05-09T02:18:25.118184+0000","last_clean":"2024-05-09T02:18:25.118184+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:25.118184+0000","last_undegraded":"2024-05-09T02:18:25.118184+0000","last_fullsized":"2024-05-09T02:18:25.118184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:28.693 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T02:18:28.693 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T02:18:28.693 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T02:18:28.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T02:18:28.694 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T02:18:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.838+0000 7f36713b2640 1 Processor -- start 2024-05-09T02:18:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.838+0000 7f36713b2640 1 -- start start 2024-05-09T02:18:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.839+0000 7f36713b2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 0x7f366c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f36713b2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c158ae0 con 0x7f366c0c84a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f36713b2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c155570 con 0x7f366c15b3a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f36713b2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f366c157ed0 con 0x7f366c155160 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f366a7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f366c0c84a0 0x7f366c0c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44098/0 (socket says 172.21.15.46:44098) 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f366a7fc640 1 -- 172.21.15.46:0/3173547930 learned_addr learned my addr 172.21.15.46:0/3173547930 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f366affd640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 0x7f366c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303649384 0 0) 0x7f366c158ae0 con 0x7f366c0c84a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3658003520 con 0x7f366c0c84a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383619723 0 0) 0x7f366c155570 con 0x7f366c15b3a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f366c158ae0 con 0x7f366c15b3a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3306253102 0 0) 0x7f3658003520 con 0x7f366c0c84a0 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 msgr2=0x7f366c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 0x7f366c0c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 >> v1:172.21.15.107:6789/0 conn(0x7f366c15b3a0 legacy=0x7f366c15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c1581b0 con 0x7f366c0c84a0 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f36540016f0 con 0x7f366c0c84a0 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 >> v1:172.21.15.46:6789/0 conn(0x7f366c0c84a0 legacy=0x7f366c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 0x7f3658003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f3658004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3658004e00 0x7f36580052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f366c157ed0 con 0x7f36580041c0 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f365800bd60 con 0x7f3658004e00 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.840+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f365800bf60 con 0x7f366c155160 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f3658004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366affd640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 0x7f3658003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366b7fe640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3658004e00 0x7f36580052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 -- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 msgr2=0x7f3658003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c155160 0x7f3658003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 -- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3658004e00 msgr2=0x7f36580052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3658004e00 0x7f36580052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 -- 172.21.15.46:0/3173547930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3658003520 con 0x7f36580041c0 2024-05-09T02:18:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.841+0000 7f366a7fc640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f3658004800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f366c0b2fc0 tx=0x7f3658005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24eaa92340627648 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654007c80 con 0x7f36580041c0 2024-05-09T02:18:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654005ad0 con 0x7f36580041c0 2024-05-09T02:18:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f3669ffb640 1 -- 172.21.15.46:0/3173547930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654007070 con 0x7f36580041c0 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f36713b2640 1 -- 172.21.15.46:0/3173547930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 msgr2=0x7f3658004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f36713b2640 1 --2- 172.21.15.46:0/3173547930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f3658004800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f366c0b2fc0 tx=0x7f3658005830 comp rx=0 tx=0).stop 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f366b7fe640 1 -- 172.21.15.46:0/3173547930 reap_dead start 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f36713b2640 1 -- 172.21.15.46:0/3173547930 shutdown_connections 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f36713b2640 1 -- 172.21.15.46:0/3173547930 >> 172.21.15.46:0/3173547930 conn(0x7f366c0aebe0 msgr2=0x7f366c0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f36713b2640 1 -- 172.21.15.46:0/3173547930 shutdown_connections 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.842+0000 7f36713b2640 1 -- 172.21.15.46:0/3173547930 wait complete. 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.844+0000 7f36713b2640 1 Processor -- start 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.844+0000 7f36713b2640 1 -- start start 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f36713b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f366c147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f36713b2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f366c0cce70 0x7f366c14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f36713b2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c14c8b0 0x7f366c1f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f36713b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f366c157b30 con 0x7f36580041c0 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f36713b2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f366c158770 con 0x7f366c0cce70 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f36713b2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f366c157cb0 con 0x7f366c14c8b0 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f366affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f366c147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.845+0000 7f366affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f366c147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35952/0 (socket says 172.21.15.46:35952) 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 -- 172.21.15.46:0/271891762 learned_addr learned my addr 172.21.15.46:0/271891762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366a7fc640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f366c0cce70 0x7f366c14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366b7fe640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c14c8b0 0x7f366c1f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 -- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c14c8b0 msgr2=0x7f366c1f0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c14c8b0 0x7f366c1f0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 -- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f366c0cce70 msgr2=0x7f366c14c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f366c0cce70 0x7f366c14c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 -- 172.21.15.46:0/271891762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c147bc0 con 0x7f36580041c0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f366affd640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f366c147680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f365c009f80 tx=0x7f365c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c00fea0 con 0x7f36580041c0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c015630 con 0x7f36580041c0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c0159e0 con 0x7f36580041c0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c154300 con 0x7f36580041c0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.846+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c149c30 con 0x7f36580041c0 2024-05-09T02:18:28.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.847+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c15bf50 con 0x7f36580041c0 2024-05-09T02:18:28.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.848+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f365c015b80 con 0x7f36580041c0 2024-05-09T02:18:28.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.848+0000 7f36637fe640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f364c076300 0x7f364c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:28.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.849+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f365c0989b0 con 0x7f36580041c0 2024-05-09T02:18:28.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.849+0000 7f366a7fc640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f364c076300 0x7f364c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:28.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.849+0000 7f366a7fc640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f364c076300 0x7f364c078810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3654032000 tx=0x7f3654009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:28.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:28.853+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f366c15bf50 con 0x7f36580041c0 2024-05-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.093+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f366c154820 con 0x7f36580041c0 2024-05-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.096+0000 7f36637fe640 1 -- 172.21.15.46:0/271891762 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189527 (secure 0 0 0) 0x7f365c019030 con 0x7f36580041c0 2024-05-09T02:18:29.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f364c076300 msgr2=0x7f364c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f364c076300 0x7f364c078810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3654032000 tx=0x7f3654009030 comp rx=0 tx=0).stop 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 msgr2=0x7f366c147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f366c147680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f365c009f80 tx=0x7f365c00f580 comp rx=0 tx=0).stop 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 shutdown_connections 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f364c076300 0x7f364c078810 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f366c14c8b0 0x7f366c1f0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f366c0cce70 0x7f366c14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 --2- 172.21.15.46:0/271891762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36580041c0 0x7f366c147680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.099+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 >> 172.21.15.46:0/271891762 conn(0x7f366c0aebe0 msgr2=0x7f366c1559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.100+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 shutdown_connections 2024-05-09T02:18:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.100+0000 7f36713b2640 1 -- 172.21.15.46:0/271891762 wait complete. 2024-05-09T02:18:29.113 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2302910508},{"type":"v1","addr":"172.21.15.107:6833","nonce":2302910508}]},"active_addr":"172.21.15.107:6833/2302910508","active_change":"2024-05-09T02:17:54.488665+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2500391156}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":775696096}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3250671892}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":4207349289}]}]} 2024-05-09T02:18:29.117 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T02:18:29.117 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T02:18:29.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.230+0000 7f20a0bb7640 1 Processor -- start 2024-05-09T02:18:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.230+0000 7f20a0bb7640 1 -- start start 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f20a0bb7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f209c153080 0x7f209c155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f20a0bb7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c155fe0 con 0x7f209c0ca560 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f20a0bb7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c1562c0 con 0x7f209c0c8ba0 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f20a0bb7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f209c159070 con 0x7f209c153080 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f2093fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f209c0ca560 0x7f209c159500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44110/0 (socket says 172.21.15.46:44110) 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f2093fff640 1 -- 172.21.15.46:0/400149230 learned_addr learned my addr 172.21.15.46:0/400149230 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f209ad9d640 1 --2- 172.21.15.46:0/400149230 >> v2:172.21.15.107:3300/0 conn(0x7f209c153080 0x7f209c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f2099d9b640 1 -- 172.21.15.46:0/400149230 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878540150 0 0) 0x7f209c155fe0 con 0x7f209c0ca560 2024-05-09T02:18:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f2099d9b640 1 -- 172.21.15.46:0/400149230 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2088003520 con 0x7f209c0ca560 2024-05-09T02:18:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f209ad9d640 1 -- 172.21.15.46:0/400149230 >> v1:172.21.15.107:6789/0 conn(0x7f209c0c8ba0 legacy=0x7f209c0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f209ad9d640 1 -- 172.21.15.46:0/400149230 >> v1:172.21.15.46:6789/0 conn(0x7f209c0ca560 legacy=0x7f209c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.232+0000 7f209ad9d640 1 -- 172.21.15.46:0/400149230 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1565a0 con 0x7f209c153080 2024-05-09T02:18:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.233+0000 7f209ad9d640 1 --2- 172.21.15.46:0/400149230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c155890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2094009d90 tx=0x7f209402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e0b561bbc57fb09 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.235+0000 7f2099d9b640 1 -- 172.21.15.46:0/400149230 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094007740 con 0x7f209c153080 2024-05-09T02:18:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.235+0000 7f2099d9b640 1 -- 172.21.15.46:0/400149230 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20940078e0 con 0x7f209c153080 2024-05-09T02:18:29.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.235+0000 7f2099d9b640 1 -- 172.21.15.46:0/400149230 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094007cb0 con 0x7f209c153080 2024-05-09T02:18:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.235+0000 7f20a0bb7640 1 -- 172.21.15.46:0/400149230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 msgr2=0x7f209c155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.235+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/400149230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c155890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2094009d90 tx=0x7f209402a660 comp rx=0 tx=0).stop 2024-05-09T02:18:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.236+0000 7f20a0bb7640 1 -- 172.21.15.46:0/400149230 shutdown_connections 2024-05-09T02:18:29.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.236+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/400149230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c155890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.236+0000 7f20a0bb7640 1 -- 172.21.15.46:0/400149230 >> 172.21.15.46:0/400149230 conn(0x7f209c0ac930 msgr2=0x7f209c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:29.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.236+0000 7f20a0bb7640 1 -- 172.21.15.46:0/400149230 shutdown_connections 2024-05-09T02:18:29.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.236+0000 7f20a0bb7640 1 -- 172.21.15.46:0/400149230 wait complete. 2024-05-09T02:18:29.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.237+0000 7f20a0bb7640 1 Processor -- start 2024-05-09T02:18:29.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.238+0000 7f20a0bb7640 1 -- start start 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f20a0bb7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 0x7f209c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f20a0bb7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209c0ca560 0x7f209c0af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f20a0bb7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f20a0bb7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0c7d60 con 0x7f209c0c8ba0 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f20a0bb7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0c60c0 con 0x7f209c153080 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f20a0bb7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f209c0c7ee0 con 0x7f209c0ca560 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 0x7f209c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 0x7f209c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35956/0 (socket says 172.21.15.46:35956) 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 -- 172.21.15.46:0/2275895788 learned_addr learned my addr 172.21.15.46:0/2275895788 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f2093fff640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209c0ca560 0x7f209c0af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209ad9d640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 -- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209c0ca560 msgr2=0x7f209c0af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209c0ca560 0x7f209c0af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 -- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 msgr2=0x7f209c14f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c14f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 -- 172.21.15.46:0/2275895788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c06e1e0 con 0x7f209c0c8ba0 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f209a59c640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 0x7f209c0c41c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f208c001eb0 tx=0x7f208c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.239+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c017070 con 0x7f209c0c8ba0 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.240+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c0052d0 con 0x7f209c0c8ba0 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.240+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c06e4a0 con 0x7f209c0c8ba0 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.240+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0037f0 con 0x7f209c0c8ba0 2024-05-09T02:18:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.240+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c0aeb40 con 0x7f209c0c8ba0 2024-05-09T02:18:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.241+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c06a330 con 0x7f209c0c8ba0 2024-05-09T02:18:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.241+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f208c01a070 con 0x7f209c0c8ba0 2024-05-09T02:18:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.242+0000 7f2092ffd640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f207c0762d0 0x7f207c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.242+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f208c096c10 con 0x7f209c0c8ba0 2024-05-09T02:18:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.242+0000 7f2093fff640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f207c0762d0 0x7f207c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.243+0000 7f2093fff640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f207c0762d0 0x7f207c0787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2084005880 tx=0x7f2084009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.247+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f208c05fb50 con 0x7f209c0c8ba0 2024-05-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.436+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f209c0aaa90 con 0x7f209c0c8ba0 2024-05-09T02:18:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.438+0000 7f2092ffd640 1 -- 172.21.15.46:0/2275895788 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7f208c068190 con 0x7f209c0c8ba0 2024-05-09T02:18:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:29.441 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f207c0762d0 msgr2=0x7f207c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f207c0762d0 0x7f207c0787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2084005880 tx=0x7f2084009040 comp rx=0 tx=0).stop 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 msgr2=0x7f209c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 0x7f209c0c41c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f208c001eb0 tx=0x7f208c00c890 comp rx=0 tx=0).stop 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 shutdown_connections 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f207c0762d0 0x7f207c0787e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f209c153080 0x7f209c14f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209c0ca560 0x7f209c0af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 --2- 172.21.15.46:0/2275895788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f209c0c8ba0 0x7f209c0c41c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 >> 172.21.15.46:0/2275895788 conn(0x7f209c0ac930 msgr2=0x7f209c0ab290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 shutdown_connections 2024-05-09T02:18:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.440+0000 7f20a0bb7640 1 -- 172.21.15.46:0/2275895788 wait complete. 2024-05-09T02:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T02:18:29.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:29.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.565+0000 7f75f541e640 1 Processor -- start 2024-05-09T02:18:29.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.565+0000 7f75f541e640 1 -- start start 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.566+0000 7f75f541e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f75f0154fd0 0x7f75f00c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.566+0000 7f75f541e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75f541e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f01553e0 con 0x7f75f00c6d70 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75f541e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f75f00c2690 con 0x7f75f0154fd0 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75f541e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f75f0158580 con 0x7f75f015af70 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75eeffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f75f00c6d70 0x7f75f00c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44112/0 (socket says 172.21.15.46:44112) 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75eeffd640 1 -- 172.21.15.46:0/2555372985 learned_addr learned my addr 172.21.15.46:0/2555372985 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ee7fc640 1 --2- 172.21.15.46:0/2555372985 >> v2:172.21.15.107:3300/0 conn(0x7f75f0154fd0 0x7f75f00c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ef7fe640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75edffb640 1 -- 172.21.15.46:0/2555372985 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415079157 0 0) 0x7f75e8001110 con 0x7f75f00c6d70 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75edffb640 1 -- 172.21.15.46:0/2555372985 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75dc003520 con 0x7f75f00c6d70 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ee7fc640 1 -- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 msgr2=0x7f75f015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ee7fc640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ee7fc640 1 -- 172.21.15.46:0/2555372985 >> v1:172.21.15.46:6789/0 conn(0x7f75f00c6d70 legacy=0x7f75f00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ee7fc640 1 -- 172.21.15.46:0/2555372985 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f0158860 con 0x7f75f0154fd0 2024-05-09T02:18:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.567+0000 7f75ef7fe640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.568+0000 7f75ee7fc640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0154fd0 0x7f75f00c9a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75d80097a0 tx=0x7f75d802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a1fd2d3964e554 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.568+0000 7f75edffb640 1 -- 172.21.15.46:0/2555372985 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8037070 con 0x7f75f0154fd0 2024-05-09T02:18:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.568+0000 7f75edffb640 1 -- 172.21.15.46:0/2555372985 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d802adb0 con 0x7f75f0154fd0 2024-05-09T02:18:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.568+0000 7f75edffb640 1 -- 172.21.15.46:0/2555372985 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8032640 con 0x7f75f0154fd0 2024-05-09T02:18:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 -- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0154fd0 msgr2=0x7f75f00c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0154fd0 0x7f75f00c9a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75d80097a0 tx=0x7f75d802a060 comp rx=0 tx=0).stop 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 -- 172.21.15.46:0/2555372985 shutdown_connections 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 --2- 172.21.15.46:0/2555372985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0154fd0 0x7f75f00c9a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 -- 172.21.15.46:0/2555372985 >> 172.21.15.46:0/2555372985 conn(0x7f75f006e8f0 msgr2=0x7f75f006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 -- 172.21.15.46:0/2555372985 shutdown_connections 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.569+0000 7f75f541e640 1 -- 172.21.15.46:0/2555372985 wait complete. 2024-05-09T02:18:29.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.571+0000 7f75f541e640 1 Processor -- start 2024-05-09T02:18:29.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.571+0000 7f75f541e640 1 -- start start 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75f541e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f00c6d70 0x7f75f01ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75f541e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 0x7f75f01e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75f541e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75f541e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00c9f40 con 0x7f75f0154fd0 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75f541e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00c2320 con 0x7f75f00c6d70 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75f541e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f75f015b8c0 con 0x7f75f015af70 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 0x7f75f01e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 0x7f75f01e4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35970/0 (socket says 172.21.15.46:35970) 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 -- 172.21.15.46:0/698638667 learned_addr learned my addr 172.21.15.46:0/698638667 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75eeffd640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f00c6d70 0x7f75f01ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ef7fe640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 -- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 msgr2=0x7f75f014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 -- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f00c6d70 msgr2=0x7f75f01ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f00c6d70 0x7f75f01ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75ee7fc640 1 -- 172.21.15.46:0/698638667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f014ab20 con 0x7f75f0154fd0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.572+0000 7f75eeffd640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f00c6d70 0x7f75f01ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.573+0000 7f75ee7fc640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 0x7f75f01e4810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f75d80097a0 tx=0x7f75d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.573+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8037040 con 0x7f75f0154fd0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.573+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d8004030 con 0x7f75f0154fd0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.573+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f01eea70 con 0x7f75f0154fd0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.573+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8006e10 con 0x7f75f0154fd0 2024-05-09T02:18:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.573+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f01f1ac0 con 0x7f75f0154fd0 2024-05-09T02:18:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.574+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f006a330 con 0x7f75f0154fd0 2024-05-09T02:18:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.575+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75d8003610 con 0x7f75f0154fd0 2024-05-09T02:18:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.575+0000 7f75e77fe640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f75d00762d0 0x7f75d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.575+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f75d80b8510 con 0x7f75f0154fd0 2024-05-09T02:18:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.575+0000 7f75eeffd640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f75d00762d0 0x7f75d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.576+0000 7f75eeffd640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f75d00762d0 0x7f75d00787e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75e8007fd0 tx=0x7f75e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:29.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.580+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75d8081a10 con 0x7f75f0154fd0 2024-05-09T02:18:29.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.771+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75f0069e80 con 0x7f75f0154fd0 2024-05-09T02:18:29.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.773+0000 7f75e77fe640 1 -- 172.21.15.46:0/698638667 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7f75d8081310 con 0x7f75f0154fd0 2024-05-09T02:18:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:29.776 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f75d00762d0 msgr2=0x7f75d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f75d00762d0 0x7f75d00787e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75e8007fd0 tx=0x7f75e8009040 comp rx=0 tx=0).stop 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 msgr2=0x7f75f01e4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 0x7f75f01e4810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f75d80097a0 tx=0x7f75d80046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 shutdown_connections 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f75d00762d0 0x7f75d00787e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75f015af70 0x7f75f014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0154fd0 0x7f75f01e4810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 --2- 172.21.15.46:0/698638667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f00c6d70 0x7f75f01ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:29.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 >> 172.21.15.46:0/698638667 conn(0x7f75f006e8f0 msgr2=0x7f75f00c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:29.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 shutdown_connections 2024-05-09T02:18:29.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:29.775+0000 7f75f541e640 1 -- 172.21.15.46:0/698638667 wait complete. 2024-05-09T02:18:29.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T02:18:29.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T02:18:29.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T02:18:29.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T02:18:29.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T02:18:29.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T02:18:29.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T02:18:29.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T02:18:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.016+0000 7fcf28975640 1 Processor -- start 2024-05-09T02:18:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.016+0000 7fcf28975640 1 -- start start 2024-05-09T02:18:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcf28975640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 0x7fcf1c04b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcf2259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 0x7fcf1c04b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcf2259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 0x7fcf1c04b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35984/0 (socket says 172.21.15.46:35984) 2024-05-09T02:18:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcf2259c640 1 -- 172.21.15.46:0/3786292004 learned_addr learned my addr 172.21.15.46:0/3786292004 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcf28975640 1 --2- 172.21.15.46:0/3786292004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c031dd0 0x7fcf1c0321e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.018+0000 7f923d47e640 1 Processor -- start 2024-05-09T02:18:30.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.018+0000 7f923d47e640 1 -- start start 2024-05-09T02:18:30.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.018+0000 7f4320bb2640 1 Processor -- start 2024-05-09T02:18:30.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.018+0000 7f4320bb2640 1 -- start start 2024-05-09T02:18:30.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.018+0000 7f7f75757640 1 Processor -- start 2024-05-09T02:18:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.018+0000 7f7f75757640 1 -- start start 2024-05-09T02:18:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.017+0000 7fcdf9261640 1 Processor -- start 2024-05-09T02:18:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.017+0000 7fcdf9261640 1 -- start start 2024-05-09T02:18:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcdf9261640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 0x7fcdec0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1c0087d0 con 0x7fcf1c047e10 2024-05-09T02:18:30.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fcf1c04aba0 con 0x7fcf1c0d4df0 2024-05-09T02:18:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcdf9261640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcdec007920 0x7fcdec0de410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcdf9261640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcdec0d80a0 0x7fcdec0de950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcdf9261640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fcdec04e5f0 con 0x7fcdec007920 2024-05-09T02:18:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcdf9261640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcdec04e8d0 con 0x7fcdec0d80a0 2024-05-09T02:18:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.019+0000 7fcdf9261640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcdec04ebb0 con 0x7fcdec04afc0 2024-05-09T02:18:30.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1c008ab0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f02a0e1c640 1 Processor -- start 2024-05-09T02:18:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3786292004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c031dd0 0x7fcf1c0321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcdf27fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcdec007920 0x7fcdec0de410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcdf2ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 0x7fcdec0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f02a0e1c640 1 -- start start 2024-05-09T02:18:30.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcdf2ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 0x7fcdec0073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42248/0 (socket says 172.21.15.46:42248) 2024-05-09T02:18:30.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcdf2ffd640 1 -- 172.21.15.46:0/1820839003 learned_addr learned my addr 172.21.15.46:0/1820839003 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f4320bb2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f431c071430 0x7f431c070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f4320bb2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431c0c6430 con 0x7f431c0c4500 2024-05-09T02:18:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fd66cc34640 1 Processor -- start 2024-05-09T02:18:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcdf37fe640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.107:3300/0 conn(0x7fcdec0d80a0 0x7fcdec0de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fcf2359e640 1 -- 172.21.15.46:0/3786292004 >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 msgr2=0x7fcf1c04b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3786292004 >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 0x7fcf1c04b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcf2359e640 1 -- 172.21.15.46:0/3786292004 >> v1:172.21.15.46:6789/0 conn(0x7fcf1c047e10 legacy=0x7fcf1c04afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcf2359e640 1 -- 172.21.15.46:0/3786292004 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c008d90 con 0x7fcf1c031dd0 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcf2259c640 1 --2- 172.21.15.46:0/3786292004 >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 0x7fcf1c04b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f923d47e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 0x7f9230047b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f923d47e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f923003f260 0x7f923003f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f923d47e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92300e3130 con 0x7f923000bc80 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f923d47e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f923004beb0 con 0x7f923003f260 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f923d47e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f923004bbd0 con 0x7f923000c370 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f9237fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 0x7f9230047b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f9237fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 0x7f9230047b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42264/0 (socket says 172.21.15.46:42264) 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f9237fff640 1 -- 172.21.15.46:0/2688205331 learned_addr learned my addr 172.21.15.46:0/2688205331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f923cc7d640 1 --2- 172.21.15.46:0/2688205331 >> v2:172.21.15.107:3300/0 conn(0x7f923003f260 0x7f923003f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f6cf7fff640 1 Processor -- start 2024-05-09T02:18:30.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f6cf7fff640 1 -- start start 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f4320bb2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431c0aaae0 con 0x7f431c0aeb80 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f4320bb2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f431c074d60 con 0x7f431c071430 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f431a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f431c071430 0x7f431c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f4319d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f431c0aeb80 0x7f431c0c5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37804/0 (socket says 172.21.15.46:37804) 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7f4319d9b640 1 -- 172.21.15.46:0/4258505302 learned_addr learned my addr 172.21.15.46:0/4258505302 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f431a59c640 1 -- 172.21.15.46:0/4258505302 >> v1:172.21.15.107:6789/0 conn(0x7f431c0aeb80 legacy=0x7f431c0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f431a59c640 1 -- 172.21.15.46:0/4258505302 >> v1:172.21.15.46:6789/0 conn(0x7f431c0c4500 legacy=0x7f431c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7f431a59c640 1 -- 172.21.15.46:0/4258505302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c0ae7f0 con 0x7f431c071430 2024-05-09T02:18:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.020+0000 7fd66cc34640 1 -- start start 2024-05-09T02:18:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcdf2ffd640 1 -- 172.21.15.46:0/1820839003 >> v2:172.21.15.107:3300/0 conn(0x7fcdec0d80a0 msgr2=0x7fcdec0de950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcdf2ffd640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.107:3300/0 conn(0x7fcdec0d80a0 0x7fcdec0de950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcdf2ffd640 1 -- 172.21.15.46:0/1820839003 >> v2:172.21.15.46:3300/0 conn(0x7fcdec007920 msgr2=0x7fcdec0de410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcdf2ffd640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.46:3300/0 conn(0x7fcdec007920 0x7fcdec0de410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.021+0000 7fcdf2ffd640 1 -- 172.21.15.46:0/1820839003 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec04ee90 con 0x7fcdec04afc0 2024-05-09T02:18:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f9237fff640 1 -- 172.21.15.46:0/2688205331 >> v2:172.21.15.107:3300/0 conn(0x7f923003f260 msgr2=0x7f923003f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3786292004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c031dd0 0x7fcf1c0321e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf24066140 tx=0x7fcf240a98e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6861887c15325ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fcf21d9b640 1 -- 172.21.15.46:0/3786292004 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf240ac070 con 0x7fcf1c031dd0 2024-05-09T02:18:30.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f9237fff640 1 --2- 172.21.15.46:0/2688205331 >> v2:172.21.15.107:3300/0 conn(0x7f923003f260 0x7f923003f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f9237fff640 1 -- 172.21.15.46:0/2688205331 >> v1:172.21.15.107:6789/0 conn(0x7f923000bc80 legacy=0x7f92300e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f9237fff640 1 -- 172.21.15.46:0/2688205331 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92300064c0 con 0x7f923000c370 2024-05-09T02:18:30.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f923cc7d640 1 --2- 172.21.15.46:0/2688205331 >> v2:172.21.15.107:3300/0 conn(0x7f923003f260 0x7f923003f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:30.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f02a0e1c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 0x7f029c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fcf21d9b640 1 -- 172.21.15.46:0/3786292004 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf240af490 con 0x7fcf1c031dd0 2024-05-09T02:18:30.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fcf21d9b640 1 -- 172.21.15.46:0/3786292004 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf240af900 con 0x7fcf1c031dd0 2024-05-09T02:18:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fcdf27fc640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.46:3300/0 conn(0x7fcdec007920 0x7fcdec0de410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fcdf37fe640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.107:3300/0 conn(0x7fcdec0d80a0 0x7fcdec0de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 0x7f029c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 0x7f029c150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42266/0 (socket says 172.21.15.46:42266) 2024-05-09T02:18:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fd66cc34640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6680c4d00 0x7fd668154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f431a59c640 1 --2- 172.21.15.46:0/4258505302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c070700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4310009720 tx=0x7f431002a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e5a79d8360bf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fd66cc34640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680a8280 0x7fd66806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f75757640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f680080f0 0x7f7f68008500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f02a0e1c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f029c0c33c0 0x7f029c153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7f029affd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f029c06f160 0x7f029c0c54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37828/0 (socket says 172.21.15.46:37828) 2024-05-09T02:18:30.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f029affd640 1 -- 172.21.15.46:0/967795658 learned_addr learned my addr 172.21.15.46:0/967795658 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f75757640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680df000 con 0x7f7f6804bf80 2024-05-09T02:18:30.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6cf0046380 0x7f6cf0049900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf7fff640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf000b950 con 0x7f6cf00dc770 2024-05-09T02:18:30.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf7fff640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf000bbf0 con 0x7f6cf004b180 2024-05-09T02:18:30.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f029c157ba0 con 0x7f029c06f160 2024-05-09T02:18:30.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf7fff640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf00dfa50 con 0x7f6cf0046380 2024-05-09T02:18:30.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f75757640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680df2e0 con 0x7f7f68048f40 2024-05-09T02:18:30.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f6effd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7f6804bf80 0x7f7f680e2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44146/0 (socket says 172.21.15.46:44146) 2024-05-09T02:18:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f6effd640 1 -- 172.21.15.46:0/2832257558 learned_addr learned my addr 172.21.15.46:0/2832257558 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f75757640 1 -- 172.21.15.46:0/2832257558 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7f680df5c0 con 0x7f7f680080f0 2024-05-09T02:18:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f029c070f00 con 0x7f029c0c33c0 2024-05-09T02:18:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f6f7fe640 1 --2- 172.21.15.46:0/2832257558 >> v2:172.21.15.107:3300/0 conn(0x7f7f680080f0 0x7f7f68008500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf77fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6cf0046380 0x7f6cf0049900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fd66cc34640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd668157490 con 0x7fd66806dc10 2024-05-09T02:18:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fd66cc34640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd6681580a0 con 0x7fd6680c4d00 2024-05-09T02:18:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.022+0000 7fd66cc34640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd668157770 con 0x7fd6680a8280 2024-05-09T02:18:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7fd6677fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6680c4d00 0x7fd668154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f9237fff640 1 --2- 172.21.15.46:0/2688205331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 0x7f9230047b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f922c009870 tx=0x7f922c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3310fc55740968e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f029c0c5060 con 0x7f029c0ae920 2024-05-09T02:18:30.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f029bfff640 1 --2- 172.21.15.46:0/967795658 >> v2:172.21.15.46:3300/0 conn(0x7f029c0c33c0 0x7f029c153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f029a7fc640 1 -- 172.21.15.46:0/967795658 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709472283 0 0) 0x7f029c157ba0 con 0x7f029c06f160 2024-05-09T02:18:30.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f029a7fc640 1 -- 172.21.15.46:0/967795658 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0284003520 con 0x7f029c06f160 2024-05-09T02:18:30.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf6ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6cf00dc770 0x7f6cf0047cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44158/0 (socket says 172.21.15.46:44158) 2024-05-09T02:18:30.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f6cf6ffd640 1 -- 172.21.15.46:0/1328955033 learned_addr learned my addr 172.21.15.46:0/1328955033 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7fcdf2ffd640 1 --2- 172.21.15.46:0/1820839003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 0x7fcdec0073e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcdf402e1c0 tx=0x7fcdf40a76d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58fdc3f714a36c47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f9236ffd640 1 -- 172.21.15.46:0/2688205331 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c037070 con 0x7f923000c370 2024-05-09T02:18:30.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f029b7fe640 1 -- 172.21.15.46:0/967795658 >> v2:172.21.15.46:3300/0 conn(0x7f029c0c33c0 msgr2=0x7f029c153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f029a7fc640 1 -- 172.21.15.46:0/967795658 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2471014624 0 0) 0x7f0284003520 con 0x7f029c06f160 2024-05-09T02:18:30.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7fd6677fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6680c4d00 0x7fd668154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36020/0 (socket says 172.21.15.46:36020) 2024-05-09T02:18:30.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7fd6677fe640 1 -- 172.21.15.46:0/1115174277 learned_addr learned my addr 172.21.15.46:0/1115174277 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7fd667fff640 1 --1- 172.21.15.46:0/1115174277 >> v1:172.21.15.107:6789/0 conn(0x7fd66806dc10 0x7fd6680c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37836/0 (socket says 172.21.15.46:37836) 2024-05-09T02:18:30.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd666ffd640 1 --2- 172.21.15.46:0/1115174277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680a8280 0x7fd66806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fcdf1ffb640 1 -- 172.21.15.46:0/1820839003 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b3070 con 0x7fcdec04afc0 2024-05-09T02:18:30.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd6667fc640 1 -- 172.21.15.46:0/1115174277 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780555280 0 0) 0x7fd668157490 con 0x7fd66806dc10 2024-05-09T02:18:30.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd6667fc640 1 -- 172.21.15.46:0/1115174277 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd650003520 con 0x7fd66806dc10 2024-05-09T02:18:30.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c031dd0 msgr2=0x7fcf1c0321e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fcf28975640 1 --2- 172.21.15.46:0/3786292004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c031dd0 0x7fcf1c0321e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf24066140 tx=0x7fcf240a98e0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f9236ffd640 1 -- 172.21.15.46:0/2688205331 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c032440 con 0x7f923000c370 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f9236ffd640 1 -- 172.21.15.46:0/2688205331 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c032810 con 0x7f923000c370 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f6cf5ffb640 1 -- 172.21.15.46:0/1328955033 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036534368 0 0) 0x7f6cf000b950 con 0x7f6cf00dc770 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f6cf5ffb640 1 -- 172.21.15.46:0/1328955033 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce0003520 con 0x7f6cf00dc770 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f6cf77fe640 1 -- 172.21.15.46:0/1328955033 >> v1:172.21.15.107:6789/0 conn(0x7f6cf004b180 legacy=0x7f6cf003e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f6cf77fe640 1 -- 172.21.15.46:0/1328955033 >> v1:172.21.15.46:6789/0 conn(0x7f6cf00dc770 legacy=0x7f6cf0047cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f6cf77fe640 1 -- 172.21.15.46:0/1328955033 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf0007580 con 0x7f6cf0046380 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f431959a640 1 -- 172.21.15.46:0/4258505302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310037070 con 0x7f431c071430 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f431959a640 1 -- 172.21.15.46:0/4258505302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431002ad40 con 0x7f431c071430 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f431959a640 1 -- 172.21.15.46:0/4258505302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310032660 con 0x7f431c071430 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f6f7fe640 1 -- 172.21.15.46:0/2832257558 >> v1:172.21.15.107:6789/0 conn(0x7f7f68048f40 legacy=0x7f7f6803fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.023+0000 7f7f6f7fe640 1 -- 172.21.15.46:0/2832257558 >> v1:172.21.15.46:6789/0 conn(0x7f7f6804bf80 legacy=0x7f7f680e2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f7f6dffb640 1 -- 172.21.15.46:0/2832257558 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051219588 0 0) 0x7f7f680df000 con 0x7f7f6804bf80 2024-05-09T02:18:30.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7f7f6f7fe640 1 -- 172.21.15.46:0/2832257558 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f680df8a0 con 0x7f7f680080f0 2024-05-09T02:18:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd6677fe640 1 -- 172.21.15.46:0/1115174277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680a8280 msgr2=0x7fd66806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd6677fe640 1 --2- 172.21.15.46:0/1115174277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680a8280 0x7fd66806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd6677fe640 1 -- 172.21.15.46:0/1115174277 >> v1:172.21.15.107:6789/0 conn(0x7fd66806dc10 legacy=0x7fd6680c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fcdf1ffb640 1 -- 172.21.15.46:0/1820839003 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf40ae600 con 0x7fcdec04afc0 2024-05-09T02:18:30.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fcdf1ffb640 1 -- 172.21.15.46:0/1820839003 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40aea70 con 0x7fcdec04afc0 2024-05-09T02:18:30.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 -- 172.21.15.46:0/4258505302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 msgr2=0x7f431c070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 --2- 172.21.15.46:0/4258505302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c070700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4310009720 tx=0x7f431002a030 comp rx=0 tx=0).stop 2024-05-09T02:18:30.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 -- 172.21.15.46:0/4258505302 shutdown_connections 2024-05-09T02:18:30.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 --2- 172.21.15.46:0/4258505302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c070700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 -- 172.21.15.46:0/4258505302 >> 172.21.15.46:0/4258505302 conn(0x7f431c0c9f20 msgr2=0x7f431c0ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.024+0000 7fd6677fe640 1 -- 172.21.15.46:0/1115174277 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd668157a50 con 0x7fd6680c4d00 2024-05-09T02:18:30.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f029b7fe640 1 --2- 172.21.15.46:0/967795658 >> v2:172.21.15.46:3300/0 conn(0x7f029c0c33c0 0x7f029c153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f029b7fe640 1 -- 172.21.15.46:0/967795658 >> v1:172.21.15.107:6789/0 conn(0x7f029c06f160 legacy=0x7f029c0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f029b7fe640 1 -- 172.21.15.46:0/967795658 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c0c4cf0 con 0x7f029c0ae920 2024-05-09T02:18:30.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 shutdown_connections 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcf28975640 1 --2- 172.21.15.46:0/3786292004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c031dd0 0x7fcf1c0321e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcf28975640 1 --2- 172.21.15.46:0/3786292004 >> v2:172.21.15.46:3300/0 conn(0x7fcf1c0d4df0 0x7fcf1c04b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 >> 172.21.15.46:0/3786292004 conn(0x7fcf1c00b4f0 msgr2=0x7fcf1c00b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 shutdown_connections 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcf28975640 1 -- 172.21.15.46:0/3786292004 wait complete. 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f029bfff640 1 --2- 172.21.15.46:0/967795658 >> v2:172.21.15.46:3300/0 conn(0x7f029c0c33c0 0x7f029c153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:30.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 -- 172.21.15.46:0/1820839003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 msgr2=0x7fcdec0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 -- 172.21.15.46:0/4258505302 shutdown_connections 2024-05-09T02:18:30.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 --2- 172.21.15.46:0/1820839003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 0x7fcdec0073e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcdf402e1c0 tx=0x7fcdf40a76d0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f4320bb2640 1 -- 172.21.15.46:0/4258505302 wait complete. 2024-05-09T02:18:30.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f6cf77fe640 1 --2- 172.21.15.46:0/1328955033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf0046380 0x7f6cf0049900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80097a0 tx=0x7f6ce802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3227f9e0f46d14c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 -- 172.21.15.46:0/1820839003 shutdown_connections 2024-05-09T02:18:30.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.107:3300/0 conn(0x7fcdec0d80a0 0x7fcdec0de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 --2- 172.21.15.46:0/1820839003 >> v2:172.21.15.46:3300/0 conn(0x7fcdec007920 0x7fcdec0de410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 --2- 172.21.15.46:0/1820839003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec04afc0 0x7fcdec0073e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7fcdf9261640 1 -- 172.21.15.46:0/1820839003 >> 172.21.15.46:0/1820839003 conn(0x7fcdec04c8d0 msgr2=0x7fcdec04cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 -- 172.21.15.46:0/2688205331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 msgr2=0x7f9230047b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 --2- 172.21.15.46:0/2688205331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 0x7f9230047b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f922c009870 tx=0x7f922c02a1c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 -- 172.21.15.46:0/2688205331 shutdown_connections 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 --2- 172.21.15.46:0/2688205331 >> v2:172.21.15.107:3300/0 conn(0x7f923003f260 0x7f923003f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 --2- 172.21.15.46:0/2688205331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000c370 0x7f9230047b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 -- 172.21.15.46:0/2688205331 >> 172.21.15.46:0/2688205331 conn(0x7f9230006cb0 msgr2=0x7f92300070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f7f6f7fe640 1 --2- 172.21.15.46:0/2832257558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680080f0 0x7f7f68008500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7f640097a0 tx=0x7f7f6402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e37dc6cb1f293b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f6cf5ffb640 1 -- 172.21.15.46:0/1328955033 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8037070 con 0x7f6cf0046380 2024-05-09T02:18:30.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7fcdf9261640 1 -- 172.21.15.46:0/1820839003 shutdown_connections 2024-05-09T02:18:30.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7f6cf5ffb640 1 -- 172.21.15.46:0/1328955033 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce802adb0 con 0x7f6cf0046380 2024-05-09T02:18:30.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7f6cf5ffb640 1 -- 172.21.15.46:0/1328955033 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8037070 con 0x7f6cf0046380 2024-05-09T02:18:30.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 -- 172.21.15.46:0/2688205331 shutdown_connections 2024-05-09T02:18:30.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.025+0000 7f923d47e640 1 -- 172.21.15.46:0/2688205331 wait complete. 2024-05-09T02:18:30.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7fd6677fe640 1 --2- 172.21.15.46:0/1115174277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680c4d00 0x7fd668154930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd65800bb00 tx=0x7fd65802c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2e2e0e44ed7c93 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7f029b7fe640 1 --2- 172.21.15.46:0/967795658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 0x7f029c150ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f029000dbc0 tx=0x7f029002e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5832835f5aa06f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7f029a7fc640 1 -- 172.21.15.46:0/967795658 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c0016f0 con 0x7f029c0ae920 2024-05-09T02:18:30.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7fd6667fc640 1 -- 172.21.15.46:0/1115174277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65803a070 con 0x7fd6680c4d00 2024-05-09T02:18:30.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7f029a7fc640 1 -- 172.21.15.46:0/967795658 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029000d0d0 con 0x7f029c0ae920 2024-05-09T02:18:30.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7f029a7fc640 1 -- 172.21.15.46:0/967795658 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029000b650 con 0x7f029c0ae920 2024-05-09T02:18:30.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7fd6667fc640 1 -- 172.21.15.46:0/1115174277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd658032480 con 0x7fd6680c4d00 2024-05-09T02:18:30.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7fd6667fc640 1 -- 172.21.15.46:0/1115174277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658032850 con 0x7fd6680c4d00 2024-05-09T02:18:30.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1328955033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf0046380 msgr2=0x7f6cf0049900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 --2- 172.21.15.46:0/1328955033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf0046380 0x7f6cf0049900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80097a0 tx=0x7f6ce802a060 comp rx=0 tx=0).stop 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1328955033 shutdown_connections 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 --2- 172.21.15.46:0/1328955033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf0046380 0x7f6cf0049900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1328955033 >> 172.21.15.46:0/1328955033 conn(0x7f6cf0006090 msgr2=0x7f6cf00064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1328955033 shutdown_connections 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1328955033 wait complete. 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 msgr2=0x7f029c150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7f02a0e1c640 1 --2- 172.21.15.46:0/967795658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 0x7f029c150ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f029000dbc0 tx=0x7f029002e410 comp rx=0 tx=0).stop 2024-05-09T02:18:30.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7fd66cc34640 1 -- 172.21.15.46:0/1115174277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680c4d00 msgr2=0x7fd668154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.027+0000 7fd66cc34640 1 --2- 172.21.15.46:0/1115174277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680c4d00 0x7fd668154930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd65800bb00 tx=0x7fd65802c5c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f7f6dffb640 1 -- 172.21.15.46:0/2832257558 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64037070 con 0x7f7f680080f0 2024-05-09T02:18:30.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 shutdown_connections 2024-05-09T02:18:30.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f02a0e1c640 1 --2- 172.21.15.46:0/967795658 >> v2:172.21.15.46:3300/0 conn(0x7f029c0c33c0 0x7f029c153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f02a0e1c640 1 --2- 172.21.15.46:0/967795658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c0ae920 0x7f029c150ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 >> 172.21.15.46:0/967795658 conn(0x7f029c06e640 msgr2=0x7f029c06ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7fcf28975640 1 Processor -- start 2024-05-09T02:18:30.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7fcf28975640 1 -- start start 2024-05-09T02:18:30.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f923d47e640 1 Processor -- start 2024-05-09T02:18:30.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f923d47e640 1 -- start start 2024-05-09T02:18:30.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 shutdown_connections 2024-05-09T02:18:30.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f02a0e1c640 1 -- 172.21.15.46:0/967795658 wait complete. 2024-05-09T02:18:30.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f4320bb2640 1 Processor -- start 2024-05-09T02:18:30.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f4320bb2640 1 -- start start 2024-05-09T02:18:30.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f7f6dffb640 1 -- 172.21.15.46:0/2832257558 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f64032440 con 0x7f7f680080f0 2024-05-09T02:18:30.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7f7f6dffb640 1 -- 172.21.15.46:0/2832257558 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64032810 con 0x7f7f680080f0 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7f7f75757640 1 -- 172.21.15.46:0/2832257558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680080f0 msgr2=0x7f7f68008500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7f7f75757640 1 --2- 172.21.15.46:0/2832257558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680080f0 0x7f7f68008500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7f640097a0 tx=0x7f7f6402a230 comp rx=0 tx=0).stop 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7f7f75757640 1 -- 172.21.15.46:0/2832257558 shutdown_connections 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7fd66cc34640 1 -- 172.21.15.46:0/1115174277 shutdown_connections 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7fd66cc34640 1 --2- 172.21.15.46:0/1115174277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680a8280 0x7fd66806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7fd66cc34640 1 --2- 172.21.15.46:0/1115174277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680c4d00 0x7fd668154930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7fd66cc34640 1 -- 172.21.15.46:0/1115174277 >> 172.21.15.46:0/1115174277 conn(0x7fd6680c5c10 msgr2=0x7fd6680c6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7fd66cc34640 1 -- 172.21.15.46:0/1115174277 shutdown_connections 2024-05-09T02:18:30.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.028+0000 7fd66cc34640 1 -- 172.21.15.46:0/1115174277 wait complete. 2024-05-09T02:18:30.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.026+0000 7fcdf9261640 1 -- 172.21.15.46:0/1820839003 wait complete. 2024-05-09T02:18:30.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7f7f75757640 1 --2- 172.21.15.46:0/2832257558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680080f0 0x7f7f68008500 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7f7f75757640 1 -- 172.21.15.46:0/2832257558 >> 172.21.15.46:0/2832257558 conn(0x7f7f6800b520 msgr2=0x7f7f6800b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f7f75757640 1 -- 172.21.15.46:0/2832257558 shutdown_connections 2024-05-09T02:18:30.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f7f75757640 1 -- 172.21.15.46:0/2832257558 wait complete. 2024-05-09T02:18:30.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f4320bb2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c1e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f431a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c1e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f431a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c1e3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36048/0 (socket says 172.21.15.46:36048) 2024-05-09T02:18:30.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f431a59c640 1 -- 172.21.15.46:0/3216350738 learned_addr learned my addr 172.21.15.46:0/3216350738 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f4320bb2640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f431c0aeb80 0x7f431c156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7f923d47e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000bc80 0x7f9230030a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f02a0e1c640 1 Processor -- start 2024-05-09T02:18:30.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f4320bb2640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f431c0c4500 0x7f431c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f431c074830 con 0x7f431c071430 2024-05-09T02:18:30.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7fd66cc34640 1 Processor -- start 2024-05-09T02:18:30.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f431c0ae5a0 con 0x7f431c0c4500 2024-05-09T02:18:30.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f431c1552a0 con 0x7f431c0aeb80 2024-05-09T02:18:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f923d47e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923000c370 0x7f9230175140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f4319d9b640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f431c0aeb80 0x7f431c156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7fcf28975640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf1c031dd0 0x7fcf1c0dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f6cf7fff640 1 Processor -- start 2024-05-09T02:18:30.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f9237fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000bc80 0x7f9230030a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f9237fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000bc80 0x7f9230030a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42296/0 (socket says 172.21.15.46:42296) 2024-05-09T02:18:30.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f9237fff640 1 -- 172.21.15.46:0/3603877927 learned_addr learned my addr 172.21.15.46:0/3603877927 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f431ad9d640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f431c0c4500 0x7f431c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f923d47e640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f923003f260 0x7f92300db690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f02a0e1c640 1 -- start start 2024-05-09T02:18:30.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f92377fe640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923000c370 0x7f9230175140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7fcf22d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf1c031dd0 0x7fcf1c0dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.029+0000 7fcdf9261640 1 Processor -- start 2024-05-09T02:18:30.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.030+0000 7fcdf9261640 1 -- start start 2024-05-09T02:18:30.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7fcf22d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf1c031dd0 0x7fcf1c0dafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36054/0 (socket says 172.21.15.46:36054) 2024-05-09T02:18:30.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7f6cf7fff640 1 -- start start 2024-05-09T02:18:30.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7fcf22d9d640 1 -- 172.21.15.46:0/3402637912 learned_addr learned my addr 172.21.15.46:0/3402637912 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcf28975640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c047e10 0x7fcf1c163410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.031+0000 7fd66cc34640 1 -- start start 2024-05-09T02:18:30.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f923cc7d640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f923003f260 0x7f92300db690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4319d9b640 1 -- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f431c0c4500 msgr2=0x7f431c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4319d9b640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f431c0c4500 0x7f431c0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4319d9b640 1 -- 172.21.15.46:0/3216350738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 msgr2=0x7f431c1e3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4319d9b640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c1e3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4319d9b640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c155a40 con 0x7f431c0aeb80 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf9261640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec007920 0x7fcdec0da810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf9261640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec04afc0 0x7fcdec00a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf9261640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdec0d80a0 0x7fcdec0d3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf9261640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec04c5c0 con 0x7fcdec04afc0 2024-05-09T02:18:30.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf9261640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec04e280 con 0x7fcdec0d80a0 2024-05-09T02:18:30.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf9261640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcdec165a60 con 0x7fcdec007920 2024-05-09T02:18:30.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcf28975640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf1c0d4df0 0x7fcf1c043000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcf2259c640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c047e10 0x7fcf1c163410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f431a59c640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c071430 0x7f431c1e3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f923d47e640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f92300dc680 con 0x7f923003f260 2024-05-09T02:18:30.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f923d47e640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f92300e2500 con 0x7f923000c370 2024-05-09T02:18:30.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f923d47e640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f92300dc800 con 0x7f923000bc80 2024-05-09T02:18:30.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4319d9b640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f431c0aeb80 0x7f431c156750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f431400c9f0 tx=0x7f431400ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdec0d80a0 0x7fcdec0d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdec0d80a0 0x7fcdec0d3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44784/0 (socket says 172.21.15.46:44784) 2024-05-09T02:18:30.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcdf37fe640 1 -- 172.21.15.46:0/2037153589 learned_addr learned my addr 172.21.15.46:0/2037153589 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c04bc20 con 0x7fcf1c031dd0 2024-05-09T02:18:30.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314018070 con 0x7f431c0aeb80 2024-05-09T02:18:30.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431400a700 con 0x7f431c0aeb80 2024-05-09T02:18:30.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431c0ae340 con 0x7f431c0aeb80 2024-05-09T02:18:30.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf1c0d4df0 0x7fcf1c043000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431400aad0 con 0x7f431c0aeb80 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.032+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f431c0ade20 con 0x7f431c0aeb80 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcdf37fe640 1 -- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec007920 msgr2=0x7fcdec0da810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcdf37fe640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcdec007920 0x7fcdec0da810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcdf37fe640 1 -- 172.21.15.46:0/2037153589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec04afc0 msgr2=0x7fcdec00a160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcdf37fe640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec04afc0 0x7fcdec00a160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcdf37fe640 1 -- 172.21.15.46:0/2037153589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec049fd0 con 0x7fcdec0d80a0 2024-05-09T02:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcdf37fe640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdec0d80a0 0x7fcdec0d3050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcde800c7f0 tx=0x7fcde800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f02a0e1c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c06f160 0x7f029c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f02a0e1c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029c0ae920 0x7f029c0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f02a0e1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c33c0 0x7f029c1e0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c06f160 0x7f029c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c06f160 0x7f029c155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42326/0 (socket says 172.21.15.46:42326) 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f029b7fe640 1 -- 172.21.15.46:0/2489309362 learned_addr learned my addr 172.21.15.46:0/2489309362 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f029c0ad3b0 con 0x7f029c0c33c0 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f029c0ad230 con 0x7f029c0ae920 2024-05-09T02:18:30.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f029c153da0 con 0x7f029c06f160 2024-05-09T02:18:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f029affd640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029c0ae920 0x7f029c0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f7f75757640 1 Processor -- start 2024-05-09T02:18:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c009350 con 0x7fcf1c0d4df0 2024-05-09T02:18:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1c032720 con 0x7fcf1c047e10 2024-05-09T02:18:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f7f75757640 1 -- start start 2024-05-09T02:18:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8015020 con 0x7fcdec0d80a0 2024-05-09T02:18:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f431c155f20 con 0x7f431c0aeb80 2024-05-09T02:18:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde8004230 con 0x7fcdec0d80a0 2024-05-09T02:18:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f029affd640 1 -- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c06f160 msgr2=0x7f029c155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcf22d9d640 1 -- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c047e10 msgr2=0x7fcf1c163410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcf22d9d640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c047e10 0x7fcf1c163410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcf22d9d640 1 -- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf1c0d4df0 msgr2=0x7fcf1c043000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcf22d9d640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf1c0d4df0 0x7fcf1c043000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7fcf22d9d640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c0d9f60 con 0x7fcf1c031dd0 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7fcf22d9d640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf1c031dd0 0x7fcf1c0dafa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400c760 tx=0x7fcf1400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f923cc7d640 1 -- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000bc80 msgr2=0x7f9230030a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f923cc7d640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923000bc80 0x7f9230030a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f923cc7d640 1 -- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923000c370 msgr2=0x7f9230175140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f923cc7d640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923000c370 0x7f9230175140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f923cc7d640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9230035f40 con 0x7f923003f260 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f923cc7d640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f923003f260 0x7f92300db690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9238051620 tx=0x7f923806ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923809b070 con 0x7f923003f260 2024-05-09T02:18:30.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.033+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923808da60 con 0x7f923003f260 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f923d47e640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9230036420 con 0x7f923003f260 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923809b070 con 0x7f923003f260 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f923d47e640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92300dd140 con 0x7f923003f260 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf0046380 0x7f6cf003f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf004b180 0x7f6cf0041890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf6ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf0046380 0x7f6cf003f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf6ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf0046380 0x7f6cf003f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42336/0 (socket says 172.21.15.46:42336) 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf67fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf004b180 0x7f6cf0041890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf67fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf004b180 0x7f6cf0041890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44816/0 (socket says 172.21.15.46:44816) 2024-05-09T02:18:30.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf67fc640 1 -- 172.21.15.46:0/1344024229 learned_addr learned my addr 172.21.15.46:0/1344024229 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf7fff640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf00dc770 0x7f6cf00de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf003f0e0 con 0x7f6cf00dc770 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf0049e40 con 0x7f6cf004b180 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf003f260 con 0x7f6cf0046380 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f029affd640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f029c06f160 0x7f029c155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f029affd640 1 -- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c33c0 msgr2=0x7f029c1e0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f029affd640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c33c0 0x7f029c1e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7f029affd640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c14a2d0 con 0x7f029c0ae920 2024-05-09T02:18:30.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f029affd640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029c0ae920 0x7f029c0c65b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f028c005880 tx=0x7f028c00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd66cc34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66806dc10 0x7fd6680738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd66cc34640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680a8280 0x7fd6681dd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd66cc34640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680c4d00 0x7fd6681dd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd66cc34640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680c7820 con 0x7fd6680a8280 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd66cc34640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680c5920 con 0x7fd66806dc10 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd66cc34640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd6680c79a0 con 0x7fd6680c4d00 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680a8280 0x7fd6681dd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680a8280 0x7fd6681dd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36090/0 (socket says 172.21.15.46:36090) 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 -- 172.21.15.46:0/735655534 learned_addr learned my addr 172.21.15.46:0/735655534 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 -- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680c4d00 msgr2=0x7fd6681dd8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6680c4d00 0x7fd6681dd8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 -- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66806dc10 msgr2=0x7fd6680738b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66806dc10 0x7fd6680738b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fd666ffd640 1 -- 172.21.15.46:0/735655534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6681e9e90 con 0x7fd6680a8280 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7fd666ffd640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680a8280 0x7fd6681dd370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d600 tx=0x7fd66000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec0db3a0 con 0x7fcdec0d80a0 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.034+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdec0da2f0 con 0x7fcdec0d80a0 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf1c0d4df0 0x7fcf1c043000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7fcf2259c640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf1c047e10 0x7fcf1c163410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f6cf77fe640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf00dc770 0x7f6cf00de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c017070 con 0x7f029c0ae920 2024-05-09T02:18:30.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c005ce0 con 0x7f029c0ae920 2024-05-09T02:18:30.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8007620 con 0x7fcdec0d80a0 2024-05-09T02:18:30.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c007310 con 0x7f029c0ae920 2024-05-09T02:18:30.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcdd4001030 con 0x7fcdec0d80a0 2024-05-09T02:18:30.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f7f75757640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f680080f0 0x7f7f680086e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6600125f0 con 0x7fd6680a8280 2024-05-09T02:18:30.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.035+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f431401b070 con 0x7f431c0aeb80 2024-05-09T02:18:30.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f430affd640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42fc0763d0 0x7f42fc0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd660019070 con 0x7fd6680a8280 2024-05-09T02:18:30.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f6cf67fc640 1 -- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf0046380 msgr2=0x7f6cf003f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f6cf67fc640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6cf0046380 0x7f6cf003f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f6cf67fc640 1 -- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf00dc770 msgr2=0x7f6cf00de4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f6cf67fc640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf00dc770 0x7f6cf00de4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f6cf67fc640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf00d8860 con 0x7f6cf004b180 2024-05-09T02:18:30.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6680aa790 con 0x7fd6680a8280 2024-05-09T02:18:30.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f7f75757640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f68048f40 0x7f7f68175040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6680c3170 con 0x7fd6680a8280 2024-05-09T02:18:30.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4314097180 con 0x7f431c0aeb80 2024-05-09T02:18:30.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9230175ea0 con 0x7f923003f260 2024-05-09T02:18:30.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f75757640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6804bf80 0x7f7f680cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf140050d0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029c1e94d0 con 0x7f029c0ae920 2024-05-09T02:18:30.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.036+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029c1e9790 con 0x7f029c0ae920 2024-05-09T02:18:30.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f430affd640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f42fc080cc0 0x7f42fc083110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4314017ec0 con 0x7f42fc080cc0 2024-05-09T02:18:30.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f431409e050 con 0x7f431c0aeb80 2024-05-09T02:18:30.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf14005270 con 0x7fcf1c031dd0 2024-05-09T02:18:30.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1c16d3a0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f6cf67fc640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf004b180 0x7f6cf0041890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80757a0 tx=0x7f6cf8069e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f029c050870 con 0x7f029c0ae920 2024-05-09T02:18:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f75757640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68040220 con 0x7f7f680080f0 2024-05-09T02:18:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f75757640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68049350 con 0x7f7f68048f40 2024-05-09T02:18:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f75757640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680403a0 con 0x7f7f6804bf80 2024-05-09T02:18:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcde8018020 con 0x7fcdec0d80a0 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f6e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f68048f40 0x7f7f68175040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f6e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f68048f40 0x7f7f68175040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44830/0 (socket says 172.21.15.46:44830) 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f7f6e7fc640 1 -- 172.21.15.46:0/2401479586 learned_addr learned my addr 172.21.15.46:0/2401479586 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.037+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf808d940 con 0x7f6cf004b180 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf8091070 con 0x7f6cf004b180 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf808d940 con 0x7f6cf004b180 2024-05-09T02:18:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf00d6bd0 con 0x7f6cf004b180 2024-05-09T02:18:30.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f7f6f7fe640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6804bf80 0x7f7f680cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf00d90d0 con 0x7f6cf004b180 2024-05-09T02:18:30.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660012990 con 0x7fd6680a8280 2024-05-09T02:18:30.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd648001030 con 0x7fd6680a8280 2024-05-09T02:18:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7fcddb7fe640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcde00762d0 0x7fcde00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f7f6e7fc640 1 -- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6804bf80 msgr2=0x7f7f680cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f7f6e7fc640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f6804bf80 0x7f7f680cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f7f6e7fc640 1 -- 172.21.15.46:0/2401479586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f680080f0 msgr2=0x7f7f680086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f7f6e7fc640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f680080f0 0x7f7f680086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f7f6e7fc640 1 -- 172.21.15.46:0/2401479586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f68178c20 con 0x7f7f68048f40 2024-05-09T02:18:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcde8097a50 con 0x7fcdec0d80a0 2024-05-09T02:18:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f431a59c640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42fc0763d0 0x7f42fc0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f028c01a070 con 0x7f029c0ae920 2024-05-09T02:18:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.038+0000 7fcddb7fe640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fcde0080bb0 0x7fcde0083000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400a640 con 0x7fcf1c031dd0 2024-05-09T02:18:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7fcdf2ffd640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcde00762d0 0x7fcde00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f7f6e7fc640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f68048f40 0x7f7f68175040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f70052220 tx=0x7f7f70069760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf1c0457a0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 --> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcde8004230 con 0x7fcde0080bb0 2024-05-09T02:18:30.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcde809a2c0 con 0x7fcdec0d80a0 2024-05-09T02:18:30.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f431ad9d640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f42fc080cc0 0x7f42fc083110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f0283fff640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02880763a0 0x7f02880788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7008da00 con 0x7f7f68048f40 2024-05-09T02:18:30.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f431a59c640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42fc0763d0 0x7f42fc0788e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4310035040 tx=0x7f431002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f028c096b50 con 0x7f029c0ae920 2024-05-09T02:18:30.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f0283fff640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7f0288080c90 0x7f02880830e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02880837b0 con 0x7f0288080c90 2024-05-09T02:18:30.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f028c09b2a0 con 0x7f029c0ae920 2024-05-09T02:18:30.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f029bfff640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7f0288080c90 0x7f02880830e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf1c0452d0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f431ad9d640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f42fc080cc0 0x7f42fc083110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f6cdd7fa640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cf0005570 con 0x7f6cf004b180 2024-05-09T02:18:30.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7fcdf27fc640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fcde0080bb0 0x7fcde0083000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f70091070 con 0x7f7f68048f40 2024-05-09T02:18:30.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.039+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f68178ec0 con 0x7f7f68048f40 2024-05-09T02:18:30.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f68040a80 con 0x7f7f68048f40 2024-05-09T02:18:30.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f029b7fe640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02880763a0 0x7f02880788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7008da00 con 0x7f7f68048f40 2024-05-09T02:18:30.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f923808dc10 con 0x7f923003f260 2024-05-09T02:18:30.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.040+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6cf808db20 con 0x7f6cf004b180 2024-05-09T02:18:30.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f681791a0 con 0x7f7f68048f40 2024-05-09T02:18:30.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7fcdf2ffd640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcde00762d0 0x7fcde00787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcdec04ed30 tx=0x7fcdf4070030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7f029bfff640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7f0288080c90 0x7f02880830e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7fcdf27fc640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fcde0080bb0 0x7fcde0083000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7f029b7fe640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02880763a0 0x7f02880788b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0290038040 tx=0x7f0290032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== osd.4 v2:172.21.15.107:6824/2823066883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4314017ec0 con 0x7f42fc080cc0 2024-05-09T02:18:30.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7f6cdf7fe640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ce40766d0 0x7f6ce4078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6cf808d740 con 0x7f6cf004b180 2024-05-09T02:18:30.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd660012b30 con 0x7fd6680a8280 2024-05-09T02:18:30.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f6cdf7fe640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7f6ce4080e30 0x7f6ce4083280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cf8099e50 con 0x7f6ce4080e30 2024-05-09T02:18:30.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== osd.3 v2:172.21.15.46:6808/2010129310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02880837b0 con 0x7f0288080c90 2024-05-09T02:18:30.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== osd.7 v2:172.21.15.107:6800/3874977895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcde8004230 con 0x7fcde0080bb0 2024-05-09T02:18:30.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f6cf6ffd640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ce40766d0 0x7f6ce4078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f7008dc20 con 0x7f7f68048f40 2024-05-09T02:18:30.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f6cf77fe640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7f6ce4080e30 0x7f6ce4083280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cf80d9270 con 0x7f6cf004b180 2024-05-09T02:18:30.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf1400a7e0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f7f577fe640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f5c076500 0x7f7f5c078a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fd64ffff640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd654076320 0x7fd654078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd6600985e0 con 0x7fd6680a8280 2024-05-09T02:18:30.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fd64ffff640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7fd654080c00 0x7fd654083050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 --> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd660004470 con 0x7fd654080c00 2024-05-09T02:18:30.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd660098a70 con 0x7fd6680a8280 2024-05-09T02:18:30.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7f70114620 con 0x7f7f68048f40 2024-05-09T02:18:30.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f6cf77fe640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7f6ce4080e30 0x7f6ce4083280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.041+0000 7f9234ff9640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f921c0764d0 0x7f921c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9238114560 con 0x7f923003f260 2024-05-09T02:18:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.042+0000 7f9237fff640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f921c0764d0 0x7f921c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f7f577fe640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f7f5c080ce0 0x7f7f5c083130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7fcf0b7fe640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcf10076350 0x7fcf10078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f9234ff9640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f921c080cc0 0x7f921c083110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f923806e6a0 con 0x7f921c080cc0 2024-05-09T02:18:30.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92381149f0 con 0x7f923003f260 2024-05-09T02:18:30.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f92377fe640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f921c080cc0 0x7f921c083110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 --> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f5c083800 con 0x7f7f5c080ce0 2024-05-09T02:18:30.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.043+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f70114ab0 con 0x7f7f68048f40 2024-05-09T02:18:30.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7f9237fff640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f921c0764d0 0x7f921c0789e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f922c0090b0 tx=0x7f922c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcf14097cc0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fd6677fe640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd654076320 0x7fd654078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fcf0b7fe640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fcf10080c40 0x7fcf10083090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7f7f6f7fe640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f7f5c080ce0 0x7f7f5c083130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf14013e70 con 0x7fcf10080c40 2024-05-09T02:18:30.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcf140981a0 con 0x7fcf1c031dd0 2024-05-09T02:18:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7f92377fe640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f921c080cc0 0x7f921c083110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fd667fff640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7fd654080c00 0x7fd654083050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7f7f6effd640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f5c076500 0x7f7f5c078a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fcf2259c640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcf10076350 0x7fcf10078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fcf10080c40 0x7fcf10083090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7f7f6f7fe640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f7f5c080ce0 0x7f7f5c083130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7fcf2259c640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcf10076350 0x7fcf10078860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c043dc0 tx=0x7fcf18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7f7f6effd640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f5c076500 0x7f7f5c078a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f60000c00 tx=0x7f7f600079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7fd667fff640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7fd654080c00 0x7fd654083050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7fcf2359e640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fcf10080c40 0x7fcf10083090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.044+0000 7f6cf6ffd640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ce40766d0 0x7f6ce4078be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cec007fd0 tx=0x7f6cec007f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== osd.2 v2:172.21.15.46:6818/2243748117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cf8099e50 con 0x7f6ce4080e30 2024-05-09T02:18:30.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7fd6677fe640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd654076320 0x7fd654078830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd658037000 tx=0x7fd658030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.045+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== osd.1 v2:172.21.15.46:6809/960382158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f923806e6a0 con 0x7f921c080cc0 2024-05-09T02:18:30.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.046+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== osd.5 v2:172.21.15.107:6816/278179118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f5c083800 con 0x7f7f5c080ce0 2024-05-09T02:18:30.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.047+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== osd.0 v2:172.21.15.46:6800/738364260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf14013e70 con 0x7fcf10080c40 2024-05-09T02:18:30.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.047+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== osd.6 v2:172.21.15.107:6808/425658714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd660004470 con 0x7fd654080c00 2024-05-09T02:18:30.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.075+0000 7f4320bb2640 1 -- 172.21.15.46:0/3216350738 --> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f431c1f2210 con 0x7f42fc080cc0 2024-05-09T02:18:30.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.075+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 --> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcdd4002dd0 con 0x7fcde0080bb0 2024-05-09T02:18:30.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.075+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 --> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f029c14a4f0 con 0x7f0288080c90 2024-05-09T02:18:30.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.075+0000 7f430affd640 1 -- 172.21.15.46:0/3216350738 <== osd.4 v2:172.21.15.107:6824/2823066883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f431c1f2210 con 0x7f42fc080cc0 2024-05-09T02:18:30.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7fcddb7fe640 1 -- 172.21.15.46:0/2037153589 <== osd.7 v2:172.21.15.107:6800/3874977895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcdd4002dd0 con 0x7fcde0080bb0 2024-05-09T02:18:30.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f0283fff640 1 -- 172.21.15.46:0/2489309362 <== osd.3 v2:172.21.15.46:6808/2010129310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f029c14a4f0 con 0x7f0288080c90 2024-05-09T02:18:30.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f42fc080cc0 msgr2=0x7f42fc083110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f4308ff9640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f42fc080cc0 0x7f42fc083110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42fc0763d0 msgr2=0x7f42fc0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f4308ff9640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42fc0763d0 0x7f42fc0788e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4310035040 tx=0x7f431002e000 comp rx=0 tx=0).stop 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f431c0aeb80 msgr2=0x7f431c156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f4308ff9640 1 --2- 172.21.15.46:0/3216350738 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f431c0aeb80 0x7f431c156750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f431400c9f0 tx=0x7f431400ceb0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7f431ad9d640 1 -- 172.21.15.46:0/3216350738 reap_dead start 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fcde0080bb0 msgr2=0x7fcde0083000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.076+0000 7fcdf9261640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fcde0080bb0 0x7fcde0083000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 shutdown_connections 2024-05-09T02:18:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcde00762d0 msgr2=0x7fcde00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcde00762d0 0x7fcde00787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcdec04ed30 tx=0x7fcdf4070030 comp rx=0 tx=0).stop 2024-05-09T02:18:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 >> 172.21.15.46:0/3216350738 conn(0x7f431c0c9f20 msgr2=0x7f431c151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdec0d80a0 msgr2=0x7fcdec0d3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 --2- 172.21.15.46:0/2037153589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdec0d80a0 0x7fcdec0d3050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcde800c7f0 tx=0x7fcde800ccb0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf37fe640 1 -- 172.21.15.46:0/2037153589 reap_dead start 2024-05-09T02:18:30.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 shutdown_connections 2024-05-09T02:18:30.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 >> 172.21.15.46:0/2037153589 conn(0x7fcdec04c8d0 msgr2=0x7fcdec0de260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 shutdown_connections 2024-05-09T02:18:30.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 shutdown_connections 2024-05-09T02:18:30.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7fcdf9261640 1 -- 172.21.15.46:0/2037153589 wait complete. 2024-05-09T02:18:30.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7f0288080c90 msgr2=0x7f02880830e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f02a0e1c640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7f0288080c90 0x7f02880830e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f6cdd7fa640 1 -- 172.21.15.46:0/1344024229 --> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cf00dbfe0 con 0x7f6ce4080e30 2024-05-09T02:18:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02880763a0 msgr2=0x7f02880788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f02a0e1c640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02880763a0 0x7f02880788b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0290038040 tx=0x7f0290032000 comp rx=0 tx=0).stop 2024-05-09T02:18:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029c0ae920 msgr2=0x7f029c0c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.077+0000 7f02a0e1c640 1 --2- 172.21.15.46:0/2489309362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029c0ae920 0x7f029c0c65b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f028c005880 tx=0x7f028c00c960 comp rx=0 tx=0).stop 2024-05-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f029bfff640 1 -- 172.21.15.46:0/2489309362 reap_dead start 2024-05-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 shutdown_connections 2024-05-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 >> 172.21.15.46:0/2489309362 conn(0x7f029c06e640 msgr2=0x7f029c156f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f4308ff9640 1 -- 172.21.15.46:0/3216350738 wait complete. 2024-05-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f6cdf7fe640 1 -- 172.21.15.46:0/1344024229 <== osd.2 v2:172.21.15.46:6818/2243748117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6cf00dbfe0 con 0x7f6ce4080e30 2024-05-09T02:18:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7f6ce4080e30 msgr2=0x7f6ce4083280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.078+0000 7f6cf7fff640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7f6ce4080e30 0x7f6ce4083280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 shutdown_connections 2024-05-09T02:18:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f02a0e1c640 1 -- 172.21.15.46:0/2489309362 wait complete. 2024-05-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ce40766d0 msgr2=0x7f6ce4078be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6ce40766d0 0x7f6ce4078be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cec007fd0 tx=0x7f6cec007f60 comp rx=0 tx=0).stop 2024-05-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf004b180 msgr2=0x7f6cf0041890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 --> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9230175ea0 con 0x7f921c080cc0 2024-05-09T02:18:30.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 --2- 172.21.15.46:0/1344024229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cf004b180 0x7f6cf0041890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80757a0 tx=0x7f6cf8069e80 comp rx=0 tx=0).stop 2024-05-09T02:18:30.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf77fe640 1 -- 172.21.15.46:0/1344024229 reap_dead start 2024-05-09T02:18:30.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 --> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f680430f0 con 0x7f7f5c080ce0 2024-05-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 shutdown_connections 2024-05-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 >> 172.21.15.46:0/1344024229 conn(0x7f6cf0006090 msgr2=0x7f6cf00db5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 shutdown_connections 2024-05-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7f6cf7fff640 1 -- 172.21.15.46:0/1344024229 wait complete. 2024-05-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.079+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 --> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf1c0059c0 con 0x7fcf10080c40 2024-05-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.080+0000 7f9234ff9640 1 -- 172.21.15.46:0/3603877927 <== osd.1 v2:172.21.15.46:6809/960382158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9230175ea0 con 0x7f921c080cc0 2024-05-09T02:18:30.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.080+0000 7f7f577fe640 1 -- 172.21.15.46:0/2401479586 <== osd.5 v2:172.21.15.107:6816/278179118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f5c083800 con 0x7f7f5c080ce0 2024-05-09T02:18:30.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.080+0000 7fcf0b7fe640 1 -- 172.21.15.46:0/3402637912 <== osd.0 v2:172.21.15.46:6800/738364260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf1c0059c0 con 0x7fcf10080c40 2024-05-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.080+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f7f5c080ce0 msgr2=0x7f7f5c083130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.080+0000 7f7f75757640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f7f5c080ce0 0x7f7f5c083130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 --> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd648002d50 con 0x7fd654080c00 2024-05-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fcf10080c40 msgr2=0x7fcf10083090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7fcf28975640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fcf10080c40 0x7fcf10083090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f921c080cc0 msgr2=0x7f921c083110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f92227fc640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f921c080cc0 0x7f921c083110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f5c076500 msgr2=0x7f7f5c078a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f7f75757640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f5c076500 0x7f7f5c078a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f60000c00 tx=0x7f7f600079c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f68048f40 msgr2=0x7f7f68175040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f7f75757640 1 --2- 172.21.15.46:0/2401479586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f68048f40 0x7f7f68175040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f70052220 tx=0x7f7f70069760 comp rx=0 tx=0).stop 2024-05-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f7f6f7fe640 1 -- 172.21.15.46:0/2401479586 reap_dead start 2024-05-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f921c0764d0 msgr2=0x7f921c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f92227fc640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f921c0764d0 0x7f921c0789e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f922c0090b0 tx=0x7f922c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f923003f260 msgr2=0x7f92300db690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f92227fc640 1 --2- 172.21.15.46:0/3603877927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f923003f260 0x7f92300db690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9238051620 tx=0x7f923806ec20 comp rx=0 tx=0).stop 2024-05-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7f923cc7d640 1 -- 172.21.15.46:0/3603877927 reap_dead start 2024-05-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.081+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcf10076350 msgr2=0x7fcf10078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcf10076350 0x7fcf10078860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c043dc0 tx=0x7fcf18008040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 shutdown_connections 2024-05-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 >> 172.21.15.46:0/2401479586 conn(0x7f7f6800b520 msgr2=0x7f7f680dd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fd64ffff640 1 -- 172.21.15.46:0/735655534 <== osd.6 v2:172.21.15.107:6808/425658714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd648002d50 con 0x7fd654080c00 2024-05-09T02:18:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf1c031dd0 msgr2=0x7fcf1c0dafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 --2- 172.21.15.46:0/3402637912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf1c031dd0 0x7fcf1c0dafa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400c760 tx=0x7fcf1400cc20 comp rx=0 tx=0).stop 2024-05-09T02:18:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf2359e640 1 -- 172.21.15.46:0/3402637912 reap_dead start 2024-05-09T02:18:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 shutdown_connections 2024-05-09T02:18:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 >> 172.21.15.46:0/3603877927 conn(0x7f9230006cb0 msgr2=0x7f92300e1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 shutdown_connections 2024-05-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 shutdown_connections 2024-05-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 shutdown_connections 2024-05-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 >> 172.21.15.46:0/3402637912 conn(0x7fcf1c00b4f0 msgr2=0x7fcf1c0d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f92227fc640 1 -- 172.21.15.46:0/3603877927 wait complete. 2024-05-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7f7f75757640 1 -- 172.21.15.46:0/2401479586 wait complete. 2024-05-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 shutdown_connections 2024-05-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fcf28975640 1 -- 172.21.15.46:0/3402637912 wait complete. 2024-05-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7fd654080c00 msgr2=0x7fd654083050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fd66cc34640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7fd654080c00 0x7fd654083050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.082+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd654076320 msgr2=0x7fd654078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd654076320 0x7fd654078830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd658037000 tx=0x7fd658030000 comp rx=0 tx=0).stop 2024-05-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680a8280 msgr2=0x7fd6681dd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 --2- 172.21.15.46:0/735655534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6680a8280 0x7fd6681dd370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d600 tx=0x7fd66000dac0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd667fff640 1 -- 172.21.15.46:0/735655534 reap_dead start 2024-05-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 shutdown_connections 2024-05-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 >> 172.21.15.46:0/735655534 conn(0x7fd6680c5c10 msgr2=0x7fd668152e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 shutdown_connections 2024-05-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.083+0000 7fd66cc34640 1 -- 172.21.15.46:0/735655534 wait complete. 2024-05-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T02:18:30.144 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T02:18:30.145 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T02:18:30.146 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T02:18:30.147 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T02:18:30.148 INFO:teuthology.orchestra.run.smithi046.stdout:55834574858 2024-05-09T02:18:30.148 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T02:18:30.149 INFO:teuthology.orchestra.run.smithi046.stdout:55834574858 2024-05-09T02:18:30.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T02:18:30.150 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2024-05-09T02:18:30.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T02:18:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.408+0000 7f052759e640 1 Processor -- start 2024-05-09T02:18:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.408+0000 7f052759e640 1 -- start start 2024-05-09T02:18:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.407+0000 7fb64d31b640 1 Processor -- start 2024-05-09T02:18:30.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.407+0000 7fb64d31b640 1 -- start start 2024-05-09T02:18:30.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.409+0000 7f892a2b8640 1 Processor -- start 2024-05-09T02:18:30.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.409+0000 7f892a2b8640 1 -- start start 2024-05-09T02:18:30.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052759e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f0520046380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052759e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f052003e9d0 0x7f052003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052759e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f052004aff0 con 0x7f052004b4f0 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052759e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f052000b510 con 0x7f052003e9d0 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052759e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f052004b2b0 con 0x7f05200dc600 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f052004b4f0 0x7f0520047c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44166/0 (socket says 172.21.15.46:44166) 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f052659c640 1 -- 172.21.15.46:0/2584630430 learned_addr learned my addr 172.21.15.46:0/2584630430 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7f0525d9b640 1 --2- 172.21.15.46:0/2584630430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f0520046380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb64d31b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb640007750 0x7fb640006d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f892a2b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8924151b40 0x7f89241583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f892a2b8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8924158900 con 0x7f89240c92d0 2024-05-09T02:18:30.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f892a2b8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89240c79d0 con 0x7f89240c5b60 2024-05-09T02:18:30.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f892a2b8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f89240c7cb0 con 0x7f8924151b40 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb64d31b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400da240 0x7fb6400da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb64d31b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb640046d90 con 0x7fb6400466a0 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb64d31b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb64000bd70 con 0x7fb640007750 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb64d31b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6400473a0 con 0x7fb6400da240 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb6477fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb6400466a0 0x7fb6400d4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44170/0 (socket says 172.21.15.46:44170) 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb6477fe640 1 -- 172.21.15.46:0/3377330597 learned_addr learned my addr 172.21.15.46:0/3377330597 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.410+0000 7fb647fff640 1 --2- 172.21.15.46:0/3377330597 >> v2:172.21.15.46:3300/0 conn(0x7fb640007750 0x7fb640006d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f8928855640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f89240c5b60 0x7f89240c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37856/0 (socket says 172.21.15.46:37856) 2024-05-09T02:18:30.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f8928855640 1 -- 172.21.15.46:0/1402963042 learned_addr learned my addr 172.21.15.46:0/1402963042 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7f487db38640 1 Processor -- start 2024-05-09T02:18:30.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7fb647fff640 1 -- 172.21.15.46:0/3377330597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400da240 msgr2=0x7fb6400da650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:30.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7fb647fff640 1 --2- 172.21.15.46:0/3377330597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400da240 0x7fb6400da650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7fb647fff640 1 -- 172.21.15.46:0/3377330597 >> v1:172.21.15.46:6789/0 conn(0x7fb6400466a0 legacy=0x7fb6400d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7fb647fff640 1 -- 172.21.15.46:0/3377330597 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64000ba90 con 0x7fb640007750 2024-05-09T02:18:30.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f0525d9b640 1 -- 172.21.15.46:0/2584630430 >> v2:172.21.15.107:3300/0 conn(0x7f052003e9d0 msgr2=0x7f052003ede0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:30.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f0525d9b640 1 --2- 172.21.15.46:0/2584630430 >> v2:172.21.15.107:3300/0 conn(0x7f052003e9d0 0x7f052003ede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f0525d9b640 1 -- 172.21.15.46:0/2584630430 >> v1:172.21.15.46:6789/0 conn(0x7f052004b4f0 legacy=0x7f0520047c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001778976 0 0) 0x7f89240c79d0 con 0x7f89240c5b60 2024-05-09T02:18:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.411+0000 7f0525d9b640 1 -- 172.21.15.46:0/2584630430 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052000b9c0 con 0x7f05200dc600 2024-05-09T02:18:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7f0525d9b640 1 --2- 172.21.15.46:0/2584630430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f0520046380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0528066140 tx=0x7f05280a7520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1dcdbc9ce535e8f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7f8923fff640 1 --2- 172.21.15.46:0/1402963042 >> v2:172.21.15.107:3300/0 conn(0x7f8924151b40 0x7f89241583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7f487db38640 1 -- start start 2024-05-09T02:18:30.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f890c003520 con 0x7f89240c5b60 2024-05-09T02:18:30.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.412+0000 7fb647fff640 1 --2- 172.21.15.46:0/3377330597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb640007750 0x7fb640006d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009a00 tx=0x7fb63c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e536cd9d4fba56 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f052559a640 1 -- 172.21.15.46:0/2584630430 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280b3070 con 0x7f05200dc600 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 376538874 0 0) 0x7f890c003520 con 0x7f89240c5b60 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 >> v2:172.21.15.107:3300/0 conn(0x7f8924151b40 msgr2=0x7f89241583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 --2- 172.21.15.46:0/1402963042 >> v2:172.21.15.107:3300/0 conn(0x7f8924151b40 0x7f89241583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 >> v1:172.21.15.46:6789/0 conn(0x7f89240c92d0 legacy=0x7f89240ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240c7f90 con 0x7f89240c5b60 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f891c001a70 con 0x7f89240c5b60 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 >> v1:172.21.15.107:6789/0 conn(0x7f89240c5b60 legacy=0x7f89240c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f890c003aa0 0x7f890c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c004800 0x7f890c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f890c005350 0x7f890c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89240c7cb0 con 0x7f890c003aa0 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f890c014a90 con 0x7f890c004800 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f890c014c90 con 0x7f890c005350 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f89237fe640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c004800 0x7f890c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f8928855640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f890c005350 0x7f890c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7fb646ffd640 1 -- 172.21.15.46:0/3377330597 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c037070 con 0x7fb640007750 2024-05-09T02:18:30.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7ff829cc5640 1 Processor -- start 2024-05-09T02:18:30.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7fb646ffd640 1 -- 172.21.15.46:0/3377330597 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c02acd0 con 0x7fb640007750 2024-05-09T02:18:30.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7fb646ffd640 1 -- 172.21.15.46:0/3377330597 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c032660 con 0x7fb640007750 2024-05-09T02:18:30.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f052559a640 1 -- 172.21.15.46:0/2584630430 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05280ae600 con 0x7f05200dc600 2024-05-09T02:18:30.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f487db38640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48780729a0 0x7f487806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f487db38640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f487806d100 0x7f4878153c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f487db38640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4878074bd0 con 0x7f487806c6c0 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f487db38640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4878151610 con 0x7f487806d100 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f487db38640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4878157ad0 con 0x7f48780729a0 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.413+0000 7f052559a640 1 -- 172.21.15.46:0/2584630430 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280aea30 con 0x7f05200dc600 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f052759e640 1 -- 172.21.15.46:0/2584630430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 msgr2=0x7f0520046380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f052759e640 1 --2- 172.21.15.46:0/2584630430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f0520046380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0528066140 tx=0x7f05280a7520 comp rx=0 tx=0).stop 2024-05-09T02:18:30.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f8928855640 1 -- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c004800 msgr2=0x7f890c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f8928855640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c004800 0x7f890c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f052759e640 1 -- 172.21.15.46:0/2584630430 shutdown_connections 2024-05-09T02:18:30.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f052759e640 1 --2- 172.21.15.46:0/2584630430 >> v2:172.21.15.107:3300/0 conn(0x7f052003e9d0 0x7f052003ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f052759e640 1 --2- 172.21.15.46:0/2584630430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f0520046380 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f052759e640 1 -- 172.21.15.46:0/2584630430 >> 172.21.15.46:0/2584630430 conn(0x7f0520006090 msgr2=0x7f05200064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f082eed2640 1 Processor -- start 2024-05-09T02:18:30.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7ff829cc5640 1 -- start start 2024-05-09T02:18:30.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f4876ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48780729a0 0x7f487806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f052759e640 1 -- 172.21.15.46:0/2584630430 shutdown_connections 2024-05-09T02:18:30.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f8928855640 1 -- 172.21.15.46:0/1402963042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f890c003aa0 msgr2=0x7f890c003f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:30.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f8928855640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f890c003aa0 0x7f890c003f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f8928855640 1 -- 172.21.15.46:0/1402963042 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240c7f90 con 0x7f890c005350 2024-05-09T02:18:30.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f4876ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48780729a0 0x7f487806cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42362/0 (socket says 172.21.15.46:42362) 2024-05-09T02:18:30.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f4876ffd640 1 -- 172.21.15.46:0/3887865250 learned_addr learned my addr 172.21.15.46:0/3887865250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f082eed2640 1 -- start start 2024-05-09T02:18:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7fb64d31b640 1 -- 172.21.15.46:0/3377330597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb640007750 msgr2=0x7fb640006d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7fb64d31b640 1 --2- 172.21.15.46:0/3377330597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb640007750 0x7fb640006d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009a00 tx=0x7fb63c02a210 comp rx=0 tx=0).stop 2024-05-09T02:18:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7fb64d31b640 1 -- 172.21.15.46:0/3377330597 shutdown_connections 2024-05-09T02:18:30.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7fb64d31b640 1 --2- 172.21.15.46:0/3377330597 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400da240 0x7fb6400da650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7fb64d31b640 1 --2- 172.21.15.46:0/3377330597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb640007750 0x7fb640006d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7fb64d31b640 1 -- 172.21.15.46:0/3377330597 >> 172.21.15.46:0/3377330597 conn(0x7fb640006090 msgr2=0x7fb6400064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f052759e640 1 -- 172.21.15.46:0/2584630430 wait complete. 2024-05-09T02:18:30.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f8928855640 1 -- 172.21.15.46:0/1402963042 reap_dead start 2024-05-09T02:18:30.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7ff89b59e640 1 Processor -- start 2024-05-09T02:18:30.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7ff89b59e640 1 -- start start 2024-05-09T02:18:30.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.415+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720509432 0 0) 0x7f4878074bd0 con 0x7f487806c6c0 2024-05-09T02:18:30.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f8928855640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f890c005350 0x7f890c00b9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f891c00a8a0 tx=0x7f890c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1cdaf14060f9189 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4860003520 con 0x7f487806c6c0 2024-05-09T02:18:30.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c00a4c0 con 0x7f890c005350 2024-05-09T02:18:30.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c02f070 con 0x7f890c005350 2024-05-09T02:18:30.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f8922ffd640 1 -- 172.21.15.46:0/1402963042 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c02bca0 con 0x7f890c005350 2024-05-09T02:18:30.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7fb64d31b640 1 -- 172.21.15.46:0/3377330597 shutdown_connections 2024-05-09T02:18:30.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff829cc5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff81c04b4e0 0x7ff81c046370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7fb713861640 1 Processor -- start 2024-05-09T02:18:30.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff829cc5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c03e9c0 0x7ff81c03edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff829cc5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81c04afe0 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff829cc5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c00b500 con 0x7ff81c04b4e0 2024-05-09T02:18:30.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff829cc5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff81c04b2a0 con 0x7ff81c03e9c0 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff823fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff81c0dc5f0 0x7ff81c047c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37870/0 (socket says 172.21.15.46:37870) 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff823fff640 1 -- 172.21.15.46:0/1897652780 learned_addr learned my addr 172.21.15.46:0/1897652780 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff828cc3640 1 --2- 172.21.15.46:0/1897652780 >> v2:172.21.15.107:3300/0 conn(0x7ff81c04b4e0 0x7ff81c046370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7ff8294c4640 1 --2- 172.21.15.46:0/1897652780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c03e9c0 0x7ff81c03edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.414+0000 7f4877fff640 1 --2- 172.21.15.46:0/3887865250 >> v2:172.21.15.46:3300/0 conn(0x7f487806d100 0x7f4878153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3820874222 0 0) 0x7f4860003520 con 0x7f487806c6c0 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48780729a0 msgr2=0x7f487806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48780729a0 0x7f487806cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 >> v2:172.21.15.46:3300/0 conn(0x7f487806d100 msgr2=0x7f4878153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 --2- 172.21.15.46:0/3887865250 >> v2:172.21.15.46:3300/0 conn(0x7f487806d100 0x7f4878153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4878072e50 con 0x7f487806c6c0 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f48680016f0 con 0x7f487806c6c0 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 >> v1:172.21.15.46:6789/0 conn(0x7f487806c6c0 legacy=0x7f4878150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f48767fc640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4860003a50 0x7f4860003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f48767fc640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4860004800 0x7f4860004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f48767fc640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48600052a0 0x7f486000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4878151610 con 0x7f4860003a50 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4878157ad0 con 0x7f48600052a0 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f486000c280 con 0x7f4860004800 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082eed2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0820007070 0x7f0820046590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082eed2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0820049900 0x7f08200d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082eed2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f08200db3c0 0x7f082000b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082eed2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f08200daf30 con 0x7f0820049900 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082eed2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f08200471e0 con 0x7f0820007070 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082eed2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0820007960 con 0x7f08200db3c0 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7ff8294c4640 1 -- 172.21.15.46:0/1897652780 >> v2:172.21.15.107:3300/0 conn(0x7ff81c04b4e0 msgr2=0x7ff81c046370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7ff8294c4640 1 --2- 172.21.15.46:0/1897652780 >> v2:172.21.15.107:3300/0 conn(0x7ff81c04b4e0 0x7ff81c046370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f892a2b8640 1 -- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f890c005350 msgr2=0x7f890c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f892a2b8640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f890c005350 0x7f890c00b9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f891c00a8a0 tx=0x7f890c005830 comp rx=0 tx=0).stop 2024-05-09T02:18:30.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7ff8294c4640 1 -- 172.21.15.46:0/1897652780 >> v1:172.21.15.107:6789/0 conn(0x7ff81c0dc5f0 legacy=0x7ff81c047c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7ff8237fe640 1 -- 172.21.15.46:0/1897652780 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148942624 0 0) 0x7ff81c04afe0 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f892a2b8640 1 -- 172.21.15.46:0/1402963042 shutdown_connections 2024-05-09T02:18:30.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f892a2b8640 1 --2- 172.21.15.46:0/1402963042 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f890c005350 0x7f890c00b9c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f892a2b8640 1 -- 172.21.15.46:0/1402963042 >> 172.21.15.46:0/1402963042 conn(0x7f89240c9b10 msgr2=0x7f89240c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082ded0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0820007070 0x7f0820046590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082ded0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0820007070 0x7f0820046590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44878/0 (socket says 172.21.15.46:44878) 2024-05-09T02:18:30.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7f082ded0640 1 -- 172.21.15.46:0/2027811563 learned_addr learned my addr 172.21.15.46:0/2027811563 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f052759e640 1 Processor -- start 2024-05-09T02:18:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7fb713861640 1 -- start start 2024-05-09T02:18:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f48777fe640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4860003a50 0x7f4860003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89b59e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff894032310 0x7ff8940d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff8940db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89b59e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8940483d0 con 0x7ff89404b8f0 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89b59e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff89404abb0 con 0x7ff894032310 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89b59e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff89404b460 con 0x7ff8940dae90 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f48777fe640 1 -- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4860004800 msgr2=0x7f4860004c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f48777fe640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4860004800 0x7f4860004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f48777fe640 1 -- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48600052a0 msgr2=0x7f486000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f48777fe640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48600052a0 0x7f486000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f48777fe640 1 -- 172.21.15.46:0/3887865250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4860003520 con 0x7f4860003a50 2024-05-09T02:18:30.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.417+0000 7ff8294c4640 1 -- 172.21.15.46:0/1897652780 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c00b9b0 con 0x7ff81c03e9c0 2024-05-09T02:18:30.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f052759e640 1 -- start start 2024-05-09T02:18:30.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082d6cf640 1 --2- 172.21.15.46:0/2027811563 >> v2:172.21.15.46:3300/0 conn(0x7f0820049900 0x7f08200d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff8294c4640 1 --2- 172.21.15.46:0/1897652780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c03e9c0 0x7ff81c03edd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff824075670 tx=0x7ff8240a7620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ab8a8c797c03369 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89a59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff894032310 0x7ff8940d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7ff89a59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff894032310 0x7ff8940d8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44880/0 (socket says 172.21.15.46:44880) 2024-05-09T02:18:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff89a59c640 1 -- 172.21.15.46:0/1011007943 learned_addr learned my addr 172.21.15.46:0/1011007943 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7f4877fff640 1 --2- 172.21.15.46:0/3887865250 >> v2:172.21.15.46:3300/0 conn(0x7f487806d100 0x7f4878153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7f4876ffd640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48780729a0 0x7f487806cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:30.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff8237fe640 1 -- 172.21.15.46:0/1897652780 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8240b3070 con 0x7ff81c03e9c0 2024-05-09T02:18:30.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb713861640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb70c157700 0x7fb70c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb713861640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb70c0cdb30 0x7fb70c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7f892a2b8640 1 -- 172.21.15.46:0/1402963042 shutdown_connections 2024-05-09T02:18:30.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.416+0000 7fb64d31b640 1 -- 172.21.15.46:0/3377330597 wait complete. 2024-05-09T02:18:30.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb64d31b640 1 Processor -- start 2024-05-09T02:18:30.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7f892a2b8640 1 -- 172.21.15.46:0/1402963042 wait complete. 2024-05-09T02:18:30.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082ded0640 1 -- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f08200db3c0 msgr2=0x7f082000b3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T02:18:30.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082ded0640 1 --2- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f08200db3c0 0x7f082000b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082ded0640 1 -- 172.21.15.46:0/2027811563 >> v2:172.21.15.46:3300/0 conn(0x7f0820049900 msgr2=0x7f08200d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082ded0640 1 --2- 172.21.15.46:0/2027811563 >> v2:172.21.15.46:3300/0 conn(0x7f0820049900 0x7f08200d7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082ded0640 1 -- 172.21.15.46:0/2027811563 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0820046c20 con 0x7f0820007070 2024-05-09T02:18:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.418+0000 7f082d6cf640 1 --2- 172.21.15.46:0/2027811563 >> v2:172.21.15.46:3300/0 conn(0x7f0820049900 0x7f08200d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7f082ded0640 1 --2- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0820007070 0x7f0820046590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f082000be20 tx=0x7f082402a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860f11f5f68e682a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb64d31b640 1 -- start start 2024-05-09T02:18:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7f48777fe640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4860003a50 0x7f4860003ec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4868007fd0 tx=0x7f4860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf596ef813cfdb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb7115fd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb70c0c85f0 0x7fb70c154d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44200/0 (socket says 172.21.15.46:44200) 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb7125ff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb70c0cdb30 0x7fb70c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb7125ff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb70c0cdb30 0x7fb70c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36130/0 (socket says 172.21.15.46:36130) 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb710dfc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb70c157700 0x7fb70c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7fb710dfc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb70c157700 0x7fb70c0cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44890/0 (socket says 172.21.15.46:44890) 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7fb713861640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70c0c8b70 con 0x7fb70c0c85f0 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff89a59c640 1 -- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 msgr2=0x7ff8940db2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T02:18:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff89a59c640 1 --2- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff8940db2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff89a59c640 1 -- 172.21.15.46:0/1011007943 >> v1:172.21.15.46:6789/0 conn(0x7ff89404b8f0 legacy=0x7ff89404bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff89a59c640 1 -- 172.21.15.46:0/1011007943 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff894047e10 con 0x7ff894032310 2024-05-09T02:18:30.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052759e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 0x7f052000a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f082cece640 1 -- 172.21.15.46:0/2027811563 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824037070 con 0x7f0820007070 2024-05-09T02:18:30.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052759e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f052004b4f0 0x7f0520175370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f082cece640 1 -- 172.21.15.46:0/2027811563 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0824032440 con 0x7f0820007070 2024-05-09T02:18:30.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f082cece640 1 -- 172.21.15.46:0/2027811563 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824032810 con 0x7f0820007070 2024-05-09T02:18:30.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868036070 con 0x7f4860003a50 2024-05-09T02:18:30.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4868031620 con 0x7f4860003a50 2024-05-09T02:18:30.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff8237fe640 1 -- 172.21.15.46:0/1897652780 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8240ae600 con 0x7ff81c03e9c0 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.419+0000 7ff8237fe640 1 -- 172.21.15.46:0/1897652780 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8240aea30 con 0x7ff81c03e9c0 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 -- 172.21.15.46:0/1897652780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c03e9c0 msgr2=0x7ff81c03edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 --2- 172.21.15.46:0/1897652780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c03e9c0 0x7ff81c03edd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff824075670 tx=0x7ff8240a7620 comp rx=0 tx=0).stop 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 0x7f052000a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 0x7f052000a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44906/0 (socket says 172.21.15.46:44906) 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f0525d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f052004b4f0 0x7f0520175370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052759e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f05200d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052759e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0520007360 con 0x7f052004b4f0 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052659c640 1 -- 172.21.15.46:0/3325209450 learned_addr learned my addr 172.21.15.46:0/3325209450 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052759e640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0520007080 con 0x7f052003e9d0 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7f052759e640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0520049900 con 0x7f05200dc600 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff89a59c640 1 --2- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff894032310 0x7ff8940d8380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009850 tx=0x7ff88c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7948c8ab4dbb88ba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 -- 172.21.15.46:0/1897652780 shutdown_connections 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 --2- 172.21.15.46:0/1897652780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c03e9c0 0x7ff81c03edd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 --2- 172.21.15.46:0/1897652780 >> v2:172.21.15.107:3300/0 conn(0x7ff81c04b4e0 0x7ff81c046370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 -- 172.21.15.46:0/1897652780 >> 172.21.15.46:0/1897652780 conn(0x7ff81c006080 msgr2=0x7ff81c006490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7ff829cc5640 1 -- 172.21.15.46:0/1897652780 shutdown_connections 2024-05-09T02:18:30.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7fb713861640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb70c0c8e50 con 0x7fb70c0cdb30 2024-05-09T02:18:30.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.420+0000 7fb713861640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb70c0c9130 con 0x7fb70c157700 2024-05-09T02:18:30.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7ff829cc5640 1 -- 172.21.15.46:0/1897652780 wait complete. 2024-05-09T02:18:30.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f0526d9d640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f05200d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 -- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0820007070 msgr2=0x7f0820046590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f052659c640 1 -- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 msgr2=0x7f05200d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f052659c640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f05200d3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f052659c640 1 -- 172.21.15.46:0/3325209450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f052004b4f0 msgr2=0x7f0520175370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f052659c640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f052004b4f0 0x7f0520175370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f052659c640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0520044a40 con 0x7f052003e9d0 2024-05-09T02:18:30.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 --2- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0820007070 0x7f0820046590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f082000be20 tx=0x7f082402a160 comp rx=0 tx=0).stop 2024-05-09T02:18:30.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f052659c640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 0x7f052000a460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f051800c4f0 tx=0x7f051800c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 -- 172.21.15.46:0/2027811563 shutdown_connections 2024-05-09T02:18:30.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 --2- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f08200db3c0 0x7f082000b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 --2- 172.21.15.46:0/2027811563 >> v2:172.21.15.46:3300/0 conn(0x7f0820049900 0x7f08200d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 --2- 172.21.15.46:0/2027811563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0820007070 0x7f0820046590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 -- 172.21.15.46:0/2027811563 >> 172.21.15.46:0/2027811563 conn(0x7f0820006090 msgr2=0x7f08200064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7fb7115fd640 1 -- 172.21.15.46:0/2522504879 learned_addr learned my addr 172.21.15.46:0/2522504879 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:30.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f48767fc640 1 -- 172.21.15.46:0/3887865250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868007c20 con 0x7f4860003a50 2024-05-09T02:18:30.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7ff89959a640 1 -- 172.21.15.46:0/1011007943 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c004030 con 0x7ff894032310 2024-05-09T02:18:30.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518018070 con 0x7f052003e9d0 2024-05-09T02:18:30.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05180074e0 con 0x7f052003e9d0 2024-05-09T02:18:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f052759e640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0520043bb0 con 0x7f052003e9d0 2024-05-09T02:18:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f892a2b8640 1 Processor -- start 2024-05-09T02:18:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f487db38640 1 -- 172.21.15.46:0/3887865250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4860003a50 msgr2=0x7f4860003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f487db38640 1 --2- 172.21.15.46:0/3887865250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4860003a50 0x7f4860003ec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4868007fd0 tx=0x7f4860005830 comp rx=0 tx=0).stop 2024-05-09T02:18:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f4877fff640 1 -- 172.21.15.46:0/3887865250 reap_dead start 2024-05-09T02:18:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7ff89959a640 1 -- 172.21.15.46:0/1011007943 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c0041d0 con 0x7ff894032310 2024-05-09T02:18:30.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 -- 172.21.15.46:0/2027811563 shutdown_connections 2024-05-09T02:18:30.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.421+0000 7f082eed2640 1 -- 172.21.15.46:0/2027811563 wait complete. 2024-05-09T02:18:30.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f052759e640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0520044170 con 0x7f052003e9d0 2024-05-09T02:18:30.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f892a2b8640 1 -- start start 2024-05-09T02:18:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f487db38640 1 -- 172.21.15.46:0/3887865250 shutdown_connections 2024-05-09T02:18:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f487db38640 1 -- 172.21.15.46:0/3887865250 >> 172.21.15.46:0/3887865250 conn(0x7f48780c8db0 msgr2=0x7f48780c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f487db38640 1 -- 172.21.15.46:0/3887865250 shutdown_connections 2024-05-09T02:18:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7ff89b59e640 1 -- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff894032310 msgr2=0x7ff8940d8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7ff89b59e640 1 --2- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff894032310 0x7ff8940d8380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009850 tx=0x7ff88c02a1c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb64d31b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400466a0 0x7fb6400d9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb64d31b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 0x7fb6400ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb64d31b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6400ce760 0x7fb64017a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb64d31b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6400072d0 con 0x7fb6400da240 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb64d31b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb64003f240 con 0x7fb6400ce760 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb64d31b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6400d4760 con 0x7fb6400466a0 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb6477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 0x7fb6400ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb6477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 0x7fb6400ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36144/0 (socket says 172.21.15.46:36144) 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb6477fe640 1 -- 172.21.15.46:0/3518679787 learned_addr learned my addr 172.21.15.46:0/3518679787 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb6477fe640 1 -- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400466a0 msgr2=0x7fb6400d9940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T02:18:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb6477fe640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400466a0 0x7fb6400d9940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb6477fe640 1 -- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6400ce760 msgr2=0x7fb64017a870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb6477fe640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6400ce760 0x7fb64017a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb6477fe640 1 -- 172.21.15.46:0/3518679787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6400d52f0 con 0x7fb6400da240 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb7125ff640 1 -- 172.21.15.46:0/2522504879 >> v2:172.21.15.107:3300/0 conn(0x7fb70c157700 msgr2=0x7fb70c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb7125ff640 1 --2- 172.21.15.46:0/2522504879 >> v2:172.21.15.107:3300/0 conn(0x7fb70c157700 0x7fb70c0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb7125ff640 1 -- 172.21.15.46:0/2522504879 >> v1:172.21.15.46:6789/0 conn(0x7fb70c0c85f0 legacy=0x7fb70c154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7fb7125ff640 1 -- 172.21.15.46:0/2522504879 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c06e660 con 0x7fb70c0cdb30 2024-05-09T02:18:30.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb6477fe640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 0x7fb6400ce220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb64806b360 tx=0x7fb648050f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7ff829cc5640 1 Processor -- start 2024-05-09T02:18:30.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7fb7125ff640 1 --2- 172.21.15.46:0/2522504879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0cdb30 0x7fb70c06eb80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0b25f0 tx=0x7fb70402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53769c95d26b6192 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.422+0000 7f487db38640 1 -- 172.21.15.46:0/3887865250 wait complete. 2024-05-09T02:18:30.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64806e440 con 0x7fb6400da240 2024-05-09T02:18:30.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb648091020 con 0x7fb6400da240 2024-05-09T02:18:30.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb64d31b640 1 -- 172.21.15.46:0/3518679787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb640030490 con 0x7fb6400da240 2024-05-09T02:18:30.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb64d31b640 1 -- 172.21.15.46:0/3518679787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb640030a50 con 0x7fb6400da240 2024-05-09T02:18:30.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64808d830 con 0x7fb6400da240 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.423+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518007690 con 0x7f052003e9d0 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7f052759e640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c005290 con 0x7f052003e9d0 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f051801b070 con 0x7f052003e9d0 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7f892a2b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 0x7f892415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f892a2b8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89241ea340 0x7f892414a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f892a2b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89241ea750 0x7f892414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f8923fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 0x7f892415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f89237fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89241ea340 0x7f892414a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f8923fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 0x7f892415afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44922/0 (socket says 172.21.15.46:44922) 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f89237fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89241ea340 0x7f892414a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42410/0 (socket says 172.21.15.46:42410) 2024-05-09T02:18:30.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f8923fff640 1 -- 172.21.15.46:0/3476715507 learned_addr learned my addr 172.21.15.46:0/3476715507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89241583c0 con 0x7f89241ea750 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f89240c8550 con 0x7f890c005350 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8924158540 con 0x7f89241ea340 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f487db38640 1 Processor -- start 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f487db38640 1 -- start start 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7ff89b59e640 1 -- 172.21.15.46:0/1011007943 shutdown_connections 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7ff89b59e640 1 --2- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff8940db2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7ff89b59e640 1 --2- 172.21.15.46:0/1011007943 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff894032310 0x7ff8940d8380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7ff89b59e640 1 -- 172.21.15.46:0/1011007943 >> 172.21.15.46:0/1011007943 conn(0x7ff8940495a0 msgr2=0x7ff8940499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7f082eed2640 1 Processor -- start 2024-05-09T02:18:30.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7f082eed2640 1 -- start start 2024-05-09T02:18:30.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7ff829cc5640 1 -- start start 2024-05-09T02:18:30.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb703fff640 1 -- 172.21.15.46:0/2522504879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704007740 con 0x7fb70c0cdb30 2024-05-09T02:18:30.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb703fff640 1 -- 172.21.15.46:0/2522504879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7040078e0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.424+0000 7fb703fff640 1 -- 172.21.15.46:0/2522504879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704007cf0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.425+0000 7ff89b59e640 1 -- 172.21.15.46:0/1011007943 shutdown_connections 2024-05-09T02:18:30.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7ff89b59e640 1 -- 172.21.15.46:0/1011007943 wait complete. 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f8923fff640 1 -- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89241ea340 msgr2=0x7f892414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f8923fff640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89241ea340 0x7f892414a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f8923fff640 1 -- 172.21.15.46:0/3476715507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89241ea750 msgr2=0x7f892414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f8923fff640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89241ea750 0x7f892414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f8923fff640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8924072820 con 0x7f890c005350 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f0516ffd640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05080763a0 0x7f05080788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f0518096c40 con 0x7f052003e9d0 2024-05-09T02:18:30.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f8923fff640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 0x7f892415afe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f891400e7d0 tx=0x7f891400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7f0525d9b640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05080763a0 0x7f05080788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff829cc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff81c03e9c0 0x7ff81c0e2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff829cc5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c04b4e0 0x7ff81c178ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7fb713861640 1 -- 172.21.15.46:0/2522504879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0cdb30 msgr2=0x7fb70c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7fb713861640 1 --2- 172.21.15.46:0/2522504879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0cdb30 0x7fb70c06eb80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0b25f0 tx=0x7fb70402a6c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff828cc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff81c03e9c0 0x7ff81c0e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff828cc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff81c03e9c0 0x7ff81c0e2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36168/0 (socket says 172.21.15.46:36168) 2024-05-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f082eed2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 0x7f08200dc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff829cc5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 0x7ff81c0d7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7fb713861640 1 -- 172.21.15.46:0/2522504879 shutdown_connections 2024-05-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7fb713861640 1 --2- 172.21.15.46:0/2522504879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0cdb30 0x7fb70c06eb80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7fb713861640 1 --2- 172.21.15.46:0/2522504879 >> v2:172.21.15.107:3300/0 conn(0x7fb70c157700 0x7fb70c0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7fb713861640 1 -- 172.21.15.46:0/2522504879 >> 172.21.15.46:0/2522504879 conn(0x7fb70c0742d0 msgr2=0x7fb70c0ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f0525d9b640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05080763a0 0x7f05080788b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f052004b430 tx=0x7f0528070030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f487db38640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4878154b30 0x7f48780c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f082eed2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0820049900 0x7f08200cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f487db38640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4878149b20 0x7f4878155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff829cc5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c007350 con 0x7ff81c03e9c0 2024-05-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f487db38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781ec990 0x7f48781ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f082ded0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 0x7f08200dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f082ded0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 0x7f08200dc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42430/0 (socket says 172.21.15.46:42430) 2024-05-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f082ded0640 1 -- 172.21.15.46:0/1933204039 learned_addr learned my addr 172.21.15.46:0/1933204039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f487db38640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4878074860 con 0x7f48781ec990 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f487db38640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4878157d20 con 0x7f4878149b20 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f487db38640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f48780c46d0 con 0x7f4878154b30 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f48777fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4878154b30 0x7f48780c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f4877fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781ec990 0x7f48781ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f4877fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781ec990 0x7f48781ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36180/0 (socket says 172.21.15.46:36180) 2024-05-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f4877fff640 1 -- 172.21.15.46:0/3934793128 learned_addr learned my addr 172.21.15.46:0/3934793128 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08200db3c0 0x7f082002b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f08200d8380 con 0x7f0820049900 2024-05-09T02:18:30.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4878149b20 0x7f4878155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f08200dabc0 con 0x7f08200db3c0 2024-05-09T02:18:30.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0820049d10 con 0x7f0820007070 2024-05-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.426+0000 7fb64d31b640 1 -- 172.21.15.46:0/3518679787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb628005290 con 0x7fb6400da240 2024-05-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff829cc5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c007070 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff829cc5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff81c0498f0 con 0x7ff81c04b4e0 2024-05-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff823fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c04b4e0 0x7ff81c178ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff8294c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 0x7ff81c0d7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff8294c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 0x7ff81c0d7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:44938/0 (socket says 172.21.15.46:44938) 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.427+0000 7ff8294c4640 1 -- 172.21.15.46:0/2055062934 learned_addr learned my addr 172.21.15.46:0/2055062934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7ff8294c4640 1 -- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c04b4e0 msgr2=0x7ff81c178ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7ff8294c4640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c04b4e0 0x7ff81c178ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7ff8294c4640 1 -- 172.21.15.46:0/2055062934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff81c03e9c0 msgr2=0x7ff81c0e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7ff8294c4640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff81c03e9c0 0x7ff81c0e2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7ff8294c4640 1 -- 172.21.15.46:0/2055062934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c042160 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7fb713861640 1 -- 172.21.15.46:0/2522504879 shutdown_connections 2024-05-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7fb713861640 1 -- 172.21.15.46:0/2522504879 wait complete. 2024-05-09T02:18:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082d6cf640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0820049900 0x7f08200cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082e6d1640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08200db3c0 0x7f082002b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb64808d9d0 con 0x7fb6400da240 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 -- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4878154b30 msgr2=0x7f48780c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4878154b30 0x7f48780c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 -- 172.21.15.46:0/3934793128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781ec990 msgr2=0x7f48781ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781ec990 0x7f48781ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 -- 172.21.15.46:0/3934793128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48781ed620 con 0x7f4878149b20 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f48777fe640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4878154b30 0x7f48780c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f4876ffd640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4878149b20 0x7f4878155950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4878072950 tx=0x7f487000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7ff8294c4640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 0x7ff81c0d7d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff824052220 tx=0x7ff82406b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7ff89b59e640 1 Processor -- start 2024-05-09T02:18:30.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082ded0640 1 -- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08200db3c0 msgr2=0x7f082002b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082ded0640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08200db3c0 0x7f082002b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082ded0640 1 -- 172.21.15.46:0/1933204039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0820049900 msgr2=0x7f08200cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082ded0640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0820049900 0x7f08200cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.428+0000 7f082ded0640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08200d75a0 con 0x7f0820007070 2024-05-09T02:18:30.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7fb644ff9640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb62c076350 0x7fb62c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7fb647fff640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb62c076350 0x7fb62c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.430+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb648113fa0 con 0x7fb6400da240 2024-05-09T02:18:30.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7ff89b59e640 1 -- start start 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7f082ded0640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 0x7f08200dc540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f082402a750 tx=0x7f08240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824041070 con 0x7f0820007070 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082403c930 con 0x7f0820007070 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08200cbcd0 con 0x7f0820007070 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824037040 con 0x7f0820007070 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.429+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f082002d000 con 0x7f0820007070 2024-05-09T02:18:30.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.430+0000 7fb647fff640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb62c076350 0x7fb62c078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb63c034000 tx=0x7fb63c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.430+0000 7fb713861640 1 Processor -- start 2024-05-09T02:18:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.430+0000 7fb713861640 1 -- start start 2024-05-09T02:18:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.430+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0820005570 con 0x7f0820007070 2024-05-09T02:18:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 0x7ff8940d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff89404b8f0 0x7ff8940cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff894007dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 0x7ff8940d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 0x7ff8940d8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36192/0 (socket says 172.21.15.46:36192) 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89a59c640 1 -- 172.21.15.46:0/2005273582 learned_addr learned my addr 172.21.15.46:0/2005273582 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff899d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff89404b8f0 0x7ff8940cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89ad9d640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff894007dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff89404b0f0 con 0x7ff894032310 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940d88c0 con 0x7ff89404b8f0 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff89404c410 con 0x7ff8940dae90 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff89a59c640 1 -- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 msgr2=0x7ff894007dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff89a59c640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff894007dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff89a59c640 1 -- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff89404b8f0 msgr2=0x7ff8940cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff89a59c640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff89404b8f0 0x7ff8940cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.431+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0824044070 con 0x7f0820007070 2024-05-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f081a7fc640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f080c0762d0 0x7f080c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8240b3050 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000cd20 con 0x7f4878149b20 2024-05-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff89a59c640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8940d91d0 con 0x7ff894032310 2024-05-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8240bf070 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f082d6cf640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f080c0762d0 0x7f080c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f08240b8310 con 0x7f0820007070 2024-05-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8240add60 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f051805fc90 con 0x7f052003e9d0 2024-05-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb713861640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0c85f0 0x7fb70c0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb713861640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 0x7fb70c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb713861640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70c157700 0x7fb70c14c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4870019070 con 0x7f4878149b20 2024-05-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700146c0 con 0x7f4878149b20 2024-05-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4878156b90 con 0x7f4878149b20 2024-05-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914017070 con 0x7f890c005350 2024-05-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb713861640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0c9410 con 0x7fb70c0c85f0 2024-05-09T02:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb713861640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0c1ed0 con 0x7fb70c157700 2024-05-09T02:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891400c940 con 0x7f890c005350 2024-05-09T02:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb713861640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c06f0c0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb710dfc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 0x7fb70c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892406fd20 con 0x7f890c005350 2024-05-09T02:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4878149f30 con 0x7f4878149b20 2024-05-09T02:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb710dfc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 0x7fb70c15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42458/0 (socket says 172.21.15.46:42458) 2024-05-09T02:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb710dfc640 1 -- 172.21.15.46:0/1124593734 learned_addr learned my addr 172.21.15.46:0/1124593734 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7fb7125ff640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70c157700 0x7fb70c14c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891400cd10 con 0x7f890c005350 2024-05-09T02:18:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7fb7115fd640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0c85f0 0x7fb70c0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241567b0 con 0x7f890c005350 2024-05-09T02:18:30.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7fb710dfc640 1 -- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70c157700 msgr2=0x7fb70c14c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7fb710dfc640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70c157700 0x7fb70c14c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7fb710dfc640 1 -- 172.21.15.46:0/1124593734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0c85f0 msgr2=0x7fb70c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7fb710dfc640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0c85f0 0x7fb70c0cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7fb710dfc640 1 -- 172.21.15.46:0/1124593734 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c14d3c0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.432+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c042440 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7ff89a59c640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 0x7ff8940d8c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0090b0 tx=0x7ff88c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.433+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c1784a0 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.434+0000 7fb710dfc640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 0x7fb70c15a750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00d620 tx=0x7fb6fc00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.434+0000 7f082d6cf640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f080c0762d0 0x7f080c0787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f082002cd90 tx=0x7f081c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.434+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487806a330 con 0x7f4878149b20 2024-05-09T02:18:30.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.435+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c041eb0 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.435+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4870005d10 con 0x7f4878149b20 2024-05-09T02:18:30.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.435+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff8240ae4c0 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.435+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8904005290 con 0x7f890c005350 2024-05-09T02:18:30.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7ff8217fa640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff808076300 0x7ff808078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7f485ffff640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4864076350 0x7f4864078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f891401a070 con 0x7f890c005350 2024-05-09T02:18:30.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff824135140 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7ff828cc3640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff808076300 0x7ff808078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4870097a70 con 0x7f4878149b20 2024-05-09T02:18:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.436+0000 7f48777fe640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4864076350 0x7f4864078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7ff828cc3640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff808076300 0x7ff808078810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0df870 tx=0x7ff818008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7f8920ff9640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8910076320 0x7f8910078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7f48777fe640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4864076350 0x7f4864078860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48780c66b0 tx=0x7f4868005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8914097690 con 0x7f890c005350 2024-05-09T02:18:30.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7f89237fe640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8910076320 0x7f8910078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7f89237fe640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8910076320 0x7f8910078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89240ca4b0 tx=0x7f8918009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.437+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c041020 con 0x7ff894032310 2024-05-09T02:18:30.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.438+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c003e50 con 0x7ff894032310 2024-05-09T02:18:30.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.438+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8940da910 con 0x7ff894032310 2024-05-09T02:18:30.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.438+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c041020 con 0x7ff894032310 2024-05-09T02:18:30.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.438+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb64809b030 con 0x7fb6400da240 2024-05-09T02:18:30.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.438+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8940cc6f0 con 0x7ff894032310 2024-05-09T02:18:30.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.439+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff894005570 con 0x7ff894032310 2024-05-09T02:18:30.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.440+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00b620 con 0x7fb70c0cdb30 2024-05-09T02:18:30.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.440+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6fc019070 con 0x7fb70c0cdb30 2024-05-09T02:18:30.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.440+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f08240812f0 con 0x7f0820007070 2024-05-09T02:18:30.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.441+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff88c044020 con 0x7ff894032310 2024-05-09T02:18:30.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.441+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c0cc8a0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.441+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00ba00 con 0x7fb70c0cdb30 2024-05-09T02:18:30.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.441+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c0cbb80 con 0x7fb70c0cdb30 2024-05-09T02:18:30.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.441+0000 7ff88affd640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff87c0764d0 0x7ff87c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.441+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff88c0b8190 con 0x7ff894032310 2024-05-09T02:18:30.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.442+0000 7ff899d9b640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff87c0764d0 0x7ff87c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.442+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c06a330 con 0x7fb70c0cdb30 2024-05-09T02:18:30.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.442+0000 7ff899d9b640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff87c0764d0 0x7ff87c0789e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8940d5650 tx=0x7ff890009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.443+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6fc00bba0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.443+0000 7fb701ffb640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6f0076320 0x7fb6f0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:30.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.444+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb6fc097bb0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.444+0000 7fb7115fd640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6f0076320 0x7fb6f0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:30.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.444+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8240e2020 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.444+0000 7fb7115fd640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6f0076320 0x7fb6f0078830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb708000f60 tx=0x7fb708009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:30.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.449+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff88c04b030 con 0x7ff894032310 2024-05-09T02:18:30.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.454+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6fc09e080 con 0x7fb70c0cdb30 2024-05-09T02:18:30.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.454+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4870010040 con 0x7f4878149b20 2024-05-09T02:18:30.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.460+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8914060720 con 0x7f890c005350 2024-05-09T02:18:30.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.866+0000 7fb64d31b640 1 -- 172.21.15.46:0/3518679787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb628005580 con 0x7fb6400da240 2024-05-09T02:18:30.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.866+0000 7fb644ff9640 1 -- 172.21.15.46:0/3518679787 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6480dd520 con 0x7fb6400da240 2024-05-09T02:18:30.869 INFO:teuthology.orchestra.run.smithi046.stdout:55834574856 2024-05-09T02:18:30.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.870+0000 7fb6327fc640 1 -- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb62c076350 msgr2=0x7fb62c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.870+0000 7fb6327fc640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb62c076350 0x7fb62c078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb63c034000 tx=0x7fb63c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.870+0000 7fb6327fc640 1 -- 172.21.15.46:0/3518679787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 msgr2=0x7fb6400ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.870+0000 7fb6327fc640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 0x7fb6400ce220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb64806b360 tx=0x7fb648050f70 comp rx=0 tx=0).stop 2024-05-09T02:18:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.870+0000 7fb6327fc640 1 -- 172.21.15.46:0/3518679787 shutdown_connections 2024-05-09T02:18:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.870+0000 7fb6327fc640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb62c076350 0x7fb62c078860 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb63c034000 tx=0x7fb63c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.871+0000 7fb6327fc640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6400ce760 0x7fb64017a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.871+0000 7fb6327fc640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6400da240 0x7fb6400ce220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.871+0000 7fb6327fc640 1 --2- 172.21.15.46:0/3518679787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6400466a0 0x7fb6400d9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.871+0000 7fb6327fc640 1 -- 172.21.15.46:0/3518679787 >> 172.21.15.46:0/3518679787 conn(0x7fb640006090 msgr2=0x7fb64004a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.872+0000 7fb6327fc640 1 -- 172.21.15.46:0/3518679787 shutdown_connections 2024-05-09T02:18:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.872+0000 7fb6327fc640 1 -- 172.21.15.46:0/3518679787 wait complete. 2024-05-09T02:18:30.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.876+0000 7f052759e640 1 -- 172.21.15.46:0/3325209450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f050c005580 con 0x7f052003e9d0 2024-05-09T02:18:30.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.876+0000 7f0516ffd640 1 -- 172.21.15.46:0/3325209450 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05180682d0 con 0x7f052003e9d0 2024-05-09T02:18:30.879 INFO:teuthology.orchestra.run.smithi046.stdout:55834574856 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.880+0000 7f0514ff9640 1 -- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05080763a0 msgr2=0x7f05080788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.880+0000 7f0514ff9640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05080763a0 0x7f05080788b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f052004b430 tx=0x7f0528070030 comp rx=0 tx=0).stop 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.880+0000 7f0514ff9640 1 -- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 msgr2=0x7f052000a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 0x7f052000a460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f051800c4f0 tx=0x7f051800c9b0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 -- 172.21.15.46:0/3325209450 shutdown_connections 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05080763a0 0x7f05080788b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05200dc600 0x7f05200d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f052004b4f0 0x7f0520175370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 --2- 172.21.15.46:0/3325209450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f052003e9d0 0x7f052000a460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 -- 172.21.15.46:0/3325209450 >> 172.21.15.46:0/3325209450 conn(0x7f0520006090 msgr2=0x7f05200db720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 -- 172.21.15.46:0/3325209450 shutdown_connections 2024-05-09T02:18:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.881+0000 7f0514ff9640 1 -- 172.21.15.46:0/3325209450 wait complete. 2024-05-09T02:18:30.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-05-09T02:18:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.893+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f082004ac40 con 0x7f0820007070 2024-05-09T02:18:30.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.893+0000 7f081a7fc640 1 -- 172.21.15.46:0/1933204039 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08240855f0 con 0x7f0820007070 2024-05-09T02:18:30.896 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.895+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb70c1559b0 con 0x7fb70c0cdb30 2024-05-09T02:18:30.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.896+0000 7fb701ffb640 1 -- 172.21.15.46:0/1124593734 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6fc061350 con 0x7fb70c0cdb30 2024-05-09T02:18:30.898 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-05-09T02:18:30.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.897+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f080c0762d0 msgr2=0x7f080c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.897+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f080c0762d0 0x7f080c0787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f082002cd90 tx=0x7f081c008040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 msgr2=0x7f08200dc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 0x7f08200dc540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f082402a750 tx=0x7f08240046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 shutdown_connections 2024-05-09T02:18:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f080c0762d0 0x7f080c0787e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08200db3c0 0x7f082002b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0820049900 0x7f08200cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 --2- 172.21.15.46:0/1933204039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0820007070 0x7f08200dc540 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f082402a750 tx=0x7f08240046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 >> 172.21.15.46:0/1933204039 conn(0x7f0820006090 msgr2=0x7f082000b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-05-09T02:18:30.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 shutdown_connections 2024-05-09T02:18:30.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7f082eed2640 1 -- 172.21.15.46:0/1933204039 wait complete. 2024-05-09T02:18:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.898+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6f0076320 msgr2=0x7fb6f0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6f0076320 0x7fb6f0078830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb708000f60 tx=0x7fb708009040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 msgr2=0x7fb70c15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 0x7fb70c15a750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00d620 tx=0x7fb6fc00dae0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 shutdown_connections 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6f0076320 0x7fb6f0078830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70c157700 0x7fb70c14c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb70c0cdb30 0x7fb70c15a750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 --2- 172.21.15.46:0/1124593734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c0c85f0 0x7fb70c0cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 >> 172.21.15.46:0/1124593734 conn(0x7fb70c0742d0 msgr2=0x7fb70c155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 shutdown_connections 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.899+0000 7fb713861640 1 -- 172.21.15.46:0/1124593734 wait complete. 2024-05-09T02:18:30.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.901+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff81c005d20 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.905 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:30.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.901+0000 7ff8217fa640 1 -- 172.21.15.46:0/2055062934 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8240fe760 con 0x7ff81c0dc5f0 2024-05-09T02:18:30.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.903+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff8940d7ef0 con 0x7ff894032310 2024-05-09T02:18:30.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.903+0000 7ff88affd640 1 -- 172.21.15.46:0/2005273582 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff88c081180 con 0x7ff894032310 2024-05-09T02:18:30.906 INFO:teuthology.orchestra.run.smithi046.stdout:55834574856 2024-05-09T02:18:30.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.904+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff808076300 msgr2=0x7ff808078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.904+0000 7ff829cc5640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff808076300 0x7ff808078810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0df870 tx=0x7ff818008040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.904+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 msgr2=0x7ff81c0d7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.904+0000 7ff829cc5640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 0x7ff81c0d7d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff824052220 tx=0x7ff82406b6d0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4878069e80 con 0x7f4878149b20 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 shutdown_connections 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff808076300 0x7ff808078810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81c0dc5f0 0x7ff81c0d7d30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81c04b4e0 0x7ff81c178ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 --2- 172.21.15.46:0/2055062934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff81c03e9c0 0x7ff81c0e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 >> 172.21.15.46:0/2055062934 conn(0x7ff81c006080 msgr2=0x7ff81c0d9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 shutdown_connections 2024-05-09T02:18:30.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7ff829cc5640 1 -- 172.21.15.46:0/2055062934 wait complete. 2024-05-09T02:18:30.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.905+0000 7f485ffff640 1 -- 172.21.15.46:0/3934793128 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4870069070 con 0x7f4878149b20 2024-05-09T02:18:30.909 INFO:teuthology.orchestra.run.smithi046.stdout:55834574856 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.907+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff87c0764d0 msgr2=0x7ff87c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.907+0000 7ff89b59e640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff87c0764d0 0x7ff87c0789e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8940d5650 tx=0x7ff890009040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.907+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 msgr2=0x7ff8940d8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.907+0000 7ff89b59e640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 0x7ff8940d8c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0090b0 tx=0x7ff88c0046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.907+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 shutdown_connections 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff87c0764d0 0x7ff87c0789e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8940dae90 0x7ff894007dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff89404b8f0 0x7ff8940cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 --2- 172.21.15.46:0/2005273582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff894032310 0x7ff8940d8c90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 >> 172.21.15.46:0/2005273582 conn(0x7ff8940495a0 msgr2=0x7ff894005780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 shutdown_connections 2024-05-09T02:18:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.908+0000 7ff89b59e640 1 -- 172.21.15.46:0/2005273582 wait complete. 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4864076350 msgr2=0x7f4864078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4864076350 0x7f4864078860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48780c66b0 tx=0x7f4868005040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4878149b20 msgr2=0x7f4878155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4878149b20 0x7f4878155950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4878072950 tx=0x7f487000c490 comp rx=0 tx=0).stop 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 shutdown_connections 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4864076350 0x7f4864078860 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781ec990 0x7f48781ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4878149b20 0x7f4878155950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 --2- 172.21.15.46:0/3934793128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4878154b30 0x7f48780c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 >> 172.21.15.46:0/3934793128 conn(0x7f48780c8db0 msgr2=0x7f48780aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 shutdown_connections 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.909+0000 7f487db38640 1 -- 172.21.15.46:0/3934793128 wait complete. 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.910+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8904005580 con 0x7f890c005350 2024-05-09T02:18:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.910+0000 7f8920ff9640 1 -- 172.21.15.46:0/3476715507 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8914064a20 con 0x7f890c005350 2024-05-09T02:18:30.915 INFO:teuthology.orchestra.run.smithi046.stdout:55834574856 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8910076320 msgr2=0x7f8910078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8910076320 0x7f8910078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89240ca4b0 tx=0x7f8918009040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 msgr2=0x7f892415afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 0x7f892415afe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f891400e7d0 tx=0x7f891400ec90 comp rx=0 tx=0).stop 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 shutdown_connections 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8910076320 0x7f8910078830 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f89240ca4b0 tx=0x7f8918009040 comp rx=0 tx=0).stop 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89241ea750 0x7f892414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89241ea340 0x7f892414a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 --2- 172.21.15.46:0/3476715507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f890c005350 0x7f892415afe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:30.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 >> 172.21.15.46:0/3476715507 conn(0x7f89240c9b10 msgr2=0x7f89240c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:30.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 shutdown_connections 2024-05-09T02:18:30.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:30.913+0000 7f892a2b8640 1 -- 172.21.15.46:0/3476715507 wait complete. 2024-05-09T02:18:30.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-05-09T02:18:30.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-05-09T02:18:30.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-05-09T02:18:30.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-05-09T02:18:30.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-05-09T02:18:30.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-05-09T02:18:31.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T02:18:31.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T02:18:31.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T02:18:31.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T02:18:31.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T02:18:31.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T02:18:31.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T02:18:31.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T02:18:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.082+0000 7f9e30b22640 1 Processor -- start 2024-05-09T02:18:32.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.083+0000 7f9e30b22640 1 -- start start 2024-05-09T02:18:32.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.087+0000 7f9e30b22640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e24031a10 0x7f9e2403eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.087+0000 7f9e30b22640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 0x7f9e240df450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.087+0000 7f9e30b22640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e24031660 con 0x7f9e240dc3f0 2024-05-09T02:18:32.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.087+0000 7f9e30b22640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f9e2400dad0 con 0x7f9e24031a10 2024-05-09T02:18:32.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.087+0000 7f9e30b22640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9e240077d0 con 0x7f9e240df040 2024-05-09T02:18:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.090+0000 7f9e2bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 0x7f9e240df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.090+0000 7f9e2b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e24031a10 0x7f9e2403eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.090+0000 7f9e2affd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9e240dc3f0 0x7f9e240dc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44214/0 (socket says 172.21.15.46:44214) 2024-05-09T02:18:32.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.091+0000 7f9e2bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 0x7f9e240df450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:45008/0 (socket says 172.21.15.46:45008) 2024-05-09T02:18:32.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.091+0000 7f9e2bfff640 1 -- 172.21.15.46:0/2917347575 learned_addr learned my addr 172.21.15.46:0/2917347575 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.091+0000 7f9e2b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e24031a10 0x7f9e2403eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36222/0 (socket says 172.21.15.46:36222) 2024-05-09T02:18:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.093+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/2917347575 >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 msgr2=0x7f9e240df450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.093+0000 7f9e2b7fe640 1 --2- 172.21.15.46:0/2917347575 >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 0x7f9e240df450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.093+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/2917347575 >> v1:172.21.15.46:6789/0 conn(0x7f9e240dc3f0 legacy=0x7f9e240dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.094+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/2917347575 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2400ba40 con 0x7f9e24031a10 2024-05-09T02:18:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.094+0000 7f9e2bfff640 1 --2- 172.21.15.46:0/2917347575 >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 0x7f9e240df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.096+0000 7f9e2b7fe640 1 --2- 172.21.15.46:0/2917347575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e2403eff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009f30 tx=0x7f9e2002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136e401708aae2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.097+0000 7f9e2a7fc640 1 -- 172.21.15.46:0/2917347575 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20037070 con 0x7f9e24031a10 2024-05-09T02:18:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.097+0000 7f9e2a7fc640 1 -- 172.21.15.46:0/2917347575 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2002ad80 con 0x7f9e24031a10 2024-05-09T02:18:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.097+0000 7f9e2a7fc640 1 -- 172.21.15.46:0/2917347575 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20032660 con 0x7f9e24031a10 2024-05-09T02:18:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.098+0000 7f9e30b22640 1 -- 172.21.15.46:0/2917347575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 msgr2=0x7f9e2403eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.098+0000 7f9e30b22640 1 --2- 172.21.15.46:0/2917347575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e2403eff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009f30 tx=0x7f9e2002a300 comp rx=0 tx=0).stop 2024-05-09T02:18:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.099+0000 7f9e30b22640 1 -- 172.21.15.46:0/2917347575 shutdown_connections 2024-05-09T02:18:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.099+0000 7f9e30b22640 1 --2- 172.21.15.46:0/2917347575 >> v2:172.21.15.107:3300/0 conn(0x7f9e240df040 0x7f9e240df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.099+0000 7f9e30b22640 1 --2- 172.21.15.46:0/2917347575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e2403eff0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.099+0000 7f9e30b22640 1 -- 172.21.15.46:0/2917347575 >> 172.21.15.46:0/2917347575 conn(0x7f9e240064d0 msgr2=0x7f9e240068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.099+0000 7f9e30b22640 1 -- 172.21.15.46:0/2917347575 shutdown_connections 2024-05-09T02:18:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.100+0000 7f9e30b22640 1 -- 172.21.15.46:0/2917347575 wait complete. 2024-05-09T02:18:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.103+0000 7f9e30b22640 1 Processor -- start 2024-05-09T02:18:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.103+0000 7f9e30b22640 1 -- start start 2024-05-09T02:18:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.106+0000 7f9e30b22640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e240420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.106+0000 7f9e30b22640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e240dc3f0 0x7f9e24174b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.106+0000 7f9e30b22640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e240df040 0x7f9e24033030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.106+0000 7f9e30b22640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24004c90 con 0x7f9e24031a10 2024-05-09T02:18:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.106+0000 7f9e30b22640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2400c0f0 con 0x7f9e240dc3f0 2024-05-09T02:18:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.106+0000 7f9e30b22640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2403f530 con 0x7f9e240df040 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.107+0000 7f9e2bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e240df040 0x7f9e24033030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.107+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e240420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.107+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e240420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36236/0 (socket says 172.21.15.46:36236) 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.107+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/109769323 learned_addr learned my addr 172.21.15.46:0/109769323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.107+0000 7f9e2affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e240dc3f0 0x7f9e24174b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e240df040 msgr2=0x7f9e24033030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2b7fe640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e240df040 0x7f9e24033030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e240dc3f0 msgr2=0x7f9e24174b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2b7fe640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e240dc3f0 0x7f9e24174b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2b7fe640 1 -- 172.21.15.46:0/109769323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e24175540 con 0x7f9e24031a10 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2bfff640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e240df040 0x7f9e24033030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.108+0000 7f9e2affd640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e240dc3f0 0x7f9e24174b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.109+0000 7f9e2b7fe640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e240420d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e2002a8f0 tx=0x7f9e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.109+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20037040 con 0x7f9e24031a10 2024-05-09T02:18:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.110+0000 7f9e30b22640 1 -- 172.21.15.46:0/109769323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e24035080 con 0x7f9e24031a10 2024-05-09T02:18:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.110+0000 7f9e30b22640 1 -- 172.21.15.46:0/109769323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e24034210 con 0x7f9e24031a10 2024-05-09T02:18:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.113+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e20003c40 con 0x7f9e24031a10 2024-05-09T02:18:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.113+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2003d470 con 0x7f9e24031a10 2024-05-09T02:18:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.113+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e2003d650 con 0x7f9e24031a10 2024-05-09T02:18:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.114+0000 7f9e17fff640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9e1c076510 0x7f9e1c078a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.115+0000 7f9e2affd640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9e1c076510 0x7f9e1c078a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.115+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9e200b7ee0 con 0x7f9e24031a10 2024-05-09T02:18:32.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.115+0000 7f9e2affd640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9e1c076510 0x7f9e1c078a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e24033e10 tx=0x7f9e18007e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.116+0000 7f9e30b22640 1 -- 172.21.15.46:0/109769323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e10005290 con 0x7f9e24031a10 2024-05-09T02:18:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.126+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e20081580 con 0x7f9e24031a10 2024-05-09T02:18:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.151+0000 7f3fb3938640 1 Processor -- start 2024-05-09T02:18:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.151+0000 7f3fb3938640 1 -- start start 2024-05-09T02:18:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.153+0000 7f3fb3938640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3fac070330 0x7f3fac165150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.153+0000 7f3fb3938640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac06cee0 con 0x7f3fac06c6c0 2024-05-09T02:18:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.153+0000 7f3fb3938640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac08cc30 con 0x7f3fac06cad0 2024-05-09T02:18:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.153+0000 7f3fb3938640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac06fea0 con 0x7f3fac070330 2024-05-09T02:18:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.154+0000 7f3fb0ed3640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3fac06c6c0 0x7f3fac072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44230/0 (socket says 172.21.15.46:44230) 2024-05-09T02:18:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.154+0000 7f3fb0ed3640 1 -- 172.21.15.46:0/1369623776 learned_addr learned my addr 172.21.15.46:0/1369623776 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.154+0000 7f3fb16d4640 1 --2- 172.21.15.46:0/1369623776 >> v2:172.21.15.107:3300/0 conn(0x7f3fac070330 0x7f3fac165150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.154+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139841796 0 0) 0x7f3fac06cee0 con 0x7f3fac06c6c0 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.154+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f98007930 con 0x7f3fac06c6c0 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 91061339 0 0) 0x7f3f98007930 con 0x7f3fac06c6c0 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 >> v2:172.21.15.107:3300/0 conn(0x7f3fac070330 msgr2=0x7f3fac165150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 --2- 172.21.15.46:0/1369623776 >> v2:172.21.15.107:3300/0 conn(0x7f3fac070330 0x7f3fac165150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 >> v1:172.21.15.107:6789/0 conn(0x7f3fac06cad0 legacy=0x7f3fac16ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac06f850 con 0x7f3fac06c6c0 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f3fa80016f0 con 0x7f3fac06c6c0 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 >> v1:172.21.15.46:6789/0 conn(0x7f3fac06c6c0 legacy=0x7f3fac072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f98007e60 0x7f3f980082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f98008c10 0x7f3f98009020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98009680 0x7f3f9800fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac06fea0 con 0x7f3f98007e60 2024-05-09T02:18:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980105d0 con 0x7f3f98009680 2024-05-09T02:18:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3f980107d0 con 0x7f3f98008c10 2024-05-09T02:18:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.155+0000 7f3fb0ed3640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f98008c10 0x7f3f98009020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7f3fb16d4640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f98007e60 0x7f3f980082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7fb69f8ee640 1 Processor -- start 2024-05-09T02:18:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7fb69f8ee640 1 -- start start 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7f3fb0ed3640 1 -- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98009680 msgr2=0x7f3f9800fdd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7f3fb0ed3640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98009680 0x7f3f9800fdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7f3fb0ed3640 1 -- 172.21.15.46:0/1369623776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f98007e60 msgr2=0x7f3f980082b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7f3fb0ed3640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f98007e60 0x7f3f980082b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.156+0000 7f3fb0ed3640 1 -- 172.21.15.46:0/1369623776 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f98007930 con 0x7f3f98008c10 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.157+0000 7f3fb1ed5640 1 -- 172.21.15.46:0/1369623776 reap_dead start 2024-05-09T02:18:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.157+0000 7f3fb0ed3640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f98008c10 0x7f3f98009020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800c210 tx=0x7f3f98009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36778c55eb5f4e07 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7f37d5100640 1 Processor -- start 2024-05-09T02:18:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.157+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8007ce0 con 0x7f3f98008c10 2024-05-09T02:18:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa8005af0 con 0x7f3f98008c10 2024-05-09T02:18:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7f3fa3fff640 1 -- 172.21.15.46:0/1369623776 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8007070 con 0x7f3f98008c10 2024-05-09T02:18:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7f3fb3938640 1 -- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f98008c10 msgr2=0x7f3f98009020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7f3fb3938640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f98008c10 0x7f3f98009020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800c210 tx=0x7f3f98009c40 comp rx=0 tx=0).stop 2024-05-09T02:18:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7f7cd3fff640 1 Processor -- start 2024-05-09T02:18:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7fb69f8ee640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb698155220 0x7fb69815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7fb69f8ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb69815baf0 0x7fb698162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7fb69f8ee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb698070930 con 0x7fb698157a80 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7fb69f8ee640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb69815bf00 con 0x7fb698155220 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7fb69f8ee640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb6980c3770 con 0x7fb69815baf0 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69d68a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb698157a80 0x7fb6980c6b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44246/0 (socket says 172.21.15.46:44246) 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69d68a640 1 -- 172.21.15.46:0/1099594675 learned_addr learned my addr 172.21.15.46:0/1099594675 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69de8b640 1 --2- 172.21.15.46:0/1099594675 >> v2:172.21.15.107:3300/0 conn(0x7fb69815baf0 0x7fb698162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb68ffff640 1 -- 172.21.15.46:0/1099594675 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046452753 0 0) 0x7fb698070930 con 0x7fb698157a80 2024-05-09T02:18:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.158+0000 7f37d5100640 1 -- start start 2024-05-09T02:18:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb68ffff640 1 -- 172.21.15.46:0/1099594675 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb684003520 con 0x7fb698157a80 2024-05-09T02:18:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69de8b640 1 -- 172.21.15.46:0/1099594675 >> v2:172.21.15.46:3300/0 conn(0x7fb698155220 msgr2=0x7fb69815b5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69de8b640 1 --2- 172.21.15.46:0/1099594675 >> v2:172.21.15.46:3300/0 conn(0x7fb698155220 0x7fb69815b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69de8b640 1 -- 172.21.15.46:0/1099594675 >> v1:172.21.15.46:6789/0 conn(0x7fb698157a80 legacy=0x7fb6980c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7fb69de8b640 1 -- 172.21.15.46:0/1099594675 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980c31b0 con 0x7fb69815baf0 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37d5100640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37d00c7f80 0x7f37d006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37d5100640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37d00c9da0 0x7f37d015b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37d5100640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d015a230 con 0x7f37d00c9990 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37d5100640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f37d015a510 con 0x7f37d00c7f80 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37d5100640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f37d015a7f0 con 0x7f37d00c9da0 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f3fb3938640 1 -- 172.21.15.46:0/1369623776 shutdown_connections 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f3fb3938640 1 --2- 172.21.15.46:0/1369623776 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f98008c10 0x7f3f98009020 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f3fb3938640 1 -- 172.21.15.46:0/1369623776 >> 172.21.15.46:0/1369623776 conn(0x7f3fac0aa770 msgr2=0x7f3fac0aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37ced9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37d00c7f80 0x7f37d006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37ced9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37d00c7f80 0x7f37d006e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36256/0 (socket says 172.21.15.46:36256) 2024-05-09T02:18:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7f7cd3fff640 1 -- start start 2024-05-09T02:18:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7f7fb9df3640 1 Processor -- start 2024-05-09T02:18:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.159+0000 7f7fb9df3640 1 -- start start 2024-05-09T02:18:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37ce59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f37d00c9990 0x7f37d00b21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37898/0 (socket says 172.21.15.46:37898) 2024-05-09T02:18:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37ce59c640 1 -- 172.21.15.46:0/3791189509 learned_addr learned my addr 172.21.15.46:0/3791189509 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.160+0000 7f37cf59e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37d00c9da0 0x7f37d015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f3fb3938640 1 -- 172.21.15.46:0/1369623776 shutdown_connections 2024-05-09T02:18:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37cdd9b640 1 -- 172.21.15.46:0/3791189509 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273237890 0 0) 0x7f37d015a230 con 0x7f37d00c9990 2024-05-09T02:18:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37cdd9b640 1 -- 172.21.15.46:0/3791189509 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37b8003520 con 0x7f37d00c9990 2024-05-09T02:18:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd40c5070 0x7f7cd415fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f7cd3fff640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4157d30 con 0x7f7cd40701c0 2024-05-09T02:18:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37ced9d640 1 -- 172.21.15.46:0/3791189509 >> v2:172.21.15.107:3300/0 conn(0x7f37d00c9da0 msgr2=0x7f37d015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37ced9d640 1 --2- 172.21.15.46:0/3791189509 >> v2:172.21.15.107:3300/0 conn(0x7f37d00c9da0 0x7f37d015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37ced9d640 1 -- 172.21.15.46:0/3791189509 >> v1:172.21.15.107:6789/0 conn(0x7f37d00c9990 legacy=0x7f37d00b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f37ced9d640 1 -- 172.21.15.46:0/3791189509 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d015aad0 con 0x7f37d00c7f80 2024-05-09T02:18:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f7cd3fff640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4158010 con 0x7f7cd4155460 2024-05-09T02:18:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f7cd3fff640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd4158af0 con 0x7f7cd40c5070 2024-05-09T02:18:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7fb69de8b640 1 --2- 172.21.15.46:0/1099594675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69815baf0 0x7fb698162340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb69806f6f0 tx=0x7fb69002a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4dcfd669da8fde server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f3fb3938640 1 -- 172.21.15.46:0/1369623776 wait complete. 2024-05-09T02:18:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.161+0000 7f7cd27fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7cd4155460 0x7f7cd40c4960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37914/0 (socket says 172.21.15.46:37914) 2024-05-09T02:18:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7cd27fc640 1 -- 172.21.15.46:0/1950421671 learned_addr learned my addr 172.21.15.46:0/1950421671 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb9df3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fb4154860 0x7f7fb406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb9df3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7fb40c8c20 0x7f7fb40735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb9df3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb4154da0 con 0x7f7fb4151640 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb9df3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb4068d20 con 0x7f7fb40c8c20 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb9df3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb40c7100 con 0x7f7fb4154860 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb37fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7fb4151640 0x7f7fb4068610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37916/0 (socket says 172.21.15.46:37916) 2024-05-09T02:18:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb37fe640 1 -- 172.21.15.46:0/3152543467 learned_addr learned my addr 172.21.15.46:0/3152543467 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7fb68ffff640 1 -- 172.21.15.46:0/1099594675 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690007740 con 0x7fb69815baf0 2024-05-09T02:18:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f3acdfe1640 1 Processor -- start 2024-05-09T02:18:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7fb68ffff640 1 -- 172.21.15.46:0/1099594675 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6900078e0 con 0x7fb69815baf0 2024-05-09T02:18:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7fb68ffff640 1 -- 172.21.15.46:0/1099594675 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690007cb0 con 0x7fb69815baf0 2024-05-09T02:18:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f3acdfe1640 1 -- start start 2024-05-09T02:18:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb2ffd640 1 --2- 172.21.15.46:0/3152543467 >> v2:172.21.15.107:3300/0 conn(0x7f7fb4154860 0x7f7fb406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7fb3fff640 1 --2- 172.21.15.46:0/3152543467 >> v2:172.21.15.46:3300/0 conn(0x7f7fb40c8c20 0x7f7fb40735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7fb27fc640 1 -- 172.21.15.46:0/3152543467 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051685511 0 0) 0x7f7fb4154da0 con 0x7f7fb4151640 2024-05-09T02:18:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7fb27fc640 1 -- 172.21.15.46:0/3152543467 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f9c003520 con 0x7f7fb4151640 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7cd37fe640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd40c5070 0x7f7cd415fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396736900 0 0) 0x7f7cd4158010 con 0x7f7cd4155460 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.162+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cbc007930 con 0x7f7cd4155460 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1380688274 0 0) 0x7f7cbc007930 con 0x7f7cd4155460 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd40c5070 msgr2=0x7f7cd415fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd40c5070 0x7f7cd415fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 >> v1:172.21.15.46:6789/0 conn(0x7f7cd40701c0 legacy=0x7f7cd40c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd41582f0 con 0x7f7cd4155460 2024-05-09T02:18:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f7ccc001a70 con 0x7f7cd4155460 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 >> v1:172.21.15.107:6789/0 conn(0x7f7cd4155460 legacy=0x7f7cd40c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cbc007e60 0x7f7cbc0082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cbc008c10 0x7f7cbc009020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cbc009560 0x7f7cbc0145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cbc008c10 0x7f7cbc009020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc014b00 con 0x7f7cbc009560 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc014c80 con 0x7f7cbc007e60 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7cbc014e00 con 0x7f7cbc008c10 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7fb69f8ee640 1 -- 172.21.15.46:0/1099594675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69815baf0 msgr2=0x7fb698162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/1099594675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69815baf0 0x7fb698162340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb69806f6f0 tx=0x7fb69002a610 comp rx=0 tx=0).stop 2024-05-09T02:18:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f96f448b640 1 Processor -- start 2024-05-09T02:18:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f37ced9d640 1 --2- 172.21.15.46:0/3791189509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c7f80 0x7f37d006e6c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37d006f350 tx=0x7f37c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af44f7787494f34e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7fb69f8ee640 1 -- 172.21.15.46:0/1099594675 shutdown_connections 2024-05-09T02:18:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/1099594675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb69815baf0 0x7fb698162340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/1099594675 >> v2:172.21.15.46:3300/0 conn(0x7fb698155220 0x7fb69815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f37cdd9b640 1 -- 172.21.15.46:0/3791189509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4037070 con 0x7f37d00c7f80 2024-05-09T02:18:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7fb69f8ee640 1 -- 172.21.15.46:0/1099594675 >> 172.21.15.46:0/1099594675 conn(0x7fb69806dbc0 msgr2=0x7fb69806dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7fb3fff640 1 -- 172.21.15.46:0/3152543467 >> v2:172.21.15.107:3300/0 conn(0x7f7fb4154860 msgr2=0x7f7fb406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7fb3fff640 1 --2- 172.21.15.46:0/3152543467 >> v2:172.21.15.107:3300/0 conn(0x7f7fb4154860 0x7f7fb406d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7fb3fff640 1 -- 172.21.15.46:0/3152543467 >> v1:172.21.15.107:6789/0 conn(0x7f7fb4151640 legacy=0x7f7fb4068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.163+0000 7f7fb3fff640 1 -- 172.21.15.46:0/3152543467 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb40c73e0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f37cdd9b640 1 -- 172.21.15.46:0/3791189509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c4032440 con 0x7f37d00c7f80 2024-05-09T02:18:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f37cdd9b640 1 -- 172.21.15.46:0/3791189509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4032810 con 0x7f37d00c7f80 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7cd2ffd640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cbc007e60 0x7f7cbc0082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7cd27fc640 1 -- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cbc007e60 msgr2=0x7f7cbc0082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cbc007e60 0x7f7cbc0082d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7cd27fc640 1 -- 172.21.15.46:0/1950421671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cbc009560 msgr2=0x7f7cbc0145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cbc009560 0x7f7cbc0145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7cd27fc640 1 -- 172.21.15.46:0/1950421671 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc007930 con 0x7f7cbc008c10 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f96f448b640 1 -- start start 2024-05-09T02:18:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f3fb3938640 1 Processor -- start 2024-05-09T02:18:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f3fb3938640 1 -- start start 2024-05-09T02:18:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3acdfe1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac004ddc0 0x7f3ac004e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.164+0000 7f7fb3fff640 1 --2- 172.21.15.46:0/3152543467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb40c8c20 0x7f7fb40735e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40728a0 tx=0x7f7fa402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a39a045f1ae7f90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3accfdf640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3ac0035520 0x7f3ac00075a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37928/0 (socket says 172.21.15.46:37928) 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3acdfe1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac004b420 con 0x7f3ac004b010 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3accfdf640 1 -- 172.21.15.46:0/791149990 learned_addr learned my addr 172.21.15.46:0/791149990 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac000e4a0 con 0x7f3ac0035520 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac000f0b0 con 0x7f3ac004ddc0 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f7fb27fc640 1 -- 172.21.15.46:0/3152543467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4037070 con 0x7f7fb40c8c20 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f7fb27fc640 1 -- 172.21.15.46:0/3152543467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa402aaa0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f7fb27fc640 1 -- 172.21.15.46:0/3152543467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80016f0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903888556 0 0) 0x7f3ac000e4a0 con 0x7f3ac0035520 2024-05-09T02:18:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ab8003520 con 0x7f3ac0035520 2024-05-09T02:18:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cbc008c10 0x7f7cbc009020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00a800 tx=0x7f7cbc009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f7f83559b11bd4b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913597225 0 0) 0x7f3ac004b420 con 0x7f3ac004b010 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ac000e4a0 con 0x7f3ac004b010 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2085576427 0 0) 0x7f3ab8003520 con 0x7f3ac0035520 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac004ddc0 msgr2=0x7f3ac004e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac004ddc0 0x7f3ac004e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 >> v1:172.21.15.46:6789/0 conn(0x7f3ac004b010 legacy=0x7f3ac00db220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac000e780 con 0x7f3ac0035520 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f3ac8050870 con 0x7f3ac0035520 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 >> v1:172.21.15.107:6789/0 conn(0x7f3ac0035520 legacy=0x7f3ac00075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ab8003b40 0x7f3ab8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8004800 0x7f3ab8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab8005350 0x7f3ab800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac000f0b0 con 0x7f3ab8003b40 2024-05-09T02:18:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab800c1e0 con 0x7f3ab8004800 2024-05-09T02:18:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.165+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab800c3e0 con 0x7f3ab8005350 2024-05-09T02:18:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3accfdf640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ab8003b40 0x7f3ab8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3ac7fff640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8004800 0x7f3ab8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7fb69f8ee640 1 -- 172.21.15.46:0/1099594675 shutdown_connections 2024-05-09T02:18:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00a3f0 con 0x7f7cbc008c10 2024-05-09T02:18:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb3938640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98008c10 0x7f3fac087a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f7cd1ffb640 1 -- 172.21.15.46:0/1950421671 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc02f070 con 0x7f7cbc008c10 2024-05-09T02:18:32.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb3938640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fac0868e0 0x7f3fac086cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f7fb9df3640 1 -- 172.21.15.46:0/3152543467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb40c8c20 msgr2=0x7f7fb40735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/3152543467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb40c8c20 0x7f7fb40735e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40728a0 tx=0x7f7fa402a010 comp rx=0 tx=0).stop 2024-05-09T02:18:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb3938640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fac0852b0 0x7f3fac0856c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7fb69f8ee640 1 -- 172.21.15.46:0/1099594675 wait complete. 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3accfdf640 1 -- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab8005350 msgr2=0x7f3ab800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3accfdf640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab8005350 0x7f3ab800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3accfdf640 1 -- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8004800 msgr2=0x7f3ab8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3accfdf640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8004800 0x7f3ab8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3accfdf640 1 -- 172.21.15.46:0/791149990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac000e780 con 0x7f3ab8003b40 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f37d5100640 1 -- 172.21.15.46:0/3791189509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c7f80 msgr2=0x7f37d006e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f37d5100640 1 --2- 172.21.15.46:0/3791189509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c7f80 0x7f37d006e6c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37d006f350 tx=0x7f37c402a1a0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb3938640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0c40e0 con 0x7f3fac0868e0 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb3938640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0c3a70 con 0x7f3f98008c10 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb3938640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3fac0c4ff0 con 0x7f3fac0852b0 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb0ed3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fac0868e0 0x7f3fac086cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb0ed3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fac0868e0 0x7f3fac086cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36304/0 (socket says 172.21.15.46:36304) 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb1ed5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fac0852b0 0x7f3fac0856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb0ed3640 1 -- 172.21.15.46:0/2087318687 learned_addr learned my addr 172.21.15.46:0/2087318687 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.166+0000 7f3fb16d4640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98008c10 0x7f3fac087a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb1ed5640 1 -- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98008c10 msgr2=0x7f3fac087a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f448b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec0c6120 0x7f96ec0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f448b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96ec0c8d80 0x7f96ec0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f37d5100640 1 -- 172.21.15.46:0/3791189509 shutdown_connections 2024-05-09T02:18:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f37d5100640 1 --2- 172.21.15.46:0/3791189509 >> v2:172.21.15.107:3300/0 conn(0x7f37d00c9da0 0x7f37d015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f37d5100640 1 --2- 172.21.15.46:0/3791189509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c7f80 0x7f37d006e6c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f37d5100640 1 -- 172.21.15.46:0/3791189509 >> 172.21.15.46:0/3791189509 conn(0x7f37d00ae9f0 msgr2=0x7f37d00aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f2227640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f96ec0c4830 0x7f96ec1594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37944/0 (socket says 172.21.15.46:37944) 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f2227640 1 -- 172.21.15.46:0/3947103015 learned_addr learned my addr 172.21.15.46:0/3947103015 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb1ed5640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98008c10 0x7f3fac087a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb1ed5640 1 -- 172.21.15.46:0/2087318687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fac0868e0 msgr2=0x7f3fac086cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb1ed5640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fac0868e0 0x7f3fac086cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb1ed5640 1 -- 172.21.15.46:0/2087318687 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac0aa450 con 0x7f3fac0852b0 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb1ed5640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fac0852b0 0x7f3fac0856c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fac071680 tx=0x7f3fa400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ec0c6670 con 0x7f96ec0c4830 2024-05-09T02:18:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4007110 con 0x7f3fac0852b0 2024-05-09T02:18:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f96ec15f430 con 0x7f96ec0c8d80 2024-05-09T02:18:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f2a28640 1 --2- 172.21.15.46:0/3947103015 >> v2:172.21.15.46:3300/0 conn(0x7f96ec0c8d80 0x7f96ec0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec15f710 con 0x7f96ec0c6120 2024-05-09T02:18:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f37d5100640 1 -- 172.21.15.46:0/3791189509 shutdown_connections 2024-05-09T02:18:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f7cd3fff640 1 -- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cbc008c10 msgr2=0x7f7cbc009020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/1950421671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cbc008c10 0x7f7cbc009020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00a800 tx=0x7f7cbc009c40 comp rx=0 tx=0).stop 2024-05-09T02:18:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459684766 0 0) 0x7f96ec0c6670 con 0x7f96ec0c4830 2024-05-09T02:18:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96d8003520 con 0x7f96ec0c4830 2024-05-09T02:18:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f7cd37fe640 1 -- 172.21.15.46:0/1950421671 reap_dead start 2024-05-09T02:18:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f7cd3fff640 1 -- 172.21.15.46:0/1950421671 shutdown_connections 2024-05-09T02:18:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1529714255 0 0) 0x7f96d8003520 con 0x7f96ec0c4830 2024-05-09T02:18:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec0c6120 msgr2=0x7f96ec0c8840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T02:18:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec0c6120 0x7f96ec0c8840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 >> v2:172.21.15.46:3300/0 conn(0x7f96ec0c8d80 msgr2=0x7f96ec0c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fac165960 con 0x7f3fac0852b0 2024-05-09T02:18:32.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fac168580 con 0x7f3fac0852b0 2024-05-09T02:18:32.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 --2- 172.21.15.46:0/3947103015 >> v2:172.21.15.46:3300/0 conn(0x7f96ec0c8d80 0x7f96ec0c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec15f9f0 con 0x7f96ec0c4830 2024-05-09T02:18:32.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f3accfdf640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ab8003b40 0x7f3ab8003f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000b60 tx=0x7f3ab8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7c9f25bf789010 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f96e8001710 con 0x7f96ec0c4830 2024-05-09T02:18:32.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa40072d0 con 0x7f3fac0852b0 2024-05-09T02:18:32.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 >> v1:172.21.15.107:6789/0 conn(0x7f96ec0c4830 legacy=0x7f96ec1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40076c0 con 0x7f3fac0852b0 2024-05-09T02:18:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f7cd3fff640 1 -- 172.21.15.46:0/1950421671 >> 172.21.15.46:0/1950421671 conn(0x7f7cd40ca5d0 msgr2=0x7f7cd40ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96d8003a00 0x7f96d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f7fb9df3640 1 -- 172.21.15.46:0/3152543467 shutdown_connections 2024-05-09T02:18:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/3152543467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb40c8c20 0x7f7fb40735e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/3152543467 >> v2:172.21.15.107:3300/0 conn(0x7f7fb4154860 0x7f7fb406d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f7fb9df3640 1 -- 172.21.15.46:0/3152543467 >> 172.21.15.46:0/3152543467 conn(0x7f7fb40c5b70 msgr2=0x7f7fb40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96d8004800 0x7f96d8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac806a410 con 0x7f3ab8003b40 2024-05-09T02:18:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac80ac070 con 0x7f3ab8003b40 2024-05-09T02:18:32.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f3ac77fe640 1 -- 172.21.15.46:0/791149990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80a88c0 con 0x7f3ab8003b40 2024-05-09T02:18:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec15f430 con 0x7f96d80052a0 2024-05-09T02:18:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec15f710 con 0x7f96d8003a00 2024-05-09T02:18:32.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.167+0000 7f37d5100640 1 -- 172.21.15.46:0/3791189509 wait complete. 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f96d800c280 con 0x7f96d8004800 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f2a28640 1 --2- 172.21.15.46:0/3947103015 >> v2:172.21.15.46:3300/0 conn(0x7f96ec0c8d80 0x7f96ec0c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f2a28640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.168+0000 7f96f2227640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96d8003a00 0x7f96d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f96f1a26640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96d8004800 0x7f96d8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f96f2a28640 1 -- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96d8004800 msgr2=0x7f96d8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f96f2a28640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96d8004800 0x7f96d8004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f96f2a28640 1 -- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96d8003a00 msgr2=0x7f96d8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f96f2a28640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96d8003a00 0x7f96d8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f96f2a28640 1 -- 172.21.15.46:0/3947103015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec15f9f0 con 0x7f96d80052a0 2024-05-09T02:18:32.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f7cd3fff640 1 -- 172.21.15.46:0/1950421671 shutdown_connections 2024-05-09T02:18:32.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f7cd3fff640 1 -- 172.21.15.46:0/1950421671 wait complete. 2024-05-09T02:18:32.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ab8003b40 msgr2=0x7f3ab8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7fb69f8ee640 1 Processor -- start 2024-05-09T02:18:32.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.169+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/791149990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ab8003b40 0x7f3ab8003f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000b60 tx=0x7f3ab8005830 comp rx=0 tx=0).stop 2024-05-09T02:18:32.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7fb69f8ee640 1 -- start start 2024-05-09T02:18:32.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7f3acd7e0640 1 -- 172.21.15.46:0/791149990 reap_dead start 2024-05-09T02:18:32.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 shutdown_connections 2024-05-09T02:18:32.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 >> 172.21.15.46:0/791149990 conn(0x7f3ac004c820 msgr2=0x7f3ac004cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7f96f2a28640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96d800b9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0b2970 tx=0x7f96d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c69b124ac5b31a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 shutdown_connections 2024-05-09T02:18:32.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4009da0 con 0x7f96d80052a0 2024-05-09T02:18:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f37d5100640 1 Processor -- start 2024-05-09T02:18:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e402c6a0 con 0x7f96d80052a0 2024-05-09T02:18:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f96f1225640 1 -- 172.21.15.46:0/3947103015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4009da0 con 0x7f96d80052a0 2024-05-09T02:18:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f3acdfe1640 1 -- 172.21.15.46:0/791149990 wait complete. 2024-05-09T02:18:32.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.171+0000 7f37d5100640 1 -- start start 2024-05-09T02:18:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7f7fb9df3640 1 -- 172.21.15.46:0/3152543467 shutdown_connections 2024-05-09T02:18:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.170+0000 7f7fb9df3640 1 -- 172.21.15.46:0/3152543467 wait complete. 2024-05-09T02:18:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 msgr2=0x7f96d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f96f448b640 1 --2- 172.21.15.46:0/3947103015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96d800b9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0b2970 tx=0x7f96d8005830 comp rx=0 tx=0).stop 2024-05-09T02:18:32.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f96f2a28640 1 -- 172.21.15.46:0/3947103015 reap_dead start 2024-05-09T02:18:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f7cd3fff640 1 Processor -- start 2024-05-09T02:18:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 shutdown_connections 2024-05-09T02:18:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 >> 172.21.15.46:0/3947103015 conn(0x7f96ec0cd030 msgr2=0x7f96ec0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37d5100640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37d00c7f80 0x7f37d00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37d5100640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 0x7f37d01f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37d5100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00b22d0 0x7f37d014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37d5100640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00cadc0 con 0x7f37d00c9990 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37d5100640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00b28e0 con 0x7f37d00b22d0 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f7fb9df3640 1 Processor -- start 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69f8ee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb698155220 0x7fb69815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69f8ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb698157a80 0x7fb6981f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69f8ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 0x7fb6981f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69f8ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb698070640 con 0x7fb69815baf0 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69f8ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb69815b090 con 0x7fb698157a80 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69f8ee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb698070390 con 0x7fb698155220 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69de8b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 0x7fb6981f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69de8b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 0x7fb6981f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36324/0 (socket says 172.21.15.46:36324) 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7fb69de8b640 1 -- 172.21.15.46:0/2477521642 learned_addr learned my addr 172.21.15.46:0/2477521642 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69de8b640 1 -- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb698155220 msgr2=0x7fb69815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69d68a640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb698155220 0x7fb69815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69ce89640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb698157a80 0x7fb6981f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69de8b640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb698155220 0x7fb69815a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69de8b640 1 -- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb698157a80 msgr2=0x7fb6981f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69de8b640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb698157a80 0x7fb6981f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69de8b640 1 -- 172.21.15.46:0/2477521642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6981f1dd0 con 0x7fb69815baf0 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69d68a640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb698155220 0x7fb69815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69ce89640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb698157a80 0x7fb6981f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 0x7f37d01f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37d5100640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37d014f3f0 con 0x7f37d00c7f80 2024-05-09T02:18:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 0x7f37d01f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36340/0 (socket says 172.21.15.46:36340) 2024-05-09T02:18:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37ce59c640 1 -- 172.21.15.46:0/2400841164 learned_addr learned my addr 172.21.15.46:0/2400841164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7fb69de8b640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 0x7fb6981f5770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb690009e50 tx=0x7fb690004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f37cf59e640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00b22d0 0x7f37d014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3fa4007860 con 0x7f3fac0852b0 2024-05-09T02:18:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8c005290 con 0x7f3fac0852b0 2024-05-09T02:18:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f3fa1ffb640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3f900763a0 0x7f3f900788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3fa4096e30 con 0x7f3fac0852b0 2024-05-09T02:18:32.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690040070 con 0x7fb69815baf0 2024-05-09T02:18:32.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f3fb16d4640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3f900763a0 0x7f3f900788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb690031b70 con 0x7fb69815baf0 2024-05-09T02:18:32.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6980c6290 con 0x7fb69815baf0 2024-05-09T02:18:32.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ced9d640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37d00c7f80 0x7f37d00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ce59c640 1 -- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37d00c7f80 msgr2=0x7f37d00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ce59c640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37d00c7f80 0x7f37d00ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ce59c640 1 -- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00b22d0 msgr2=0x7f37d014e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f3acdfe1640 1 Processor -- start 2024-05-09T02:18:32.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ce59c640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00b22d0 0x7f37d014e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ce59c640 1 -- 172.21.15.46:0/2400841164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d0151260 con 0x7f37d00c9990 2024-05-09T02:18:32.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37cf59e640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00b22d0 0x7f37d014e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:32.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690045460 con 0x7fb69815baf0 2024-05-09T02:18:32.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f3acdfe1640 1 -- start start 2024-05-09T02:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f37ce59c640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 0x7f37d01f0a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f37c000cbf0 tx=0x7f37c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6980c59f0 con 0x7fb69815baf0 2024-05-09T02:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f3fb16d4640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3f900763a0 0x7f3f900788b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3fac06a0a0 tx=0x7f3f9c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.172+0000 7f7cd3fff640 1 -- start start 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd414dca0 0x7f7cd41eca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.174+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 0x7f7cd414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd414d640 0x7f7cd40aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd27fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 0x7f7cd414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd27fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 0x7f7cd414d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42558/0 (socket says 172.21.15.46:42558) 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd27fc640 1 -- 172.21.15.46:0/257321016 learned_addr learned my addr 172.21.15.46:0/257321016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40748e0 con 0x7f7cd414d640 2024-05-09T02:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40c44d0 con 0x7f7cd414dca0 2024-05-09T02:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd40c5480 con 0x7f7cd41ecf50 2024-05-09T02:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd2ffd640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd414dca0 0x7f7cd41eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c000ad40 con 0x7f37d00c9990 2024-05-09T02:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd27fc640 1 -- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd414dca0 msgr2=0x7f7cd41eca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c0012400 con 0x7f37d00c9990 2024-05-09T02:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.173+0000 7f7fb9df3640 1 -- start start 2024-05-09T02:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb9df3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 0x7f7fb4150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb9df3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fb4151640 0x7f7fb41f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d0151500 con 0x7f37d00c9990 2024-05-09T02:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb9df3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb4154860 0x7f7fb40c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 0x7f7fb4150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 0x7f7fb4150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:45140/0 (socket says 172.21.15.46:45140) 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb37fe640 1 -- 172.21.15.46:0/2523697432 learned_addr learned my addr 172.21.15.46:0/2523697432 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4070200 con 0x7f7fb4154860 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb40c76c0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb40c3560 con 0x7f7fb4151640 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd414dca0 0x7f7cd41eca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d01f0290 con 0x7f37d00c9990 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb2ffd640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fb4151640 0x7f7fb41f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb3fff640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb4154860 0x7f7fb40c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb37fe640 1 -- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fb4151640 msgr2=0x7f7fb41f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb37fe640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fb4151640 0x7f7fb41f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb37fe640 1 -- 172.21.15.46:0/2523697432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb4154860 msgr2=0x7f7fb40c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb37fe640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb4154860 0x7f7fb40c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb37fe640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb41f5810 con 0x7f7fb40c8c20 2024-05-09T02:18:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00127b0 con 0x7f37d00c9990 2024-05-09T02:18:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.175+0000 7f7cd27fc640 1 -- 172.21.15.46:0/257321016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd414d640 msgr2=0x7f7cd40aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7cd2ffd640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd414dca0 0x7f7cd41eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7cd37fe640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd414d640 0x7f7cd40aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7fb3fff640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb4154860 0x7f7fb40c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd414d640 0x7f7cd40aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7f7cd27fc640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd414eca0 con 0x7f7cd41ecf50 2024-05-09T02:18:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f7cd37fe640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd414d640 0x7f7cd40aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3acdfe1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 0x7f3ac00d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f7cd27fc640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 0x7f7cd414d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00a800 tx=0x7f7cd41584c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3acdfe1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac00d3270 0x7f3ac0173c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3acdfe1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ac00cf680 0x7f3ac00de630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.176+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69806e280 con 0x7fb69815baf0 2024-05-09T02:18:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 shutdown_connections 2024-05-09T02:18:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f7fb37fe640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 0x7f7fb4150210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c6b0 tx=0x7f7fa800cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb690039040 con 0x7fb69815baf0 2024-05-09T02:18:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b0005290 con 0x7f37d00c9990 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8018070 con 0x7f7fb40c8c20 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb41f5af0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb41f60b0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa80072d0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80047e0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3accfdf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 0x7f3ac00d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3accfdf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 0x7f3ac00d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:45142/0 (socket says 172.21.15.46:45142) 2024-05-09T02:18:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3accfdf640 1 -- 172.21.15.46:0/688312981 learned_addr learned my addr 172.21.15.46:0/688312981 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac00db930 con 0x7f3ac00cf680 2024-05-09T02:18:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac000ed40 con 0x7f3ab8003b40 2024-05-09T02:18:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac00dbab0 con 0x7f3ac00d3270 2024-05-09T02:18:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.177+0000 7f96f448b640 1 -- 172.21.15.46:0/3947103015 wait complete. 2024-05-09T02:18:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7fb68dffb640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb67c076300 0x7fb67c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7f3acd7e0640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ac00cf680 0x7f3ac00de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.178+0000 7f3ac7fff640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac00d3270 0x7f3ac0173c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7fb69d68a640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb67c076300 0x7fb67c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3accfdf640 1 -- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac00d3270 msgr2=0x7f3ac0173c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37c0012950 con 0x7f37d00c9990 2024-05-09T02:18:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3accfdf640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac00d3270 0x7f3ac0173c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3accfdf640 1 -- 172.21.15.46:0/688312981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ac00cf680 msgr2=0x7f3ac00de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3accfdf640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ac00cf680 0x7f3ac00de630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3accfdf640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac00cf380 con 0x7f3ab8003b40 2024-05-09T02:18:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3accfdf640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 0x7f3ac00d2220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8051620 tx=0x7f3ac806a920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.179+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3fa409a030 con 0x7f3fac0852b0 2024-05-09T02:18:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc034880 con 0x7f7cd41ecf50 2024-05-09T02:18:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80c0070 con 0x7f3ab8003b40 2024-05-09T02:18:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc042070 con 0x7f7cd41ecf50 2024-05-09T02:18:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd414da50 con 0x7f7cd41ecf50 2024-05-09T02:18:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f37b77fe640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f37bc0763a0 0x7f37bc0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd41ed520 con 0x7f7cd41ecf50 2024-05-09T02:18:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f96f448b640 1 Processor -- start 2024-05-09T02:18:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f37c0097ef0 con 0x7f37d00c9990 2024-05-09T02:18:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac80a8ae0 con 0x7f3ab8003b40 2024-05-09T02:18:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac0174790 con 0x7f3ab8003b40 2024-05-09T02:18:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc034c40 con 0x7f7cd41ecf50 2024-05-09T02:18:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac00d2760 con 0x7f3ab8003b40 2024-05-09T02:18:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb6900b8e80 con 0x7fb69815baf0 2024-05-09T02:18:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fa801b070 con 0x7f7fb40c8c20 2024-05-09T02:18:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.181+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8050870 con 0x7f3ab8003b40 2024-05-09T02:18:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.181+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f94005290 con 0x7f7fb40c8c20 2024-05-09T02:18:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.181+0000 7f7f9bfff640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fa00762d0 0x7f7fa00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.181+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7fa8096ff0 con 0x7f7fb40c8c20 2024-05-09T02:18:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.181+0000 7fb69d68a640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb67c076300 0x7fb67c078810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb694001220 tx=0x7fb694009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.180+0000 7f96f448b640 1 -- start start 2024-05-09T02:18:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.182+0000 7f96f448b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96ec0c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ccc03c070 con 0x7f7cd41ecf50 2024-05-09T02:18:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f2227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96ec0c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f2227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96ec0c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36378/0 (socket says 172.21.15.46:36378) 2024-05-09T02:18:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ac80c3070 con 0x7f3ab8003b40 2024-05-09T02:18:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f2227640 1 -- 172.21.15.46:0/256079065 learned_addr learned my addr 172.21.15.46:0/256079065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.182+0000 7f37ced9d640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f37bc0763a0 0x7f37bc0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f448b640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96ec149150 0x7f96ec1f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac00d0730 con 0x7f3ab8003b40 2024-05-09T02:18:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f448b640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec148490 0x7f96ec1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f448b640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec0c3a10 con 0x7f96d80052a0 2024-05-09T02:18:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f448b640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1601f0 con 0x7f96ec149150 2024-05-09T02:18:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f448b640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec0c3b90 con 0x7f96ec148490 2024-05-09T02:18:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f1a26640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96ec149150 0x7f96ec1f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f7cbbfff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7cc00763a0 0x7f7cc00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f7fb2ffd640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fa00762d0 0x7f7fa00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.183+0000 7f96f2a28640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec148490 0x7f96ec1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7ccc0b8320 con 0x7f7cd41ecf50 2024-05-09T02:18:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f7cd2ffd640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7cc00763a0 0x7f7cc00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f3ac57fa640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aac0763d0 0x7f3aac0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3ac8134750 con 0x7f3ab8003b40 2024-05-09T02:18:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f3ac7fff640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aac0763d0 0x7f3aac0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f7fb2ffd640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fa00762d0 0x7f7fa00787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40ad230 tx=0x7f7fac00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f7cd2ffd640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7cc00763a0 0x7f7cc00788b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40ae6c0 tx=0x7f7cc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f96f2227640 1 -- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec148490 msgr2=0x7f96ec1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.185+0000 7f37ced9d640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f37bc0763a0 0x7f37bc0788b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f37c4034000 tx=0x7f37c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f96f2227640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec148490 0x7f96ec1488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f96f2227640 1 -- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96ec149150 msgr2=0x7f96ec1f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f96f2227640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96ec149150 0x7f96ec1f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f96f2227640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec1498f0 con 0x7f96d80052a0 2024-05-09T02:18:32.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.184+0000 7f96f2227640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96ec0c2030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96e8007310 tx=0x7f96e80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.185+0000 7f96f2a28640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec148490 0x7f96ec1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.185+0000 7f96f1a26640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96ec149150 0x7f96ec1f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.185+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb4005290 con 0x7f7cd41ecf50 2024-05-09T02:18:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.185+0000 7f3ac7fff640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aac0763d0 0x7f3aac0788e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ac004f9e0 tx=0x7f3ab4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.187+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7fa8060530 con 0x7f7fb40c8c20 2024-05-09T02:18:32.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.187+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb69806e280 con 0x7fb69815baf0 2024-05-09T02:18:32.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.191+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ccc03a040 con 0x7f7cd41ecf50 2024-05-09T02:18:32.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.191+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ac80fd680 con 0x7f3ab8003b40 2024-05-09T02:18:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.198+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37c0061500 con 0x7f37d00c9990 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.198+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e800f8d0 con 0x7f96d80052a0 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.198+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e8018070 con 0x7f96d80052a0 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.199+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e800fc70 con 0x7f96d80052a0 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.199+0000 7f96f448b640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec0cbe00 con 0x7f96d80052a0 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.199+0000 7f96f448b640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec0cc3a0 con 0x7f96d80052a0 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.202+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f96e801d460 con 0x7f96d80052a0 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.203+0000 7f96e2ffd640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f96d00763d0 0x7f96d00788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.203+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f96e8097810 con 0x7f96d80052a0 2024-05-09T02:18:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.204+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec06a330 con 0x7f96d80052a0 2024-05-09T02:18:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.207+0000 7f96f1a26640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f96d00763d0 0x7f96d00788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.214+0000 7f96f1a26640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f96d00763d0 0x7f96d00788e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f96ec1579b0 tx=0x7f96dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.214+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f96e8060860 con 0x7f96d80052a0 2024-05-09T02:18:32.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.543+0000 7f9e30b22640 1 -- 172.21.15.46:0/109769323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9e10005580 con 0x7f9e24031a10 2024-05-09T02:18:32.550 INFO:teuthology.orchestra.run.smithi046.stdout:55834574857 2024-05-09T02:18:32.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.544+0000 7f9e17fff640 1 -- 172.21.15.46:0/109769323 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e20080e80 con 0x7f9e24031a10 2024-05-09T02:18:32.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 -- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9e1c076510 msgr2=0x7f9e1c078a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9e1c076510 0x7f9e1c078a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e24033e10 tx=0x7f9e18007e20 comp rx=0 tx=0).stop 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 -- 172.21.15.46:0/109769323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 msgr2=0x7f9e240420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e240420d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e2002a8f0 tx=0x7f9e200046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 -- 172.21.15.46:0/109769323 shutdown_connections 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9e1c076510 0x7f9e1c078a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e240df040 0x7f9e24033030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.548+0000 7f9e15ffb640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e240dc3f0 0x7f9e24174b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.549+0000 7f9e15ffb640 1 --2- 172.21.15.46:0/109769323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e24031a10 0x7f9e240420d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.549+0000 7f9e15ffb640 1 -- 172.21.15.46:0/109769323 >> 172.21.15.46:0/109769323 conn(0x7f9e240064d0 msgr2=0x7f9e240db090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.549+0000 7f9e15ffb640 1 -- 172.21.15.46:0/109769323 shutdown_connections 2024-05-09T02:18:32.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.549+0000 7f9e15ffb640 1 -- 172.21.15.46:0/109769323 wait complete. 2024-05-09T02:18:32.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-05-09T02:18:32.574 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.609+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f96ec155b50 con 0x7f96d80052a0 2024-05-09T02:18:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.609+0000 7f96e2ffd640 1 -- 172.21.15.46:0/256079065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96e8064b60 con 0x7f96d80052a0 2024-05-09T02:18:32.612 INFO:teuthology.orchestra.run.smithi046.stdout:55834574858 2024-05-09T02:18:32.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f96d00763d0 msgr2=0x7f96d00788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f96d00763d0 0x7f96d00788e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f96ec1579b0 tx=0x7f96dc008040 comp rx=0 tx=0).stop 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 msgr2=0x7f96ec0c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96ec0c2030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96e8007310 tx=0x7f96e80077d0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 shutdown_connections 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f96d00763d0 0x7f96d00788e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.611+0000 7f96e0ff9640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f96ec148490 0x7f96ec1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.612+0000 7f96e0ff9640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96ec149150 0x7f96ec1f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.612+0000 7f96e0ff9640 1 --2- 172.21.15.46:0/256079065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96d80052a0 0x7f96ec0c2030 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.612+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 >> 172.21.15.46:0/256079065 conn(0x7f96ec0cd030 msgr2=0x7f96ec1594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.612+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 shutdown_connections 2024-05-09T02:18:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.612+0000 7f96e0ff9640 1 -- 172.21.15.46:0/256079065 wait complete. 2024-05-09T02:18:32.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.7 2024-05-09T02:18:32.626 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.631+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3f8c005580 con 0x7f3fac0852b0 2024-05-09T02:18:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.631+0000 7f3fa1ffb640 1 -- 172.21.15.46:0/2087318687 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3fa40604d0 con 0x7f3fac0852b0 2024-05-09T02:18:32.634 INFO:teuthology.orchestra.run.smithi046.stdout:55834574859 2024-05-09T02:18:32.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.633+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb69806a330 con 0x7fb69815baf0 2024-05-09T02:18:32.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.633+0000 7fb68dffb640 1 -- 172.21.15.46:0/2477521642 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb69004a060 con 0x7fb69815baf0 2024-05-09T02:18:32.636 INFO:teuthology.orchestra.run.smithi046.stdout:55834574858 2024-05-09T02:18:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3f900763a0 msgr2=0x7f3f900788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3f900763a0 0x7f3f900788b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3fac06a0a0 tx=0x7f3f9c00b040 comp rx=0 tx=0).stop 2024-05-09T02:18:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fac0852b0 msgr2=0x7f3fac0856c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fac0852b0 0x7f3fac0856c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fac071680 tx=0x7f3fa400c960 comp rx=0 tx=0).stop 2024-05-09T02:18:32.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 shutdown_connections 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3f900763a0 0x7f3f900788b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fac0852b0 0x7f3fac0856c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fac0868e0 0x7f3fac086cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 --2- 172.21.15.46:0/2087318687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f98008c10 0x7f3fac087a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 >> 172.21.15.46:0/2087318687 conn(0x7f3fac0aa770 msgr2=0x7f3fac0c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 shutdown_connections 2024-05-09T02:18:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.635+0000 7f3fb3938640 1 -- 172.21.15.46:0/2087318687 wait complete. 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb67c076300 msgr2=0x7fb67c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb67c076300 0x7fb67c078810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb694001220 tx=0x7fb694009040 comp rx=0 tx=0).stop 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 msgr2=0x7fb6981f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 0x7fb6981f5770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb690009e50 tx=0x7fb690004a40 comp rx=0 tx=0).stop 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 shutdown_connections 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb67c076300 0x7fb67c078810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815baf0 0x7fb6981f5770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb698157a80 0x7fb6981f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 --2- 172.21.15.46:0/2477521642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb698155220 0x7fb69815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 >> 172.21.15.46:0/2477521642 conn(0x7fb69806dbc0 msgr2=0x7fb698156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 shutdown_connections 2024-05-09T02:18:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.636+0000 7fb69f8ee640 1 -- 172.21.15.46:0/2477521642 wait complete. 2024-05-09T02:18:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.637+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7f94005580 con 0x7f7fb40c8c20 2024-05-09T02:18:32.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.637+0000 7f7f9bfff640 1 -- 172.21.15.46:0/2523697432 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7fa805fe30 con 0x7f7fb40c8c20 2024-05-09T02:18:32.642 INFO:teuthology.orchestra.run.smithi046.stdout:55834574859 2024-05-09T02:18:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.638+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3ac004abe0 con 0x7f3ab8003b40 2024-05-09T02:18:32.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.639+0000 7f3ac57fa640 1 -- 172.21.15.46:0/688312981 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ac8101980 con 0x7f3ab8003b40 2024-05-09T02:18:32.642 INFO:teuthology.orchestra.run.smithi046.stdout:55834574858 2024-05-09T02:18:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fa00762d0 msgr2=0x7f7fa00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fa00762d0 0x7f7fa00787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40ad230 tx=0x7f7fac00b040 comp rx=0 tx=0).stop 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 msgr2=0x7f7fb4150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 0x7f7fb4150210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c6b0 tx=0x7f7fa800cb70 comp rx=0 tx=0).stop 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 shutdown_connections 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fa00762d0 0x7f7fa00787e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb4154860 0x7f7fb40c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7fb4151640 0x7f7fb41f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 --2- 172.21.15.46:0/2523697432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb40c8c20 0x7f7fb4150210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 >> 172.21.15.46:0/2523697432 conn(0x7f7fb40c5b70 msgr2=0x7f7fb40aa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 shutdown_connections 2024-05-09T02:18:32.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.640+0000 7f7fb9df3640 1 -- 172.21.15.46:0/2523697432 wait complete. 2024-05-09T02:18:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aac0763d0 msgr2=0x7f3aac0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aac0763d0 0x7f3aac0788e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ac004f9e0 tx=0x7f3ab4009040 comp rx=0 tx=0).stop 2024-05-09T02:18:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 msgr2=0x7f3ac00d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 0x7f3ac00d2220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8051620 tx=0x7f3ac806a920 comp rx=0 tx=0).stop 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 shutdown_connections 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aac0763d0 0x7f3aac0788e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ac00cf680 0x7f3ac00de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ac00d3270 0x7f3ac0173c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 --2- 172.21.15.46:0/688312981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8003b40 0x7f3ac00d2220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.641+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 >> 172.21.15.46:0/688312981 conn(0x7f3ac004c820 msgr2=0x7f3ac00da4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.642+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 shutdown_connections 2024-05-09T02:18:32.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.642+0000 7f3acdfe1640 1 -- 172.21.15.46:0/688312981 wait complete. 2024-05-09T02:18:32.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.643+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7cb4005580 con 0x7f7cd41ecf50 2024-05-09T02:18:32.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.643+0000 7f7cbbfff640 1 -- 172.21.15.46:0/257321016 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ccc0819e0 con 0x7f7cd41ecf50 2024-05-09T02:18:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:55834574856 2024-05-09T02:18:32.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f37b0005580 con 0x7f37d00c9990 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7cc00763a0 msgr2=0x7f7cc00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7cc00763a0 0x7f7cc00788b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40ae6c0 tx=0x7f7cc4009040 comp rx=0 tx=0).stop 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 msgr2=0x7f7cd414d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 0x7f7cd414d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00a800 tx=0x7f7cd41584c0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 shutdown_connections 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7cc00763a0 0x7f7cc00788b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cd414d640 0x7f7cd40aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7cd41ecf50 0x7f7cd414d100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 --2- 172.21.15.46:0/257321016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cd414dca0 0x7f7cd41eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.647+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 >> 172.21.15.46:0/257321016 conn(0x7f7cd40ca5d0 msgr2=0x7f7cd40c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.648+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 shutdown_connections 2024-05-09T02:18:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.648+0000 7f37b77fe640 1 -- 172.21.15.46:0/2400841164 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37c0060e00 con 0x7f37d00c9990 2024-05-09T02:18:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.648+0000 7f7cd3fff640 1 -- 172.21.15.46:0/257321016 wait complete. 2024-05-09T02:18:32.652 INFO:teuthology.orchestra.run.smithi046.stdout:55834574858 2024-05-09T02:18:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.651+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f37bc0763a0 msgr2=0x7f37bc0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.651+0000 7f37d5100640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f37bc0763a0 0x7f37bc0788b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f37c4034000 tx=0x7f37c402e000 comp rx=0 tx=0).stop 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.651+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 msgr2=0x7f37d01f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.651+0000 7f37d5100640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 0x7f37d01f0a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f37c000cbf0 tx=0x7f37c000a430 comp rx=0 tx=0).stop 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 shutdown_connections 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f37bc0763a0 0x7f37bc0788b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37d00b22d0 0x7f37d014e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37d00c9990 0x7f37d01f0a90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 --2- 172.21.15.46:0/2400841164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37d00c7f80 0x7f37d00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 >> 172.21.15.46:0/2400841164 conn(0x7f37d00ae9f0 msgr2=0x7f37d00cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 shutdown_connections 2024-05-09T02:18:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.652+0000 7f37d5100640 1 -- 172.21.15.46:0/2400841164 wait complete. 2024-05-09T02:18:32.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.6 2024-05-09T02:18:32.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.0 2024-05-09T02:18:32.661 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.661 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.1 2024-05-09T02:18:32.662 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2024-05-09T02:18:32.666 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2024-05-09T02:18:32.666 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2024-05-09T02:18:32.671 DEBUG:teuthology.parallel:result is None 2024-05-09T02:18:32.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T02:18:32.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.822+0000 7fae66c2b640 1 Processor -- start 2024-05-09T02:18:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.822+0000 7fae66c2b640 1 -- start start 2024-05-09T02:18:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae66c2b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae601580a0 0x7fae60154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae66c2b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae600b1e60 con 0x7fae600b17d0 2024-05-09T02:18:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae66c2b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6015bde0 con 0x7fae600c4800 2024-05-09T02:18:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae66c2b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fae6015b950 con 0x7fae601580a0 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fae600b17d0 0x7fae60157990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44274/0 (socket says 172.21.15.46:44274) 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5ffff640 1 -- 172.21.15.46:0/90229965 learned_addr learned my addr 172.21.15.46:0/90229965 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818818694 0 0) 0x7fae600b1e60 con 0x7fae600b17d0 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae651c8640 1 --2- 172.21.15.46:0/90229965 >> v2:172.21.15.107:3300/0 conn(0x7fae601580a0 0x7fae60154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c003520 con 0x7fae600b17d0 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142806429 0 0) 0x7fae6015bde0 con 0x7fae600c4800 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae600b1e60 con 0x7fae600c4800 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4074017378 0 0) 0x7fae4c003520 con 0x7fae600b17d0 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 >> v2:172.21.15.107:3300/0 conn(0x7fae601580a0 msgr2=0x7fae60154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 --2- 172.21.15.46:0/90229965 >> v2:172.21.15.107:3300/0 conn(0x7fae601580a0 0x7fae60154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 >> v1:172.21.15.107:6789/0 conn(0x7fae600c4800 legacy=0x7fae600c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6015b020 con 0x7fae600b17d0 2024-05-09T02:18:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7fae480019f0 con 0x7fae600b17d0 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 >> v1:172.21.15.46:6789/0 conn(0x7fae600b17d0 legacy=0x7fae60157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae4c003c80 0x7fae4c0040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae4c004d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae4c0099b0 0x7fae4c00bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae6015b950 con 0x7fae4c004850 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c00c3c0 con 0x7fae4c0099b0 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.824+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae4c00c5c0 con 0x7fae4c003c80 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae5ffff640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae4c004d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae651c8640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae4c0099b0 0x7fae4c00bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae649c7640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae4c003c80 0x7fae4c0040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae5ffff640 1 -- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae4c003c80 msgr2=0x7fae4c0040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae5ffff640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae4c003c80 0x7fae4c0040f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae5ffff640 1 -- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae4c0099b0 msgr2=0x7fae4c00bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae5ffff640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae4c0099b0 0x7fae4c00bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae5ffff640 1 -- 172.21.15.46:0/90229965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c003520 con 0x7fae4c004850 2024-05-09T02:18:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae651c8640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae4c0099b0 0x7fae4c00bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.825+0000 7fae651c8640 1 -- 172.21.15.46:0/90229965 reap_dead start 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.826+0000 7fae5ffff640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae4c004d20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae6006d460 tx=0x7fae4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390f9a57fa7e6344 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.826+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4800a330 con 0x7fae4c004850 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.826+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4802f070 con 0x7fae4c004850 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.826+0000 7fae5f7fe640 1 -- 172.21.15.46:0/90229965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4802bac0 con 0x7fae4c004850 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.826+0000 7fae66c2b640 1 -- 172.21.15.46:0/90229965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 msgr2=0x7fae4c004d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.826+0000 7fae66c2b640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae4c004d20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae6006d460 tx=0x7fae4c005830 comp rx=0 tx=0).stop 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.827+0000 7fae66c2b640 1 -- 172.21.15.46:0/90229965 shutdown_connections 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.827+0000 7fae66c2b640 1 --2- 172.21.15.46:0/90229965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae4c004d20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.827+0000 7fae66c2b640 1 -- 172.21.15.46:0/90229965 >> 172.21.15.46:0/90229965 conn(0x7fae60068ec0 msgr2=0x7fae600cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.827+0000 7fae66c2b640 1 -- 172.21.15.46:0/90229965 shutdown_connections 2024-05-09T02:18:32.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.827+0000 7fae66c2b640 1 -- 172.21.15.46:0/90229965 wait complete. 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.828+0000 7fae66c2b640 1 Processor -- start 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.828+0000 7fae66c2b640 1 -- start start 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.829+0000 7fae66c2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae601ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae601f17f0 0x7fae60156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae60142470 0x7fae60142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae6006ee40 con 0x7fae4c004850 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae6015b5e0 con 0x7fae60142470 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae600b2120 con 0x7fae601f17f0 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae601ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae601ee2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36394/0 (socket says 172.21.15.46:36394) 2024-05-09T02:18:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 -- 172.21.15.46:0/3266345255 learned_addr learned my addr 172.21.15.46:0/3266345255 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae5ffff640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae601f17f0 0x7fae60156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae651c8640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae60142470 0x7fae60142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 -- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae601f17f0 msgr2=0x7fae60156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae601f17f0 0x7fae60156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 -- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae60142470 msgr2=0x7fae60142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae60142470 0x7fae60142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 -- 172.21.15.46:0/3266345255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae600cc1e0 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae649c7640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae601ee2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fae5000f850 tx=0x7fae5000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5000fe40 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae50018070 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae600cc4c0 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5000d6d0 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.830+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae601edda0 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.831+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6006a330 con 0x7fae4c004850 2024-05-09T02:18:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.832+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae5000d870 con 0x7fae4c004850 2024-05-09T02:18:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.833+0000 7fae5d7fa640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fae400762d0 0x7fae400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.833+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fae50097720 con 0x7fae4c004850 2024-05-09T02:18:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.833+0000 7fae5ffff640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fae400762d0 0x7fae400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.834+0000 7fae5ffff640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fae400762d0 0x7fae400787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae6008f050 tx=0x7fae48007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:32.838+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fae50060de0 con 0x7fae4c004850 2024-05-09T02:18:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.024+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae600cbf90 con 0x7fae400762d0 2024-05-09T02:18:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.036+0000 7fae5d7fa640 1 -- 172.21.15.46:0/3266345255 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490296 (secure 0 0 0) 0x7fae600cbf90 con 0x7fae400762d0 2024-05-09T02:18:33.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:33.047 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fae400762d0 msgr2=0x7fae400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fae400762d0 0x7fae400787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae6008f050 tx=0x7fae48007000 comp rx=0 tx=0).stop 2024-05-09T02:18:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 msgr2=0x7fae601ee2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae601ee2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fae5000f850 tx=0x7fae5000fd10 comp rx=0 tx=0).stop 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 shutdown_connections 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fae400762d0 0x7fae400787e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae60142470 0x7fae60142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae601f17f0 0x7fae60156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 --2- 172.21.15.46:0/3266345255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae4c004850 0x7fae601ee2c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 >> 172.21.15.46:0/3266345255 conn(0x7fae60068ec0 msgr2=0x7fae600c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 shutdown_connections 2024-05-09T02:18:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.040+0000 7fae66c2b640 1 -- 172.21.15.46:0/3266345255 wait complete. 2024-05-09T02:18:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-09T02:18:32.503259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2021832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.311115"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199693+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:18:24.199693+0000","last_peered":"2024-05-09T02:18:24.199693+0000","last_clean":"2024-05-09T02:18:24.199693+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:18:24.199693+0000","last_undegraded":"2024-05-09T02:18:24.199693+0000","last_fullsized":"2024-05-09T02:18:24.199693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194809+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:24.194809+0000","last_peered":"2024-05-09T02:18:24.194809+0000","last_clean":"2024-05-09T02:18:24.194809+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:24.194809+0000","last_undegraded":"2024-05-09T02:18:24.194809+0000","last_fullsized":"2024-05-09T02:18:24.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200366+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:24.200366+0000","last_peered":"2024-05-09T02:18:24.200366+0000","last_clean":"2024-05-09T02:18:24.200366+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:24.200366+0000","last_undegraded":"2024-05-09T02:18:24.200366+0000","last_fullsized":"2024-05-09T02:18:24.200366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199237+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:18:24.199237+0000","last_peered":"2024-05-09T02:18:24.199237+0000","last_clean":"2024-05-09T02:18:24.199237+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:18:24.199237+0000","last_undegraded":"2024-05-09T02:18:24.199237+0000","last_fullsized":"2024-05-09T02:18:24.199237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212516+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:18:24.212516+0000","last_peered":"2024-05-09T02:18:24.212516+0000","last_clean":"2024-05-09T02:18:24.212516+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:18:24.212516+0000","last_undegraded":"2024-05-09T02:18:24.212516+0000","last_fullsized":"2024-05-09T02:18:24.212516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200409+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:24.200409+0000","last_peered":"2024-05-09T02:18:24.200409+0000","last_clean":"2024-05-09T02:18:24.200409+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:24.200409+0000","last_undegraded":"2024-05-09T02:18:24.200409+0000","last_fullsized":"2024-05-09T02:18:24.200409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194737+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:24.194737+0000","last_peered":"2024-05-09T02:18:24.194737+0000","last_clean":"2024-05-09T02:18:24.194737+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:24.194737+0000","last_undegraded":"2024-05-09T02:18:24.194737+0000","last_fullsized":"2024-05-09T02:18:24.194737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199565+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:18:24.199565+0000","last_peered":"2024-05-09T02:18:24.199565+0000","last_clean":"2024-05-09T02:18:24.199565+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:18:24.199565+0000","last_undegraded":"2024-05-09T02:18:24.199565+0000","last_fullsized":"2024-05-09T02:18:24.199565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117680+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:25.117680+0000","last_peered":"2024-05-09T02:18:25.117680+0000","last_clean":"2024-05-09T02:18:25.117680+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:25.117680+0000","last_undegraded":"2024-05-09T02:18:25.117680+0000","last_fullsized":"2024-05-09T02:18:25.117680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545151+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:24.545151+0000","last_peered":"2024-05-09T02:18:24.545151+0000","last_clean":"2024-05-09T02:18:24.545151+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:24.545151+0000","last_undegraded":"2024-05-09T02:18:24.545151+0000","last_fullsized":"2024-05-09T02:18:24.545151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199967+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:18:24.199967+0000","last_peered":"2024-05-09T02:18:24.199967+0000","last_clean":"2024-05-09T02:18:24.199967+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:18:24.199967+0000","last_undegraded":"2024-05-09T02:18:24.199967+0000","last_fullsized":"2024-05-09T02:18:24.199967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544707+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:18:24.544707+0000","last_peered":"2024-05-09T02:18:24.544707+0000","last_clean":"2024-05-09T02:18:24.544707+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:18:24.544707+0000","last_undegraded":"2024-05-09T02:18:24.544707+0000","last_fullsized":"2024-05-09T02:18:24.544707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117346+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:25.117346+0000","last_peered":"2024-05-09T02:18:25.117346+0000","last_clean":"2024-05-09T02:18:25.117346+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:25.117346+0000","last_undegraded":"2024-05-09T02:18:25.117346+0000","last_fullsized":"2024-05-09T02:18:25.117346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545312+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:24.545312+0000","last_peered":"2024-05-09T02:18:24.545312+0000","last_clean":"2024-05-09T02:18:24.545312+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:24.545312+0000","last_undegraded":"2024-05-09T02:18:24.545312+0000","last_fullsized":"2024-05-09T02:18:24.545312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199878+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:18:24.199878+0000","last_peered":"2024-05-09T02:18:24.199878+0000","last_clean":"2024-05-09T02:18:24.199878+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:18:24.199878+0000","last_undegraded":"2024-05-09T02:18:24.199878+0000","last_fullsized":"2024-05-09T02:18:24.199878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213230+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:18:24.213230+0000","last_peered":"2024-05-09T02:18:24.213230+0000","last_clean":"2024-05-09T02:18:24.213230+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:18:24.213230+0000","last_undegraded":"2024-05-09T02:18:24.213230+0000","last_fullsized":"2024-05-09T02:18:24.213230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116725+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:25.116725+0000","last_peered":"2024-05-09T02:18:25.116725+0000","last_clean":"2024-05-09T02:18:25.116725+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:25.116725+0000","last_undegraded":"2024-05-09T02:18:25.116725+0000","last_fullsized":"2024-05-09T02:18:25.116725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117491+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:25.117491+0000","last_peered":"2024-05-09T02:18:25.117491+0000","last_clean":"2024-05-09T02:18:25.117491+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:25.117491+0000","last_undegraded":"2024-05-09T02:18:25.117491+0000","last_fullsized":"2024-05-09T02:18:25.117491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200557+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:18:24.200557+0000","last_peered":"2024-05-09T02:18:24.200557+0000","last_clean":"2024-05-09T02:18:24.200557+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:18:24.200557+0000","last_undegraded":"2024-05-09T02:18:24.200557+0000","last_fullsized":"2024-05-09T02:18:24.200557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117023+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:18:25.117023+0000","last_peered":"2024-05-09T02:18:25.117023+0000","last_clean":"2024-05-09T02:18:25.117023+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:18:25.117023+0000","last_undegraded":"2024-05-09T02:18:25.117023+0000","last_fullsized":"2024-05-09T02:18:25.117023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199802+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:24.199802+0000","last_peered":"2024-05-09T02:18:24.199802+0000","last_clean":"2024-05-09T02:18:24.199802+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:24.199802+0000","last_undegraded":"2024-05-09T02:18:24.199802+0000","last_fullsized":"2024-05-09T02:18:24.199802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212930+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:24.212930+0000","last_peered":"2024-05-09T02:18:24.212930+0000","last_clean":"2024-05-09T02:18:24.212930+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:24.212930+0000","last_undegraded":"2024-05-09T02:18:24.212930+0000","last_fullsized":"2024-05-09T02:18:24.212930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200551+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:18:24.200551+0000","last_peered":"2024-05-09T02:18:24.200551+0000","last_clean":"2024-05-09T02:18:24.200551+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:18:24.200551+0000","last_undegraded":"2024-05-09T02:18:24.200551+0000","last_fullsized":"2024-05-09T02:18:24.200551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200686+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:18:24.200686+0000","last_peered":"2024-05-09T02:18:24.200686+0000","last_clean":"2024-05-09T02:18:24.200686+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:18:24.200686+0000","last_undegraded":"2024-05-09T02:18:24.200686+0000","last_fullsized":"2024-05-09T02:18:24.200686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200229+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:24.200229+0000","last_peered":"2024-05-09T02:18:24.200229+0000","last_clean":"2024-05-09T02:18:24.200229+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:24.200229+0000","last_undegraded":"2024-05-09T02:18:24.200229+0000","last_fullsized":"2024-05-09T02:18:24.200229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212619+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:24.212619+0000","last_peered":"2024-05-09T02:18:24.212619+0000","last_clean":"2024-05-09T02:18:24.212619+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:24.212619+0000","last_undegraded":"2024-05-09T02:18:24.212619+0000","last_fullsized":"2024-05-09T02:18:24.212619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213272+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:18:24.213272+0000","last_peered":"2024-05-09T02:18:24.213272+0000","last_clean":"2024-05-09T02:18:24.213272+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:18:24.213272+0000","last_undegraded":"2024-05-09T02:18:24.213272+0000","last_fullsized":"2024-05-09T02:18:24.213272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545447+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:18:24.545447+0000","last_peered":"2024-05-09T02:18:24.545447+0000","last_clean":"2024-05-09T02:18:24.545447+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:18:24.545447+0000","last_undegraded":"2024-05-09T02:18:24.545447+0000","last_fullsized":"2024-05-09T02:18:24.545447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200114+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:24.200114+0000","last_peered":"2024-05-09T02:18:24.200114+0000","last_clean":"2024-05-09T02:18:24.200114+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:24.200114+0000","last_undegraded":"2024-05-09T02:18:24.200114+0000","last_fullsized":"2024-05-09T02:18:24.200114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117121+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:25.117121+0000","last_peered":"2024-05-09T02:18:25.117121+0000","last_clean":"2024-05-09T02:18:25.117121+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:25.117121+0000","last_undegraded":"2024-05-09T02:18:25.117121+0000","last_fullsized":"2024-05-09T02:18:25.117121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200694+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:18:24.200694+0000","last_peered":"2024-05-09T02:18:24.200694+0000","last_clean":"2024-05-09T02:18:24.200694+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:18:24.200694+0000","last_undegraded":"2024-05-09T02:18:24.200694+0000","last_fullsized":"2024-05-09T02:18:24.200694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199079+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:18:24.199079+0000","last_peered":"2024-05-09T02:18:24.199079+0000","last_clean":"2024-05-09T02:18:24.199079+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:18:24.199079+0000","last_undegraded":"2024-05-09T02:18:24.199079+0000","last_fullsized":"2024-05-09T02:18:24.199079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194623+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:24.194623+0000","last_peered":"2024-05-09T02:18:24.194623+0000","last_clean":"2024-05-09T02:18:24.194623+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:24.194623+0000","last_undegraded":"2024-05-09T02:18:24.194623+0000","last_fullsized":"2024-05-09T02:18:24.194623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118230+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:25.118230+0000","last_peered":"2024-05-09T02:18:25.118230+0000","last_clean":"2024-05-09T02:18:25.118230+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:25.118230+0000","last_undegraded":"2024-05-09T02:18:25.118230+0000","last_fullsized":"2024-05-09T02:18:25.118230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199762+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:18:24.199762+0000","last_peered":"2024-05-09T02:18:24.199762+0000","last_clean":"2024-05-09T02:18:24.199762+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:18:24.199762+0000","last_undegraded":"2024-05-09T02:18:24.199762+0000","last_fullsized":"2024-05-09T02:18:24.199762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199671+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:18:24.199671+0000","last_peered":"2024-05-09T02:18:24.199671+0000","last_clean":"2024-05-09T02:18:24.199671+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:18:24.199671+0000","last_undegraded":"2024-05-09T02:18:24.199671+0000","last_fullsized":"2024-05-09T02:18:24.199671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200278+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:24.200278+0000","last_peered":"2024-05-09T02:18:24.200278+0000","last_clean":"2024-05-09T02:18:24.200278+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:24.200278+0000","last_undegraded":"2024-05-09T02:18:24.200278+0000","last_fullsized":"2024-05-09T02:18:24.200278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213294+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:24.213294+0000","last_peered":"2024-05-09T02:18:24.213294+0000","last_clean":"2024-05-09T02:18:24.213294+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:24.213294+0000","last_undegraded":"2024-05-09T02:18:24.213294+0000","last_fullsized":"2024-05-09T02:18:24.213294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199015+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:18:24.199015+0000","last_peered":"2024-05-09T02:18:24.199015+0000","last_clean":"2024-05-09T02:18:24.199015+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:18:24.199015+0000","last_undegraded":"2024-05-09T02:18:24.199015+0000","last_fullsized":"2024-05-09T02:18:24.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116593+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:18:25.116593+0000","last_peered":"2024-05-09T02:18:25.116593+0000","last_clean":"2024-05-09T02:18:25.116593+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:18:25.116593+0000","last_undegraded":"2024-05-09T02:18:25.116593+0000","last_fullsized":"2024-05-09T02:18:25.116593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213438+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:24.213438+0000","last_peered":"2024-05-09T02:18:24.213438+0000","last_clean":"2024-05-09T02:18:24.213438+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:24.213438+0000","last_undegraded":"2024-05-09T02:18:24.213438+0000","last_fullsized":"2024-05-09T02:18:24.213438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117923+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:25.117923+0000","last_peered":"2024-05-09T02:18:25.117923+0000","last_clean":"2024-05-09T02:18:25.117923+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:25.117923+0000","last_undegraded":"2024-05-09T02:18:25.117923+0000","last_fullsized":"2024-05-09T02:18:25.117923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194343+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:18:24.194343+0000","last_peered":"2024-05-09T02:18:24.194343+0000","last_clean":"2024-05-09T02:18:24.194343+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:18:24.194343+0000","last_undegraded":"2024-05-09T02:18:24.194343+0000","last_fullsized":"2024-05-09T02:18:24.194343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194795+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:18:24.194795+0000","last_peered":"2024-05-09T02:18:24.194795+0000","last_clean":"2024-05-09T02:18:24.194795+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:18:24.194795+0000","last_undegraded":"2024-05-09T02:18:24.194795+0000","last_fullsized":"2024-05-09T02:18:24.194795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545446+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:24.545446+0000","last_peered":"2024-05-09T02:18:24.545446+0000","last_clean":"2024-05-09T02:18:24.545446+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:24.545446+0000","last_undegraded":"2024-05-09T02:18:24.545446+0000","last_fullsized":"2024-05-09T02:18:24.545446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213541+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:24.213541+0000","last_peered":"2024-05-09T02:18:24.213541+0000","last_clean":"2024-05-09T02:18:24.213541+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:24.213541+0000","last_undegraded":"2024-05-09T02:18:24.213541+0000","last_fullsized":"2024-05-09T02:18:24.213541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212698+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:18:24.212698+0000","last_peered":"2024-05-09T02:18:24.212698+0000","last_clean":"2024-05-09T02:18:24.212698+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:18:24.212698+0000","last_undegraded":"2024-05-09T02:18:24.212698+0000","last_fullsized":"2024-05-09T02:18:24.212698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194413+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:18:24.194413+0000","last_peered":"2024-05-09T02:18:24.194413+0000","last_clean":"2024-05-09T02:18:24.194413+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:18:24.194413+0000","last_undegraded":"2024-05-09T02:18:24.194413+0000","last_fullsized":"2024-05-09T02:18:24.194413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200494+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:24.200494+0000","last_peered":"2024-05-09T02:18:24.200494+0000","last_clean":"2024-05-09T02:18:24.200494+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:24.200494+0000","last_undegraded":"2024-05-09T02:18:24.200494+0000","last_fullsized":"2024-05-09T02:18:24.200494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545086+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:24.545086+0000","last_peered":"2024-05-09T02:18:24.545086+0000","last_clean":"2024-05-09T02:18:24.545086+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:24.545086+0000","last_undegraded":"2024-05-09T02:18:24.545086+0000","last_fullsized":"2024-05-09T02:18:24.545086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213293+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:18:24.213293+0000","last_peered":"2024-05-09T02:18:24.213293+0000","last_clean":"2024-05-09T02:18:24.213293+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:18:24.213293+0000","last_undegraded":"2024-05-09T02:18:24.213293+0000","last_fullsized":"2024-05-09T02:18:24.213293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117109+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:18:25.117109+0000","last_peered":"2024-05-09T02:18:25.117109+0000","last_clean":"2024-05-09T02:18:25.117109+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:18:25.117109+0000","last_undegraded":"2024-05-09T02:18:25.117109+0000","last_fullsized":"2024-05-09T02:18:25.117109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212497+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:24.212497+0000","last_peered":"2024-05-09T02:18:24.212497+0000","last_clean":"2024-05-09T02:18:24.212497+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:24.212497+0000","last_undegraded":"2024-05-09T02:18:24.212497+0000","last_fullsized":"2024-05-09T02:18:24.212497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116723+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:25.116723+0000","last_peered":"2024-05-09T02:18:25.116723+0000","last_clean":"2024-05-09T02:18:25.116723+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:25.116723+0000","last_undegraded":"2024-05-09T02:18:25.116723+0000","last_fullsized":"2024-05-09T02:18:25.116723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213274+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:18:24.213274+0000","last_peered":"2024-05-09T02:18:24.213274+0000","last_clean":"2024-05-09T02:18:24.213274+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:18:24.213274+0000","last_undegraded":"2024-05-09T02:18:24.213274+0000","last_fullsized":"2024-05-09T02:18:24.213274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545598+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:18:24.545598+0000","last_peered":"2024-05-09T02:18:24.545598+0000","last_clean":"2024-05-09T02:18:24.545598+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:18:24.545598+0000","last_undegraded":"2024-05-09T02:18:24.545598+0000","last_fullsized":"2024-05-09T02:18:24.545598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193902+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:24.193902+0000","last_peered":"2024-05-09T02:18:24.193902+0000","last_clean":"2024-05-09T02:18:24.193902+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:24.193902+0000","last_undegraded":"2024-05-09T02:18:24.193902+0000","last_fullsized":"2024-05-09T02:18:24.193902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117239+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:25.117239+0000","last_peered":"2024-05-09T02:18:25.117239+0000","last_clean":"2024-05-09T02:18:25.117239+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:25.117239+0000","last_undegraded":"2024-05-09T02:18:25.117239+0000","last_fullsized":"2024-05-09T02:18:25.117239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194546+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:18:24.194546+0000","last_peered":"2024-05-09T02:18:24.194546+0000","last_clean":"2024-05-09T02:18:24.194546+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:18:24.194546+0000","last_undegraded":"2024-05-09T02:18:24.194546+0000","last_fullsized":"2024-05-09T02:18:24.194546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117439+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:18:25.117439+0000","last_peered":"2024-05-09T02:18:25.117439+0000","last_clean":"2024-05-09T02:18:25.117439+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:18:25.117439+0000","last_undegraded":"2024-05-09T02:18:25.117439+0000","last_fullsized":"2024-05-09T02:18:25.117439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199819+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:24.199819+0000","last_peered":"2024-05-09T02:18:24.199819+0000","last_clean":"2024-05-09T02:18:24.199819+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:24.199819+0000","last_undegraded":"2024-05-09T02:18:24.199819+0000","last_fullsized":"2024-05-09T02:18:24.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544691+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:24.544691+0000","last_peered":"2024-05-09T02:18:24.544691+0000","last_clean":"2024-05-09T02:18:24.544691+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:24.544691+0000","last_undegraded":"2024-05-09T02:18:24.544691+0000","last_fullsized":"2024-05-09T02:18:24.544691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117558+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:25.117558+0000","last_peered":"2024-05-09T02:18:25.117558+0000","last_clean":"2024-05-09T02:18:25.117558+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:25.117558+0000","last_undegraded":"2024-05-09T02:18:25.117558+0000","last_fullsized":"2024-05-09T02:18:25.117558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117570+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:25.117570+0000","last_peered":"2024-05-09T02:18:25.117570+0000","last_clean":"2024-05-09T02:18:25.117570+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:25.117570+0000","last_undegraded":"2024-05-09T02:18:25.117570+0000","last_fullsized":"2024-05-09T02:18:25.117570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117008+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:25.117008+0000","last_peered":"2024-05-09T02:18:25.117008+0000","last_clean":"2024-05-09T02:18:25.117008+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:25.117008+0000","last_undegraded":"2024-05-09T02:18:25.117008+0000","last_fullsized":"2024-05-09T02:18:25.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116656+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:18:25.116656+0000","last_peered":"2024-05-09T02:18:25.116656+0000","last_clean":"2024-05-09T02:18:25.116656+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:18:25.116656+0000","last_undegraded":"2024-05-09T02:18:25.116656+0000","last_fullsized":"2024-05-09T02:18:25.116656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545429+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:24.545429+0000","last_peered":"2024-05-09T02:18:24.545429+0000","last_clean":"2024-05-09T02:18:24.545429+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:24.545429+0000","last_undegraded":"2024-05-09T02:18:24.545429+0000","last_fullsized":"2024-05-09T02:18:24.545429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213599+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:24.213599+0000","last_peered":"2024-05-09T02:18:24.213599+0000","last_clean":"2024-05-09T02:18:24.213599+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:24.213599+0000","last_undegraded":"2024-05-09T02:18:24.213599+0000","last_fullsized":"2024-05-09T02:18:24.213599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194066+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:18:24.194066+0000","last_peered":"2024-05-09T02:18:24.194066+0000","last_clean":"2024-05-09T02:18:24.194066+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:18:24.194066+0000","last_undegraded":"2024-05-09T02:18:24.194066+0000","last_fullsized":"2024-05-09T02:18:24.194066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118369+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:25.118369+0000","last_peered":"2024-05-09T02:18:25.118369+0000","last_clean":"2024-05-09T02:18:25.118369+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:25.118369+0000","last_undegraded":"2024-05-09T02:18:25.118369+0000","last_fullsized":"2024-05-09T02:18:25.118369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117107+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:25.117107+0000","last_peered":"2024-05-09T02:18:25.117107+0000","last_clean":"2024-05-09T02:18:25.117107+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:25.117107+0000","last_undegraded":"2024-05-09T02:18:25.117107+0000","last_fullsized":"2024-05-09T02:18:25.117107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544340+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:18:24.544340+0000","last_peered":"2024-05-09T02:18:24.544340+0000","last_clean":"2024-05-09T02:18:24.544340+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:18:24.544340+0000","last_undegraded":"2024-05-09T02:18:24.544340+0000","last_fullsized":"2024-05-09T02:18:24.544340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116753+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:18:25.116753+0000","last_peered":"2024-05-09T02:18:25.116753+0000","last_clean":"2024-05-09T02:18:25.116753+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:18:25.116753+0000","last_undegraded":"2024-05-09T02:18:25.116753+0000","last_fullsized":"2024-05-09T02:18:25.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117832+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:25.117832+0000","last_peered":"2024-05-09T02:18:25.117832+0000","last_clean":"2024-05-09T02:18:25.117832+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:25.117832+0000","last_undegraded":"2024-05-09T02:18:25.117832+0000","last_fullsized":"2024-05-09T02:18:25.117832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201043+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:24.201043+0000","last_peered":"2024-05-09T02:18:24.201043+0000","last_clean":"2024-05-09T02:18:24.201043+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:24.201043+0000","last_undegraded":"2024-05-09T02:18:24.201043+0000","last_fullsized":"2024-05-09T02:18:24.201043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199591+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:18:24.199591+0000","last_peered":"2024-05-09T02:18:24.199591+0000","last_clean":"2024-05-09T02:18:24.199591+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:18:24.199591+0000","last_undegraded":"2024-05-09T02:18:24.199591+0000","last_fullsized":"2024-05-09T02:18:24.199591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200090+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:18:24.200090+0000","last_peered":"2024-05-09T02:18:24.200090+0000","last_clean":"2024-05-09T02:18:24.200090+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:18:24.200090+0000","last_undegraded":"2024-05-09T02:18:24.200090+0000","last_fullsized":"2024-05-09T02:18:24.200090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116454+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:25.116454+0000","last_peered":"2024-05-09T02:18:25.116454+0000","last_clean":"2024-05-09T02:18:25.116454+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:25.116454+0000","last_undegraded":"2024-05-09T02:18:25.116454+0000","last_fullsized":"2024-05-09T02:18:25.116454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194601+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:18:24.194601+0000","last_peered":"2024-05-09T02:18:24.194601+0000","last_clean":"2024-05-09T02:18:24.194601+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:18:24.194601+0000","last_undegraded":"2024-05-09T02:18:24.194601+0000","last_fullsized":"2024-05-09T02:18:24.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545288+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:18:24.545288+0000","last_peered":"2024-05-09T02:18:24.545288+0000","last_clean":"2024-05-09T02:18:24.545288+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:18:24.545288+0000","last_undegraded":"2024-05-09T02:18:24.545288+0000","last_fullsized":"2024-05-09T02:18:24.545288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116481+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:25.116481+0000","last_peered":"2024-05-09T02:18:25.116481+0000","last_clean":"2024-05-09T02:18:25.116481+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:25.116481+0000","last_undegraded":"2024-05-09T02:18:25.116481+0000","last_fullsized":"2024-05-09T02:18:25.116481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117146+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:25.117146+0000","last_peered":"2024-05-09T02:18:25.117146+0000","last_clean":"2024-05-09T02:18:25.117146+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:25.117146+0000","last_undegraded":"2024-05-09T02:18:25.117146+0000","last_fullsized":"2024-05-09T02:18:25.117146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200150+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:18:24.200150+0000","last_peered":"2024-05-09T02:18:24.200150+0000","last_clean":"2024-05-09T02:18:24.200150+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:18:24.200150+0000","last_undegraded":"2024-05-09T02:18:24.200150+0000","last_fullsized":"2024-05-09T02:18:24.200150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544937+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:18:24.544937+0000","last_peered":"2024-05-09T02:18:24.544937+0000","last_clean":"2024-05-09T02:18:24.544937+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:18:24.544937+0000","last_undegraded":"2024-05-09T02:18:24.544937+0000","last_fullsized":"2024-05-09T02:18:24.544937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117143+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:25.117143+0000","last_peered":"2024-05-09T02:18:25.117143+0000","last_clean":"2024-05-09T02:18:25.117143+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:25.117143+0000","last_undegraded":"2024-05-09T02:18:25.117143+0000","last_fullsized":"2024-05-09T02:18:25.117143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545038+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:24.545038+0000","last_peered":"2024-05-09T02:18:24.545038+0000","last_clean":"2024-05-09T02:18:24.545038+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:24.545038+0000","last_undegraded":"2024-05-09T02:18:24.545038+0000","last_fullsized":"2024-05-09T02:18:24.545038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199798+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:18:24.199798+0000","last_peered":"2024-05-09T02:18:24.199798+0000","last_clean":"2024-05-09T02:18:24.199798+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:18:24.199798+0000","last_undegraded":"2024-05-09T02:18:24.199798+0000","last_fullsized":"2024-05-09T02:18:24.199798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200009+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:18:24.200009+0000","last_peered":"2024-05-09T02:18:24.200009+0000","last_clean":"2024-05-09T02:18:24.200009+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:18:24.200009+0000","last_undegraded":"2024-05-09T02:18:24.200009+0000","last_fullsized":"2024-05-09T02:18:24.200009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194050+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:24.194050+0000","last_peered":"2024-05-09T02:18:24.194050+0000","last_clean":"2024-05-09T02:18:24.194050+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:24.194050+0000","last_undegraded":"2024-05-09T02:18:24.194050+0000","last_fullsized":"2024-05-09T02:18:24.194050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194934+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:24.194934+0000","last_peered":"2024-05-09T02:18:24.194934+0000","last_clean":"2024-05-09T02:18:24.194934+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:24.194934+0000","last_undegraded":"2024-05-09T02:18:24.194934+0000","last_fullsized":"2024-05-09T02:18:24.194934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545295+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:18:24.545295+0000","last_peered":"2024-05-09T02:18:24.545295+0000","last_clean":"2024-05-09T02:18:24.545295+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:18:24.545295+0000","last_undegraded":"2024-05-09T02:18:24.545295+0000","last_fullsized":"2024-05-09T02:18:24.545295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199929+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:18:24.199929+0000","last_peered":"2024-05-09T02:18:24.199929+0000","last_clean":"2024-05-09T02:18:24.199929+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:18:24.199929+0000","last_undegraded":"2024-05-09T02:18:24.199929+0000","last_fullsized":"2024-05-09T02:18:24.199929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117435+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:25.117435+0000","last_peered":"2024-05-09T02:18:25.117435+0000","last_clean":"2024-05-09T02:18:25.117435+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:25.117435+0000","last_undegraded":"2024-05-09T02:18:25.117435+0000","last_fullsized":"2024-05-09T02:18:25.117435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117643+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:25.117643+0000","last_peered":"2024-05-09T02:18:25.117643+0000","last_clean":"2024-05-09T02:18:25.117643+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:25.117643+0000","last_undegraded":"2024-05-09T02:18:25.117643+0000","last_fullsized":"2024-05-09T02:18:25.117643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212549+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:18:24.212549+0000","last_peered":"2024-05-09T02:18:24.212549+0000","last_clean":"2024-05-09T02:18:24.212549+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:18:24.212549+0000","last_undegraded":"2024-05-09T02:18:24.212549+0000","last_fullsized":"2024-05-09T02:18:24.212549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212872+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:18:24.212872+0000","last_peered":"2024-05-09T02:18:24.212872+0000","last_clean":"2024-05-09T02:18:24.212872+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:18:24.212872+0000","last_undegraded":"2024-05-09T02:18:24.212872+0000","last_fullsized":"2024-05-09T02:18:24.212872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201035+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:24.201035+0000","last_peered":"2024-05-09T02:18:24.201035+0000","last_clean":"2024-05-09T02:18:24.201035+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:24.201035+0000","last_undegraded":"2024-05-09T02:18:24.201035+0000","last_fullsized":"2024-05-09T02:18:24.201035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213593+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:24.213593+0000","last_peered":"2024-05-09T02:18:24.213593+0000","last_clean":"2024-05-09T02:18:24.213593+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:24.213593+0000","last_undegraded":"2024-05-09T02:18:24.213593+0000","last_fullsized":"2024-05-09T02:18:24.213593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200111+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:18:24.200111+0000","last_peered":"2024-05-09T02:18:24.200111+0000","last_clean":"2024-05-09T02:18:24.200111+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:18:24.200111+0000","last_undegraded":"2024-05-09T02:18:24.200111+0000","last_fullsized":"2024-05-09T02:18:24.200111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117015+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:18:25.117015+0000","last_peered":"2024-05-09T02:18:25.117015+0000","last_clean":"2024-05-09T02:18:25.117015+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:18:25.117015+0000","last_undegraded":"2024-05-09T02:18:25.117015+0000","last_fullsized":"2024-05-09T02:18:25.117015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194791+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:24.194791+0000","last_peered":"2024-05-09T02:18:24.194791+0000","last_clean":"2024-05-09T02:18:24.194791+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:24.194791+0000","last_undegraded":"2024-05-09T02:18:24.194791+0000","last_fullsized":"2024-05-09T02:18:24.194791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545365+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:24.545365+0000","last_peered":"2024-05-09T02:18:24.545365+0000","last_clean":"2024-05-09T02:18:24.545365+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:24.545365+0000","last_undegraded":"2024-05-09T02:18:24.545365+0000","last_fullsized":"2024-05-09T02:18:24.545365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199144+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:18:24.199144+0000","last_peered":"2024-05-09T02:18:24.199144+0000","last_clean":"2024-05-09T02:18:24.199144+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:18:24.199144+0000","last_undegraded":"2024-05-09T02:18:24.199144+0000","last_fullsized":"2024-05-09T02:18:24.199144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117861+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:18:25.117861+0000","last_peered":"2024-05-09T02:18:25.117861+0000","last_clean":"2024-05-09T02:18:25.117861+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:18:25.117861+0000","last_undegraded":"2024-05-09T02:18:25.117861+0000","last_fullsized":"2024-05-09T02:18:25.117861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545293+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:24.545293+0000","last_peered":"2024-05-09T02:18:24.545293+0000","last_clean":"2024-05-09T02:18:24.545293+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:24.545293+0000","last_undegraded":"2024-05-09T02:18:24.545293+0000","last_fullsized":"2024-05-09T02:18:24.545293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118231+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:25.118231+0000","last_peered":"2024-05-09T02:18:25.118231+0000","last_clean":"2024-05-09T02:18:25.118231+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:25.118231+0000","last_undegraded":"2024-05-09T02:18:25.118231+0000","last_fullsized":"2024-05-09T02:18:25.118231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199116+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:18:24.199116+0000","last_peered":"2024-05-09T02:18:24.199116+0000","last_clean":"2024-05-09T02:18:24.199116+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:18:24.199116+0000","last_undegraded":"2024-05-09T02:18:24.199116+0000","last_fullsized":"2024-05-09T02:18:24.199116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118154+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:18:25.118154+0000","last_peered":"2024-05-09T02:18:25.118154+0000","last_clean":"2024-05-09T02:18:25.118154+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:18:25.118154+0000","last_undegraded":"2024-05-09T02:18:25.118154+0000","last_fullsized":"2024-05-09T02:18:25.118154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194363+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:18:24.194363+0000","last_peered":"2024-05-09T02:18:24.194363+0000","last_clean":"2024-05-09T02:18:24.194363+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:18:24.194363+0000","last_undegraded":"2024-05-09T02:18:24.194363+0000","last_fullsized":"2024-05-09T02:18:24.194363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212490+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:24.212490+0000","last_peered":"2024-05-09T02:18:24.212490+0000","last_clean":"2024-05-09T02:18:24.212490+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:24.212490+0000","last_undegraded":"2024-05-09T02:18:24.212490+0000","last_fullsized":"2024-05-09T02:18:24.212490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194441+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:18:24.194441+0000","last_peered":"2024-05-09T02:18:24.194441+0000","last_clean":"2024-05-09T02:18:24.194441+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:18:24.194441+0000","last_undegraded":"2024-05-09T02:18:24.194441+0000","last_fullsized":"2024-05-09T02:18:24.194441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118101+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:18:25.118101+0000","last_peered":"2024-05-09T02:18:25.118101+0000","last_clean":"2024-05-09T02:18:25.118101+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:18:25.118101+0000","last_undegraded":"2024-05-09T02:18:25.118101+0000","last_fullsized":"2024-05-09T02:18:25.118101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199684+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:24.199684+0000","last_peered":"2024-05-09T02:18:24.199684+0000","last_clean":"2024-05-09T02:18:24.199684+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:24.199684+0000","last_undegraded":"2024-05-09T02:18:24.199684+0000","last_fullsized":"2024-05-09T02:18:24.199684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199561+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:24.199561+0000","last_peered":"2024-05-09T02:18:24.199561+0000","last_clean":"2024-05-09T02:18:24.199561+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:24.199561+0000","last_undegraded":"2024-05-09T02:18:24.199561+0000","last_fullsized":"2024-05-09T02:18:24.199561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213468+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:18:24.213468+0000","last_peered":"2024-05-09T02:18:24.213468+0000","last_clean":"2024-05-09T02:18:24.213468+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:18:24.213468+0000","last_undegraded":"2024-05-09T02:18:24.213468+0000","last_fullsized":"2024-05-09T02:18:24.213468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116796+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:25.116796+0000","last_peered":"2024-05-09T02:18:25.116796+0000","last_clean":"2024-05-09T02:18:25.116796+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:25.116796+0000","last_undegraded":"2024-05-09T02:18:25.116796+0000","last_fullsized":"2024-05-09T02:18:25.116796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194815+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:24.194815+0000","last_peered":"2024-05-09T02:18:24.194815+0000","last_clean":"2024-05-09T02:18:24.194815+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:24.194815+0000","last_undegraded":"2024-05-09T02:18:24.194815+0000","last_fullsized":"2024-05-09T02:18:24.194815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116805+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:18:25.116805+0000","last_peered":"2024-05-09T02:18:25.116805+0000","last_clean":"2024-05-09T02:18:25.116805+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:18:25.116805+0000","last_undegraded":"2024-05-09T02:18:25.116805+0000","last_fullsized":"2024-05-09T02:18:25.116805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200413+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:18:24.200413+0000","last_peered":"2024-05-09T02:18:24.200413+0000","last_clean":"2024-05-09T02:18:24.200413+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:18:24.200413+0000","last_undegraded":"2024-05-09T02:18:24.200413+0000","last_fullsized":"2024-05-09T02:18:24.200413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200002+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:24.200002+0000","last_peered":"2024-05-09T02:18:24.200002+0000","last_clean":"2024-05-09T02:18:24.200002+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:24.200002+0000","last_undegraded":"2024-05-09T02:18:24.200002+0000","last_fullsized":"2024-05-09T02:18:24.200002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200154+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:24.200154+0000","last_peered":"2024-05-09T02:18:24.200154+0000","last_clean":"2024-05-09T02:18:24.200154+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:24.200154+0000","last_undegraded":"2024-05-09T02:18:24.200154+0000","last_fullsized":"2024-05-09T02:18:24.200154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199852+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:18:24.199852+0000","last_peered":"2024-05-09T02:18:24.199852+0000","last_clean":"2024-05-09T02:18:24.199852+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:18:24.199852+0000","last_undegraded":"2024-05-09T02:18:24.199852+0000","last_fullsized":"2024-05-09T02:18:24.199852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200142+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:18:24.200142+0000","last_peered":"2024-05-09T02:18:24.200142+0000","last_clean":"2024-05-09T02:18:24.200142+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:18:24.200142+0000","last_undegraded":"2024-05-09T02:18:24.200142+0000","last_fullsized":"2024-05-09T02:18:24.200142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116363+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:25.116363+0000","last_peered":"2024-05-09T02:18:25.116363+0000","last_clean":"2024-05-09T02:18:25.116363+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:25.116363+0000","last_undegraded":"2024-05-09T02:18:25.116363+0000","last_fullsized":"2024-05-09T02:18:25.116363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213190+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:18:24.213190+0000","last_peered":"2024-05-09T02:18:24.213190+0000","last_clean":"2024-05-09T02:18:24.213190+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:18:24.213190+0000","last_undegraded":"2024-05-09T02:18:24.213190+0000","last_fullsized":"2024-05-09T02:18:24.213190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116452+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:25.116452+0000","last_peered":"2024-05-09T02:18:25.116452+0000","last_clean":"2024-05-09T02:18:25.116452+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:25.116452+0000","last_undegraded":"2024-05-09T02:18:25.116452+0000","last_fullsized":"2024-05-09T02:18:25.116452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544873+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:18:24.544873+0000","last_peered":"2024-05-09T02:18:24.544873+0000","last_clean":"2024-05-09T02:18:24.544873+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:18:24.544873+0000","last_undegraded":"2024-05-09T02:18:24.544873+0000","last_fullsized":"2024-05-09T02:18:24.544873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544891+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:24.544891+0000","last_peered":"2024-05-09T02:18:24.544891+0000","last_clean":"2024-05-09T02:18:24.544891+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:24.544891+0000","last_undegraded":"2024-05-09T02:18:24.544891+0000","last_fullsized":"2024-05-09T02:18:24.544891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213449+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:18:24.213449+0000","last_peered":"2024-05-09T02:18:24.213449+0000","last_clean":"2024-05-09T02:18:24.213449+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:18:24.213449+0000","last_undegraded":"2024-05-09T02:18:24.213449+0000","last_fullsized":"2024-05-09T02:18:24.213449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194691+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:24.194691+0000","last_peered":"2024-05-09T02:18:24.194691+0000","last_clean":"2024-05-09T02:18:24.194691+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:24.194691+0000","last_undegraded":"2024-05-09T02:18:24.194691+0000","last_fullsized":"2024-05-09T02:18:24.194691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116786+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:18:25.116786+0000","last_peered":"2024-05-09T02:18:25.116786+0000","last_clean":"2024-05-09T02:18:25.116786+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:18:25.116786+0000","last_undegraded":"2024-05-09T02:18:25.116786+0000","last_fullsized":"2024-05-09T02:18:25.116786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200069+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:24.200069+0000","last_peered":"2024-05-09T02:18:24.200069+0000","last_clean":"2024-05-09T02:18:24.200069+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:24.200069+0000","last_undegraded":"2024-05-09T02:18:24.200069+0000","last_fullsized":"2024-05-09T02:18:24.200069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199888+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:18:24.199888+0000","last_peered":"2024-05-09T02:18:24.199888+0000","last_clean":"2024-05-09T02:18:24.199888+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:18:24.199888+0000","last_undegraded":"2024-05-09T02:18:24.199888+0000","last_fullsized":"2024-05-09T02:18:24.199888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213517+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:24.213517+0000","last_peered":"2024-05-09T02:18:24.213517+0000","last_clean":"2024-05-09T02:18:24.213517+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:24.213517+0000","last_undegraded":"2024-05-09T02:18:24.213517+0000","last_fullsized":"2024-05-09T02:18:24.213517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116516+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:18:25.116516+0000","last_peered":"2024-05-09T02:18:25.116516+0000","last_clean":"2024-05-09T02:18:25.116516+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:18:25.116516+0000","last_undegraded":"2024-05-09T02:18:25.116516+0000","last_fullsized":"2024-05-09T02:18:25.116516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117856+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:25.117856+0000","last_peered":"2024-05-09T02:18:25.117856+0000","last_clean":"2024-05-09T02:18:25.117856+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:25.117856+0000","last_undegraded":"2024-05-09T02:18:25.117856+0000","last_fullsized":"2024-05-09T02:18:25.117856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116831+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:18:25.116831+0000","last_peered":"2024-05-09T02:18:25.116831+0000","last_clean":"2024-05-09T02:18:25.116831+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:18:25.116831+0000","last_undegraded":"2024-05-09T02:18:25.116831+0000","last_fullsized":"2024-05-09T02:18:25.116831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200256+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:24.200256+0000","last_peered":"2024-05-09T02:18:24.200256+0000","last_clean":"2024-05-09T02:18:24.200256+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:24.200256+0000","last_undegraded":"2024-05-09T02:18:24.200256+0000","last_fullsized":"2024-05-09T02:18:24.200256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200283+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:18:24.200283+0000","last_peered":"2024-05-09T02:18:24.200283+0000","last_clean":"2024-05-09T02:18:24.200283+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:18:24.200283+0000","last_undegraded":"2024-05-09T02:18:24.200283+0000","last_fullsized":"2024-05-09T02:18:24.200283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544524+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:24.544524+0000","last_peered":"2024-05-09T02:18:24.544524+0000","last_clean":"2024-05-09T02:18:24.544524+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:24.544524+0000","last_undegraded":"2024-05-09T02:18:24.544524+0000","last_fullsized":"2024-05-09T02:18:24.544524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118322+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:18:25.118322+0000","last_peered":"2024-05-09T02:18:25.118322+0000","last_clean":"2024-05-09T02:18:25.118322+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:18:25.118322+0000","last_undegraded":"2024-05-09T02:18:25.118322+0000","last_fullsized":"2024-05-09T02:18:25.118322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199333+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:24.199333+0000","last_peered":"2024-05-09T02:18:24.199333+0000","last_clean":"2024-05-09T02:18:24.199333+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:24.199333+0000","last_undegraded":"2024-05-09T02:18:24.199333+0000","last_fullsized":"2024-05-09T02:18:24.199333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116756+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:18:25.116756+0000","last_peered":"2024-05-09T02:18:25.116756+0000","last_clean":"2024-05-09T02:18:25.116756+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:18:25.116756+0000","last_undegraded":"2024-05-09T02:18:25.116756+0000","last_fullsized":"2024-05-09T02:18:25.116756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544741+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:24.544741+0000","last_peered":"2024-05-09T02:18:24.544741+0000","last_clean":"2024-05-09T02:18:24.544741+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:24.544741+0000","last_undegraded":"2024-05-09T02:18:24.544741+0000","last_fullsized":"2024-05-09T02:18:24.544741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199644+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:18:24.199644+0000","last_peered":"2024-05-09T02:18:24.199644+0000","last_clean":"2024-05-09T02:18:24.199644+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:18:24.199644+0000","last_undegraded":"2024-05-09T02:18:24.199644+0000","last_fullsized":"2024-05-09T02:18:24.199644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194548+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:24.194548+0000","last_peered":"2024-05-09T02:18:24.194548+0000","last_clean":"2024-05-09T02:18:24.194548+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:24.194548+0000","last_undegraded":"2024-05-09T02:18:24.194548+0000","last_fullsized":"2024-05-09T02:18:24.194548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200449+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:18:24.200449+0000","last_peered":"2024-05-09T02:18:24.200449+0000","last_clean":"2024-05-09T02:18:24.200449+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:18:24.200449+0000","last_undegraded":"2024-05-09T02:18:24.200449+0000","last_fullsized":"2024-05-09T02:18:24.200449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117511+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:25.117511+0000","last_peered":"2024-05-09T02:18:25.117511+0000","last_clean":"2024-05-09T02:18:25.117511+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:25.117511+0000","last_undegraded":"2024-05-09T02:18:25.117511+0000","last_fullsized":"2024-05-09T02:18:25.117511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199759+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:18:24.199759+0000","last_peered":"2024-05-09T02:18:24.199759+0000","last_clean":"2024-05-09T02:18:24.199759+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:18:24.199759+0000","last_undegraded":"2024-05-09T02:18:24.199759+0000","last_fullsized":"2024-05-09T02:18:24.199759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117792+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:25.117792+0000","last_peered":"2024-05-09T02:18:25.117792+0000","last_clean":"2024-05-09T02:18:25.117792+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:25.117792+0000","last_undegraded":"2024-05-09T02:18:25.117792+0000","last_fullsized":"2024-05-09T02:18:25.117792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544399+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:18:24.544399+0000","last_peered":"2024-05-09T02:18:24.544399+0000","last_clean":"2024-05-09T02:18:24.544399+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:18:24.544399+0000","last_undegraded":"2024-05-09T02:18:24.544399+0000","last_fullsized":"2024-05-09T02:18:24.544399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116838+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:25.116838+0000","last_peered":"2024-05-09T02:18:25.116838+0000","last_clean":"2024-05-09T02:18:25.116838+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:25.116838+0000","last_undegraded":"2024-05-09T02:18:25.116838+0000","last_fullsized":"2024-05-09T02:18:25.116838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193965+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:18:24.193965+0000","last_peered":"2024-05-09T02:18:24.193965+0000","last_clean":"2024-05-09T02:18:24.193965+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:18:24.193965+0000","last_undegraded":"2024-05-09T02:18:24.193965+0000","last_fullsized":"2024-05-09T02:18:24.193965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545650+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:24.545650+0000","last_peered":"2024-05-09T02:18:24.545650+0000","last_clean":"2024-05-09T02:18:24.545650+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:24.545650+0000","last_undegraded":"2024-05-09T02:18:24.545650+0000","last_fullsized":"2024-05-09T02:18:24.545650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213025+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:18:24.213025+0000","last_peered":"2024-05-09T02:18:24.213025+0000","last_clean":"2024-05-09T02:18:24.213025+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:18:24.213025+0000","last_undegraded":"2024-05-09T02:18:24.213025+0000","last_fullsized":"2024-05-09T02:18:24.213025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544509+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:24.544509+0000","last_peered":"2024-05-09T02:18:24.544509+0000","last_clean":"2024-05-09T02:18:24.544509+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:24.544509+0000","last_undegraded":"2024-05-09T02:18:24.544509+0000","last_fullsized":"2024-05-09T02:18:24.544509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200878+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:18:24.200878+0000","last_peered":"2024-05-09T02:18:24.200878+0000","last_clean":"2024-05-09T02:18:24.200878+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:18:24.200878+0000","last_undegraded":"2024-05-09T02:18:24.200878+0000","last_fullsized":"2024-05-09T02:18:24.200878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212585+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:24.212585+0000","last_peered":"2024-05-09T02:18:24.212585+0000","last_clean":"2024-05-09T02:18:24.212585+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:24.212585+0000","last_undegraded":"2024-05-09T02:18:24.212585+0000","last_fullsized":"2024-05-09T02:18:24.212585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544885+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:18:24.544885+0000","last_peered":"2024-05-09T02:18:24.544885+0000","last_clean":"2024-05-09T02:18:24.544885+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:18:24.544885+0000","last_undegraded":"2024-05-09T02:18:24.544885+0000","last_fullsized":"2024-05-09T02:18:24.544885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194082+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:24.194082+0000","last_peered":"2024-05-09T02:18:24.194082+0000","last_clean":"2024-05-09T02:18:24.194082+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:24.194082+0000","last_undegraded":"2024-05-09T02:18:24.194082+0000","last_fullsized":"2024-05-09T02:18:24.194082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118000+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:18:25.118000+0000","last_peered":"2024-05-09T02:18:25.118000+0000","last_clean":"2024-05-09T02:18:25.118000+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:18:25.118000+0000","last_undegraded":"2024-05-09T02:18:25.118000+0000","last_fullsized":"2024-05-09T02:18:25.118000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199427+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:24.199427+0000","last_peered":"2024-05-09T02:18:24.199427+0000","last_clean":"2024-05-09T02:18:24.199427+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:24.199427+0000","last_undegraded":"2024-05-09T02:18:24.199427+0000","last_fullsized":"2024-05-09T02:18:24.199427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199676+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:18:24.199676+0000","last_peered":"2024-05-09T02:18:24.199676+0000","last_clean":"2024-05-09T02:18:24.199676+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:18:24.199676+0000","last_undegraded":"2024-05-09T02:18:24.199676+0000","last_fullsized":"2024-05-09T02:18:24.199676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200953+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:24.200953+0000","last_peered":"2024-05-09T02:18:24.200953+0000","last_clean":"2024-05-09T02:18:24.200953+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:24.200953+0000","last_undegraded":"2024-05-09T02:18:24.200953+0000","last_fullsized":"2024-05-09T02:18:24.200953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116902+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:18:25.116902+0000","last_peered":"2024-05-09T02:18:25.116902+0000","last_clean":"2024-05-09T02:18:25.116902+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:18:25.116902+0000","last_undegraded":"2024-05-09T02:18:25.116902+0000","last_fullsized":"2024-05-09T02:18:25.116902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117232+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:25.117232+0000","last_peered":"2024-05-09T02:18:25.117232+0000","last_clean":"2024-05-09T02:18:25.117232+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:25.117232+0000","last_undegraded":"2024-05-09T02:18:25.117232+0000","last_fullsized":"2024-05-09T02:18:25.117232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117481+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:18:25.117481+0000","last_peered":"2024-05-09T02:18:25.117481+0000","last_clean":"2024-05-09T02:18:25.117481+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:18:25.117481+0000","last_undegraded":"2024-05-09T02:18:25.117481+0000","last_fullsized":"2024-05-09T02:18:25.117481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117736+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:25.117736+0000","last_peered":"2024-05-09T02:18:25.117736+0000","last_clean":"2024-05-09T02:18:25.117736+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:25.117736+0000","last_undegraded":"2024-05-09T02:18:25.117736+0000","last_fullsized":"2024-05-09T02:18:25.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544734+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:18:24.544734+0000","last_peered":"2024-05-09T02:18:24.544734+0000","last_clean":"2024-05-09T02:18:24.544734+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:18:24.544734+0000","last_undegraded":"2024-05-09T02:18:24.544734+0000","last_fullsized":"2024-05-09T02:18:24.544734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118260+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:25.118260+0000","last_peered":"2024-05-09T02:18:25.118260+0000","last_clean":"2024-05-09T02:18:25.118260+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:25.118260+0000","last_undegraded":"2024-05-09T02:18:25.118260+0000","last_fullsized":"2024-05-09T02:18:25.118260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199800+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:18:24.199800+0000","last_peered":"2024-05-09T02:18:24.199800+0000","last_clean":"2024-05-09T02:18:24.199800+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:18:24.199800+0000","last_undegraded":"2024-05-09T02:18:24.199800+0000","last_fullsized":"2024-05-09T02:18:24.199800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199349+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:24.199349+0000","last_peered":"2024-05-09T02:18:24.199349+0000","last_clean":"2024-05-09T02:18:24.199349+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:24.199349+0000","last_undegraded":"2024-05-09T02:18:24.199349+0000","last_fullsized":"2024-05-09T02:18:24.199349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118052+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:18:25.118052+0000","last_peered":"2024-05-09T02:18:25.118052+0000","last_clean":"2024-05-09T02:18:25.118052+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:18:25.118052+0000","last_undegraded":"2024-05-09T02:18:25.118052+0000","last_fullsized":"2024-05-09T02:18:25.118052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116863+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:25.116863+0000","last_peered":"2024-05-09T02:18:25.116863+0000","last_clean":"2024-05-09T02:18:25.116863+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:25.116863+0000","last_undegraded":"2024-05-09T02:18:25.116863+0000","last_fullsized":"2024-05-09T02:18:25.116863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213378+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:18:24.213378+0000","last_peered":"2024-05-09T02:18:24.213378+0000","last_clean":"2024-05-09T02:18:24.213378+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:18:24.213378+0000","last_undegraded":"2024-05-09T02:18:24.213378+0000","last_fullsized":"2024-05-09T02:18:24.213378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545227+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:18:24.545227+0000","last_peered":"2024-05-09T02:18:24.545227+0000","last_clean":"2024-05-09T02:18:24.545227+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:18:24.545227+0000","last_undegraded":"2024-05-09T02:18:24.545227+0000","last_fullsized":"2024-05-09T02:18:24.545227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199515+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:18:24.199515+0000","last_peered":"2024-05-09T02:18:24.199515+0000","last_clean":"2024-05-09T02:18:24.199515+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:18:24.199515+0000","last_undegraded":"2024-05-09T02:18:24.199515+0000","last_fullsized":"2024-05-09T02:18:24.199515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545003+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:24.545003+0000","last_peered":"2024-05-09T02:18:24.545003+0000","last_clean":"2024-05-09T02:18:24.545003+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:24.545003+0000","last_undegraded":"2024-05-09T02:18:24.545003+0000","last_fullsized":"2024-05-09T02:18:24.545003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116685+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:18:25.116685+0000","last_peered":"2024-05-09T02:18:25.116685+0000","last_clean":"2024-05-09T02:18:25.116685+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:18:25.116685+0000","last_undegraded":"2024-05-09T02:18:25.116685+0000","last_fullsized":"2024-05-09T02:18:25.116685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194258+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:24.194258+0000","last_peered":"2024-05-09T02:18:24.194258+0000","last_clean":"2024-05-09T02:18:24.194258+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:24.194258+0000","last_undegraded":"2024-05-09T02:18:24.194258+0000","last_fullsized":"2024-05-09T02:18:24.194258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116880+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:18:25.116880+0000","last_peered":"2024-05-09T02:18:25.116880+0000","last_clean":"2024-05-09T02:18:25.116880+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:18:25.116880+0000","last_undegraded":"2024-05-09T02:18:25.116880+0000","last_fullsized":"2024-05-09T02:18:25.116880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213092+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:24.213092+0000","last_peered":"2024-05-09T02:18:24.213092+0000","last_clean":"2024-05-09T02:18:24.213092+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:24.213092+0000","last_undegraded":"2024-05-09T02:18:24.213092+0000","last_fullsized":"2024-05-09T02:18:24.213092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116857+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:18:25.116857+0000","last_peered":"2024-05-09T02:18:25.116857+0000","last_clean":"2024-05-09T02:18:25.116857+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:18:25.116857+0000","last_undegraded":"2024-05-09T02:18:25.116857+0000","last_fullsized":"2024-05-09T02:18:25.116857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118184+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:25.118184+0000","last_peered":"2024-05-09T02:18:25.118184+0000","last_clean":"2024-05-09T02:18:25.118184+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:25.118184+0000","last_undegraded":"2024-05-09T02:18:25.118184+0000","last_fullsized":"2024-05-09T02:18:25.118184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:33.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.206+0000 7fb3a9842640 1 Processor -- start 2024-05-09T02:18:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.206+0000 7fb3a9842640 1 -- start start 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a9842640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb3a4068c50 0x7fb3a415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a9842640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a4157ee0 0x7fb3a41582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a9842640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40c52d0 con 0x7fb3a41519a0 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a9842640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a40c3bf0 con 0x7fb3a4068c50 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a9842640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a406f060 con 0x7fb3a4157ee0 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a27fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb3a41519a0 0x7fb3a4073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44286/0 (socket says 172.21.15.46:44286) 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a27fc640 1 -- 172.21.15.46:0/4126227152 learned_addr learned my addr 172.21.15.46:0/4126227152 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a37fe640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a4157ee0 0x7fb3a41582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/4126227152 >> v2:172.21.15.107:3300/0 conn(0x7fb3a4068c50 0x7fb3a415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a1ffb640 1 -- 172.21.15.46:0/4126227152 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315930303 0 0) 0x7fb3a40c52d0 con 0x7fb3a41519a0 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.207+0000 7fb3a1ffb640 1 -- 172.21.15.46:0/4126227152 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb390003520 con 0x7fb3a41519a0 2024-05-09T02:18:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a2ffd640 1 -- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a4157ee0 msgr2=0x7fb3a41582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a4157ee0 0x7fb3a41582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a2ffd640 1 -- 172.21.15.46:0/4126227152 >> v1:172.21.15.46:6789/0 conn(0x7fb3a41519a0 legacy=0x7fb3a4073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a1ffb640 1 -- 172.21.15.46:0/4126227152 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689100063 0 0) 0x7fb390003520 con 0x7fb3a41519a0 2024-05-09T02:18:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a2ffd640 1 -- 172.21.15.46:0/4126227152 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41579e0 con 0x7fb3a4068c50 2024-05-09T02:18:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a37fe640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a4157ee0 0x7fb3a41582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.208+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a415b9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009d90 tx=0x7fb39c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d009fe634294b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a1ffb640 1 -- 172.21.15.46:0/4126227152 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0016f0 con 0x7fb3a4068c50 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a1ffb640 1 -- 172.21.15.46:0/4126227152 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c007540 con 0x7fb3a4068c50 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a1ffb640 1 -- 172.21.15.46:0/4126227152 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0078f0 con 0x7fb3a4068c50 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a9842640 1 -- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 msgr2=0x7fb3a415b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a9842640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a415b9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009d90 tx=0x7fb39c02a5f0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a9842640 1 -- 172.21.15.46:0/4126227152 shutdown_connections 2024-05-09T02:18:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a9842640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a4157ee0 0x7fb3a41582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a9842640 1 --2- 172.21.15.46:0/4126227152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a415b9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.209+0000 7fb3a9842640 1 -- 172.21.15.46:0/4126227152 >> 172.21.15.46:0/4126227152 conn(0x7fb3a4073250 msgr2=0x7fb3a4073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.210+0000 7fb3a9842640 1 -- 172.21.15.46:0/4126227152 shutdown_connections 2024-05-09T02:18:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.210+0000 7fb3a9842640 1 -- 172.21.15.46:0/4126227152 wait complete. 2024-05-09T02:18:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.211+0000 7fb3a9842640 1 Processor -- start 2024-05-09T02:18:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.211+0000 7fb3a9842640 1 -- start start 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.212+0000 7fb3a9842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a4153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a41519a0 0x7fb3a4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 0x7fb3a4155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40c5b00 con 0x7fb3a4157ee0 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40c5820 con 0x7fb3a4068c50 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a4158830 con 0x7fb3a41519a0 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 0x7fb3a4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 0x7fb3a4155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36398/0 (socket says 172.21.15.46:36398) 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 -- 172.21.15.46:0/1271335585 learned_addr learned my addr 172.21.15.46:0/1271335585 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a27fc640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a41519a0 0x7fb3a4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a4153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 -- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a41519a0 msgr2=0x7fb3a4154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a41519a0 0x7fb3a4154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 -- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 msgr2=0x7fb3a4153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a4153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 -- 172.21.15.46:0/1271335585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a415b8b0 con 0x7fb3a4157ee0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a4153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a37fe640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 0x7fb3a4155300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb39400e850 tx=0x7fb39400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394017070 con 0x7fb3a4157ee0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39400c940 con 0x7fb3a4157ee0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a415bb90 con 0x7fb3a4157ee0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39400ccf0 con 0x7fb3a4157ee0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.213+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a415a8e0 con 0x7fb3a4157ee0 2024-05-09T02:18:33.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.214+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a4150a00 con 0x7fb3a4157ee0 2024-05-09T02:18:33.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.215+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb39401a070 con 0x7fb3a4157ee0 2024-05-09T02:18:33.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.216+0000 7fb39bfff640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb384076300 0x7fb384078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.216+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb394097650 con 0x7fb3a4157ee0 2024-05-09T02:18:33.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.216+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb384076300 0x7fb384078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.217+0000 7fb3a2ffd640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb384076300 0x7fb384078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb39c034000 tx=0x7fb39c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.220+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb3a4150a00 con 0x7fb3a4157ee0 2024-05-09T02:18:33.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.408+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3a415be20 con 0x7fb384076300 2024-05-09T02:18:33.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.421+0000 7fb39bfff640 1 -- 172.21.15.46:0/1271335585 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490296 (secure 0 0 0) 0x7fb39c007710 con 0x7fb384076300 2024-05-09T02:18:33.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb384076300 msgr2=0x7fb384078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb384076300 0x7fb384078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb39c034000 tx=0x7fb39c02f000 comp rx=0 tx=0).stop 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 msgr2=0x7fb3a4155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 0x7fb3a4155300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb39400e850 tx=0x7fb39400ed10 comp rx=0 tx=0).stop 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 shutdown_connections 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb384076300 0x7fb384078810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3a4157ee0 0x7fb3a4155300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a41519a0 0x7fb3a4154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 --2- 172.21.15.46:0/1271335585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a4068c50 0x7fb3a4153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.425+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 >> 172.21.15.46:0/1271335585 conn(0x7fb3a4073250 msgr2=0x7fb3a414a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.426+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 shutdown_connections 2024-05-09T02:18:33.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.426+0000 7fb3a9842640 1 -- 172.21.15.46:0/1271335585 wait complete. 2024-05-09T02:18:33.439 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-09T02:18:32.503259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2021832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.311115"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199693+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:18:24.199693+0000","last_peered":"2024-05-09T02:18:24.199693+0000","last_clean":"2024-05-09T02:18:24.199693+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:18:24.199693+0000","last_undegraded":"2024-05-09T02:18:24.199693+0000","last_fullsized":"2024-05-09T02:18:24.199693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194809+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:24.194809+0000","last_peered":"2024-05-09T02:18:24.194809+0000","last_clean":"2024-05-09T02:18:24.194809+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:24.194809+0000","last_undegraded":"2024-05-09T02:18:24.194809+0000","last_fullsized":"2024-05-09T02:18:24.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200366+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:24.200366+0000","last_peered":"2024-05-09T02:18:24.200366+0000","last_clean":"2024-05-09T02:18:24.200366+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:24.200366+0000","last_undegraded":"2024-05-09T02:18:24.200366+0000","last_fullsized":"2024-05-09T02:18:24.200366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199237+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:18:24.199237+0000","last_peered":"2024-05-09T02:18:24.199237+0000","last_clean":"2024-05-09T02:18:24.199237+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:18:24.199237+0000","last_undegraded":"2024-05-09T02:18:24.199237+0000","last_fullsized":"2024-05-09T02:18:24.199237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212516+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:18:24.212516+0000","last_peered":"2024-05-09T02:18:24.212516+0000","last_clean":"2024-05-09T02:18:24.212516+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:18:24.212516+0000","last_undegraded":"2024-05-09T02:18:24.212516+0000","last_fullsized":"2024-05-09T02:18:24.212516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200409+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:24.200409+0000","last_peered":"2024-05-09T02:18:24.200409+0000","last_clean":"2024-05-09T02:18:24.200409+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:24.200409+0000","last_undegraded":"2024-05-09T02:18:24.200409+0000","last_fullsized":"2024-05-09T02:18:24.200409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194737+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:24.194737+0000","last_peered":"2024-05-09T02:18:24.194737+0000","last_clean":"2024-05-09T02:18:24.194737+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:24.194737+0000","last_undegraded":"2024-05-09T02:18:24.194737+0000","last_fullsized":"2024-05-09T02:18:24.194737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199565+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:18:24.199565+0000","last_peered":"2024-05-09T02:18:24.199565+0000","last_clean":"2024-05-09T02:18:24.199565+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:18:24.199565+0000","last_undegraded":"2024-05-09T02:18:24.199565+0000","last_fullsized":"2024-05-09T02:18:24.199565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117680+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:25.117680+0000","last_peered":"2024-05-09T02:18:25.117680+0000","last_clean":"2024-05-09T02:18:25.117680+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:25.117680+0000","last_undegraded":"2024-05-09T02:18:25.117680+0000","last_fullsized":"2024-05-09T02:18:25.117680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545151+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:24.545151+0000","last_peered":"2024-05-09T02:18:24.545151+0000","last_clean":"2024-05-09T02:18:24.545151+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:24.545151+0000","last_undegraded":"2024-05-09T02:18:24.545151+0000","last_fullsized":"2024-05-09T02:18:24.545151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199967+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:18:24.199967+0000","last_peered":"2024-05-09T02:18:24.199967+0000","last_clean":"2024-05-09T02:18:24.199967+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:18:24.199967+0000","last_undegraded":"2024-05-09T02:18:24.199967+0000","last_fullsized":"2024-05-09T02:18:24.199967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544707+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:18:24.544707+0000","last_peered":"2024-05-09T02:18:24.544707+0000","last_clean":"2024-05-09T02:18:24.544707+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:18:24.544707+0000","last_undegraded":"2024-05-09T02:18:24.544707+0000","last_fullsized":"2024-05-09T02:18:24.544707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117346+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:25.117346+0000","last_peered":"2024-05-09T02:18:25.117346+0000","last_clean":"2024-05-09T02:18:25.117346+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:25.117346+0000","last_undegraded":"2024-05-09T02:18:25.117346+0000","last_fullsized":"2024-05-09T02:18:25.117346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545312+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:24.545312+0000","last_peered":"2024-05-09T02:18:24.545312+0000","last_clean":"2024-05-09T02:18:24.545312+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:24.545312+0000","last_undegraded":"2024-05-09T02:18:24.545312+0000","last_fullsized":"2024-05-09T02:18:24.545312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199878+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:18:24.199878+0000","last_peered":"2024-05-09T02:18:24.199878+0000","last_clean":"2024-05-09T02:18:24.199878+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:18:24.199878+0000","last_undegraded":"2024-05-09T02:18:24.199878+0000","last_fullsized":"2024-05-09T02:18:24.199878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213230+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:18:24.213230+0000","last_peered":"2024-05-09T02:18:24.213230+0000","last_clean":"2024-05-09T02:18:24.213230+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:18:24.213230+0000","last_undegraded":"2024-05-09T02:18:24.213230+0000","last_fullsized":"2024-05-09T02:18:24.213230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116725+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:25.116725+0000","last_peered":"2024-05-09T02:18:25.116725+0000","last_clean":"2024-05-09T02:18:25.116725+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:25.116725+0000","last_undegraded":"2024-05-09T02:18:25.116725+0000","last_fullsized":"2024-05-09T02:18:25.116725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117491+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:25.117491+0000","last_peered":"2024-05-09T02:18:25.117491+0000","last_clean":"2024-05-09T02:18:25.117491+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:25.117491+0000","last_undegraded":"2024-05-09T02:18:25.117491+0000","last_fullsized":"2024-05-09T02:18:25.117491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200557+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:18:24.200557+0000","last_peered":"2024-05-09T02:18:24.200557+0000","last_clean":"2024-05-09T02:18:24.200557+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:18:24.200557+0000","last_undegraded":"2024-05-09T02:18:24.200557+0000","last_fullsized":"2024-05-09T02:18:24.200557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117023+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:18:25.117023+0000","last_peered":"2024-05-09T02:18:25.117023+0000","last_clean":"2024-05-09T02:18:25.117023+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:18:25.117023+0000","last_undegraded":"2024-05-09T02:18:25.117023+0000","last_fullsized":"2024-05-09T02:18:25.117023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199802+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:24.199802+0000","last_peered":"2024-05-09T02:18:24.199802+0000","last_clean":"2024-05-09T02:18:24.199802+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:24.199802+0000","last_undegraded":"2024-05-09T02:18:24.199802+0000","last_fullsized":"2024-05-09T02:18:24.199802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212930+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:24.212930+0000","last_peered":"2024-05-09T02:18:24.212930+0000","last_clean":"2024-05-09T02:18:24.212930+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:24.212930+0000","last_undegraded":"2024-05-09T02:18:24.212930+0000","last_fullsized":"2024-05-09T02:18:24.212930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200551+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:18:24.200551+0000","last_peered":"2024-05-09T02:18:24.200551+0000","last_clean":"2024-05-09T02:18:24.200551+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:18:24.200551+0000","last_undegraded":"2024-05-09T02:18:24.200551+0000","last_fullsized":"2024-05-09T02:18:24.200551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200686+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:18:24.200686+0000","last_peered":"2024-05-09T02:18:24.200686+0000","last_clean":"2024-05-09T02:18:24.200686+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:18:24.200686+0000","last_undegraded":"2024-05-09T02:18:24.200686+0000","last_fullsized":"2024-05-09T02:18:24.200686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200229+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:24.200229+0000","last_peered":"2024-05-09T02:18:24.200229+0000","last_clean":"2024-05-09T02:18:24.200229+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:24.200229+0000","last_undegraded":"2024-05-09T02:18:24.200229+0000","last_fullsized":"2024-05-09T02:18:24.200229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212619+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:24.212619+0000","last_peered":"2024-05-09T02:18:24.212619+0000","last_clean":"2024-05-09T02:18:24.212619+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:24.212619+0000","last_undegraded":"2024-05-09T02:18:24.212619+0000","last_fullsized":"2024-05-09T02:18:24.212619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213272+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:18:24.213272+0000","last_peered":"2024-05-09T02:18:24.213272+0000","last_clean":"2024-05-09T02:18:24.213272+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:18:24.213272+0000","last_undegraded":"2024-05-09T02:18:24.213272+0000","last_fullsized":"2024-05-09T02:18:24.213272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545447+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:18:24.545447+0000","last_peered":"2024-05-09T02:18:24.545447+0000","last_clean":"2024-05-09T02:18:24.545447+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:18:24.545447+0000","last_undegraded":"2024-05-09T02:18:24.545447+0000","last_fullsized":"2024-05-09T02:18:24.545447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200114+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:24.200114+0000","last_peered":"2024-05-09T02:18:24.200114+0000","last_clean":"2024-05-09T02:18:24.200114+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:24.200114+0000","last_undegraded":"2024-05-09T02:18:24.200114+0000","last_fullsized":"2024-05-09T02:18:24.200114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117121+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:25.117121+0000","last_peered":"2024-05-09T02:18:25.117121+0000","last_clean":"2024-05-09T02:18:25.117121+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:25.117121+0000","last_undegraded":"2024-05-09T02:18:25.117121+0000","last_fullsized":"2024-05-09T02:18:25.117121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200694+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:18:24.200694+0000","last_peered":"2024-05-09T02:18:24.200694+0000","last_clean":"2024-05-09T02:18:24.200694+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:18:24.200694+0000","last_undegraded":"2024-05-09T02:18:24.200694+0000","last_fullsized":"2024-05-09T02:18:24.200694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199079+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:18:24.199079+0000","last_peered":"2024-05-09T02:18:24.199079+0000","last_clean":"2024-05-09T02:18:24.199079+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:18:24.199079+0000","last_undegraded":"2024-05-09T02:18:24.199079+0000","last_fullsized":"2024-05-09T02:18:24.199079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194623+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:24.194623+0000","last_peered":"2024-05-09T02:18:24.194623+0000","last_clean":"2024-05-09T02:18:24.194623+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:24.194623+0000","last_undegraded":"2024-05-09T02:18:24.194623+0000","last_fullsized":"2024-05-09T02:18:24.194623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118230+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:25.118230+0000","last_peered":"2024-05-09T02:18:25.118230+0000","last_clean":"2024-05-09T02:18:25.118230+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:25.118230+0000","last_undegraded":"2024-05-09T02:18:25.118230+0000","last_fullsized":"2024-05-09T02:18:25.118230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199762+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:18:24.199762+0000","last_peered":"2024-05-09T02:18:24.199762+0000","last_clean":"2024-05-09T02:18:24.199762+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:18:24.199762+0000","last_undegraded":"2024-05-09T02:18:24.199762+0000","last_fullsized":"2024-05-09T02:18:24.199762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199671+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:18:24.199671+0000","last_peered":"2024-05-09T02:18:24.199671+0000","last_clean":"2024-05-09T02:18:24.199671+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:18:24.199671+0000","last_undegraded":"2024-05-09T02:18:24.199671+0000","last_fullsized":"2024-05-09T02:18:24.199671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200278+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:24.200278+0000","last_peered":"2024-05-09T02:18:24.200278+0000","last_clean":"2024-05-09T02:18:24.200278+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:24.200278+0000","last_undegraded":"2024-05-09T02:18:24.200278+0000","last_fullsized":"2024-05-09T02:18:24.200278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213294+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:24.213294+0000","last_peered":"2024-05-09T02:18:24.213294+0000","last_clean":"2024-05-09T02:18:24.213294+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:24.213294+0000","last_undegraded":"2024-05-09T02:18:24.213294+0000","last_fullsized":"2024-05-09T02:18:24.213294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199015+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:18:24.199015+0000","last_peered":"2024-05-09T02:18:24.199015+0000","last_clean":"2024-05-09T02:18:24.199015+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:18:24.199015+0000","last_undegraded":"2024-05-09T02:18:24.199015+0000","last_fullsized":"2024-05-09T02:18:24.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116593+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:18:25.116593+0000","last_peered":"2024-05-09T02:18:25.116593+0000","last_clean":"2024-05-09T02:18:25.116593+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:18:25.116593+0000","last_undegraded":"2024-05-09T02:18:25.116593+0000","last_fullsized":"2024-05-09T02:18:25.116593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213438+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:24.213438+0000","last_peered":"2024-05-09T02:18:24.213438+0000","last_clean":"2024-05-09T02:18:24.213438+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:24.213438+0000","last_undegraded":"2024-05-09T02:18:24.213438+0000","last_fullsized":"2024-05-09T02:18:24.213438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117923+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:25.117923+0000","last_peered":"2024-05-09T02:18:25.117923+0000","last_clean":"2024-05-09T02:18:25.117923+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:25.117923+0000","last_undegraded":"2024-05-09T02:18:25.117923+0000","last_fullsized":"2024-05-09T02:18:25.117923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194343+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:18:24.194343+0000","last_peered":"2024-05-09T02:18:24.194343+0000","last_clean":"2024-05-09T02:18:24.194343+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:18:24.194343+0000","last_undegraded":"2024-05-09T02:18:24.194343+0000","last_fullsized":"2024-05-09T02:18:24.194343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194795+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:18:24.194795+0000","last_peered":"2024-05-09T02:18:24.194795+0000","last_clean":"2024-05-09T02:18:24.194795+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:18:24.194795+0000","last_undegraded":"2024-05-09T02:18:24.194795+0000","last_fullsized":"2024-05-09T02:18:24.194795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545446+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:24.545446+0000","last_peered":"2024-05-09T02:18:24.545446+0000","last_clean":"2024-05-09T02:18:24.545446+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:24.545446+0000","last_undegraded":"2024-05-09T02:18:24.545446+0000","last_fullsized":"2024-05-09T02:18:24.545446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213541+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:24.213541+0000","last_peered":"2024-05-09T02:18:24.213541+0000","last_clean":"2024-05-09T02:18:24.213541+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:24.213541+0000","last_undegraded":"2024-05-09T02:18:24.213541+0000","last_fullsized":"2024-05-09T02:18:24.213541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212698+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:18:24.212698+0000","last_peered":"2024-05-09T02:18:24.212698+0000","last_clean":"2024-05-09T02:18:24.212698+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:18:24.212698+0000","last_undegraded":"2024-05-09T02:18:24.212698+0000","last_fullsized":"2024-05-09T02:18:24.212698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194413+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:18:24.194413+0000","last_peered":"2024-05-09T02:18:24.194413+0000","last_clean":"2024-05-09T02:18:24.194413+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:18:24.194413+0000","last_undegraded":"2024-05-09T02:18:24.194413+0000","last_fullsized":"2024-05-09T02:18:24.194413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200494+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:24.200494+0000","last_peered":"2024-05-09T02:18:24.200494+0000","last_clean":"2024-05-09T02:18:24.200494+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:24.200494+0000","last_undegraded":"2024-05-09T02:18:24.200494+0000","last_fullsized":"2024-05-09T02:18:24.200494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545086+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:24.545086+0000","last_peered":"2024-05-09T02:18:24.545086+0000","last_clean":"2024-05-09T02:18:24.545086+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:24.545086+0000","last_undegraded":"2024-05-09T02:18:24.545086+0000","last_fullsized":"2024-05-09T02:18:24.545086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213293+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:18:24.213293+0000","last_peered":"2024-05-09T02:18:24.213293+0000","last_clean":"2024-05-09T02:18:24.213293+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:18:24.213293+0000","last_undegraded":"2024-05-09T02:18:24.213293+0000","last_fullsized":"2024-05-09T02:18:24.213293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117109+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:18:25.117109+0000","last_peered":"2024-05-09T02:18:25.117109+0000","last_clean":"2024-05-09T02:18:25.117109+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:18:25.117109+0000","last_undegraded":"2024-05-09T02:18:25.117109+0000","last_fullsized":"2024-05-09T02:18:25.117109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212497+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:24.212497+0000","last_peered":"2024-05-09T02:18:24.212497+0000","last_clean":"2024-05-09T02:18:24.212497+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:24.212497+0000","last_undegraded":"2024-05-09T02:18:24.212497+0000","last_fullsized":"2024-05-09T02:18:24.212497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116723+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:25.116723+0000","last_peered":"2024-05-09T02:18:25.116723+0000","last_clean":"2024-05-09T02:18:25.116723+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:25.116723+0000","last_undegraded":"2024-05-09T02:18:25.116723+0000","last_fullsized":"2024-05-09T02:18:25.116723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213274+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:18:24.213274+0000","last_peered":"2024-05-09T02:18:24.213274+0000","last_clean":"2024-05-09T02:18:24.213274+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:18:24.213274+0000","last_undegraded":"2024-05-09T02:18:24.213274+0000","last_fullsized":"2024-05-09T02:18:24.213274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545598+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:18:24.545598+0000","last_peered":"2024-05-09T02:18:24.545598+0000","last_clean":"2024-05-09T02:18:24.545598+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:18:24.545598+0000","last_undegraded":"2024-05-09T02:18:24.545598+0000","last_fullsized":"2024-05-09T02:18:24.545598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193902+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:24.193902+0000","last_peered":"2024-05-09T02:18:24.193902+0000","last_clean":"2024-05-09T02:18:24.193902+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:24.193902+0000","last_undegraded":"2024-05-09T02:18:24.193902+0000","last_fullsized":"2024-05-09T02:18:24.193902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117239+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:25.117239+0000","last_peered":"2024-05-09T02:18:25.117239+0000","last_clean":"2024-05-09T02:18:25.117239+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:25.117239+0000","last_undegraded":"2024-05-09T02:18:25.117239+0000","last_fullsized":"2024-05-09T02:18:25.117239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194546+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:18:24.194546+0000","last_peered":"2024-05-09T02:18:24.194546+0000","last_clean":"2024-05-09T02:18:24.194546+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:18:24.194546+0000","last_undegraded":"2024-05-09T02:18:24.194546+0000","last_fullsized":"2024-05-09T02:18:24.194546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117439+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:18:25.117439+0000","last_peered":"2024-05-09T02:18:25.117439+0000","last_clean":"2024-05-09T02:18:25.117439+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:18:25.117439+0000","last_undegraded":"2024-05-09T02:18:25.117439+0000","last_fullsized":"2024-05-09T02:18:25.117439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199819+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:24.199819+0000","last_peered":"2024-05-09T02:18:24.199819+0000","last_clean":"2024-05-09T02:18:24.199819+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:24.199819+0000","last_undegraded":"2024-05-09T02:18:24.199819+0000","last_fullsized":"2024-05-09T02:18:24.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544691+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:24.544691+0000","last_peered":"2024-05-09T02:18:24.544691+0000","last_clean":"2024-05-09T02:18:24.544691+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:24.544691+0000","last_undegraded":"2024-05-09T02:18:24.544691+0000","last_fullsized":"2024-05-09T02:18:24.544691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117558+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:25.117558+0000","last_peered":"2024-05-09T02:18:25.117558+0000","last_clean":"2024-05-09T02:18:25.117558+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:25.117558+0000","last_undegraded":"2024-05-09T02:18:25.117558+0000","last_fullsized":"2024-05-09T02:18:25.117558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117570+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:25.117570+0000","last_peered":"2024-05-09T02:18:25.117570+0000","last_clean":"2024-05-09T02:18:25.117570+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:25.117570+0000","last_undegraded":"2024-05-09T02:18:25.117570+0000","last_fullsized":"2024-05-09T02:18:25.117570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117008+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:25.117008+0000","last_peered":"2024-05-09T02:18:25.117008+0000","last_clean":"2024-05-09T02:18:25.117008+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:25.117008+0000","last_undegraded":"2024-05-09T02:18:25.117008+0000","last_fullsized":"2024-05-09T02:18:25.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116656+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:18:25.116656+0000","last_peered":"2024-05-09T02:18:25.116656+0000","last_clean":"2024-05-09T02:18:25.116656+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:18:25.116656+0000","last_undegraded":"2024-05-09T02:18:25.116656+0000","last_fullsized":"2024-05-09T02:18:25.116656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545429+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:24.545429+0000","last_peered":"2024-05-09T02:18:24.545429+0000","last_clean":"2024-05-09T02:18:24.545429+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:24.545429+0000","last_undegraded":"2024-05-09T02:18:24.545429+0000","last_fullsized":"2024-05-09T02:18:24.545429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213599+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:24.213599+0000","last_peered":"2024-05-09T02:18:24.213599+0000","last_clean":"2024-05-09T02:18:24.213599+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:24.213599+0000","last_undegraded":"2024-05-09T02:18:24.213599+0000","last_fullsized":"2024-05-09T02:18:24.213599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194066+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:18:24.194066+0000","last_peered":"2024-05-09T02:18:24.194066+0000","last_clean":"2024-05-09T02:18:24.194066+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:18:24.194066+0000","last_undegraded":"2024-05-09T02:18:24.194066+0000","last_fullsized":"2024-05-09T02:18:24.194066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118369+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:25.118369+0000","last_peered":"2024-05-09T02:18:25.118369+0000","last_clean":"2024-05-09T02:18:25.118369+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:25.118369+0000","last_undegraded":"2024-05-09T02:18:25.118369+0000","last_fullsized":"2024-05-09T02:18:25.118369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117107+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:25.117107+0000","last_peered":"2024-05-09T02:18:25.117107+0000","last_clean":"2024-05-09T02:18:25.117107+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:25.117107+0000","last_undegraded":"2024-05-09T02:18:25.117107+0000","last_fullsized":"2024-05-09T02:18:25.117107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544340+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:18:24.544340+0000","last_peered":"2024-05-09T02:18:24.544340+0000","last_clean":"2024-05-09T02:18:24.544340+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:18:24.544340+0000","last_undegraded":"2024-05-09T02:18:24.544340+0000","last_fullsized":"2024-05-09T02:18:24.544340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116753+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:18:25.116753+0000","last_peered":"2024-05-09T02:18:25.116753+0000","last_clean":"2024-05-09T02:18:25.116753+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:18:25.116753+0000","last_undegraded":"2024-05-09T02:18:25.116753+0000","last_fullsized":"2024-05-09T02:18:25.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117832+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:25.117832+0000","last_peered":"2024-05-09T02:18:25.117832+0000","last_clean":"2024-05-09T02:18:25.117832+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:25.117832+0000","last_undegraded":"2024-05-09T02:18:25.117832+0000","last_fullsized":"2024-05-09T02:18:25.117832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201043+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:24.201043+0000","last_peered":"2024-05-09T02:18:24.201043+0000","last_clean":"2024-05-09T02:18:24.201043+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:24.201043+0000","last_undegraded":"2024-05-09T02:18:24.201043+0000","last_fullsized":"2024-05-09T02:18:24.201043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199591+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:18:24.199591+0000","last_peered":"2024-05-09T02:18:24.199591+0000","last_clean":"2024-05-09T02:18:24.199591+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:18:24.199591+0000","last_undegraded":"2024-05-09T02:18:24.199591+0000","last_fullsized":"2024-05-09T02:18:24.199591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200090+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:18:24.200090+0000","last_peered":"2024-05-09T02:18:24.200090+0000","last_clean":"2024-05-09T02:18:24.200090+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:18:24.200090+0000","last_undegraded":"2024-05-09T02:18:24.200090+0000","last_fullsized":"2024-05-09T02:18:24.200090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116454+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:25.116454+0000","last_peered":"2024-05-09T02:18:25.116454+0000","last_clean":"2024-05-09T02:18:25.116454+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:25.116454+0000","last_undegraded":"2024-05-09T02:18:25.116454+0000","last_fullsized":"2024-05-09T02:18:25.116454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194601+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:18:24.194601+0000","last_peered":"2024-05-09T02:18:24.194601+0000","last_clean":"2024-05-09T02:18:24.194601+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:18:24.194601+0000","last_undegraded":"2024-05-09T02:18:24.194601+0000","last_fullsized":"2024-05-09T02:18:24.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545288+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:18:24.545288+0000","last_peered":"2024-05-09T02:18:24.545288+0000","last_clean":"2024-05-09T02:18:24.545288+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:18:24.545288+0000","last_undegraded":"2024-05-09T02:18:24.545288+0000","last_fullsized":"2024-05-09T02:18:24.545288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116481+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:25.116481+0000","last_peered":"2024-05-09T02:18:25.116481+0000","last_clean":"2024-05-09T02:18:25.116481+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:25.116481+0000","last_undegraded":"2024-05-09T02:18:25.116481+0000","last_fullsized":"2024-05-09T02:18:25.116481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117146+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:25.117146+0000","last_peered":"2024-05-09T02:18:25.117146+0000","last_clean":"2024-05-09T02:18:25.117146+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:25.117146+0000","last_undegraded":"2024-05-09T02:18:25.117146+0000","last_fullsized":"2024-05-09T02:18:25.117146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200150+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:18:24.200150+0000","last_peered":"2024-05-09T02:18:24.200150+0000","last_clean":"2024-05-09T02:18:24.200150+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:18:24.200150+0000","last_undegraded":"2024-05-09T02:18:24.200150+0000","last_fullsized":"2024-05-09T02:18:24.200150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544937+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:18:24.544937+0000","last_peered":"2024-05-09T02:18:24.544937+0000","last_clean":"2024-05-09T02:18:24.544937+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:18:24.544937+0000","last_undegraded":"2024-05-09T02:18:24.544937+0000","last_fullsized":"2024-05-09T02:18:24.544937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117143+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:25.117143+0000","last_peered":"2024-05-09T02:18:25.117143+0000","last_clean":"2024-05-09T02:18:25.117143+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:25.117143+0000","last_undegraded":"2024-05-09T02:18:25.117143+0000","last_fullsized":"2024-05-09T02:18:25.117143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545038+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:24.545038+0000","last_peered":"2024-05-09T02:18:24.545038+0000","last_clean":"2024-05-09T02:18:24.545038+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:24.545038+0000","last_undegraded":"2024-05-09T02:18:24.545038+0000","last_fullsized":"2024-05-09T02:18:24.545038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199798+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:18:24.199798+0000","last_peered":"2024-05-09T02:18:24.199798+0000","last_clean":"2024-05-09T02:18:24.199798+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:18:24.199798+0000","last_undegraded":"2024-05-09T02:18:24.199798+0000","last_fullsized":"2024-05-09T02:18:24.199798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200009+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:18:24.200009+0000","last_peered":"2024-05-09T02:18:24.200009+0000","last_clean":"2024-05-09T02:18:24.200009+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:18:24.200009+0000","last_undegraded":"2024-05-09T02:18:24.200009+0000","last_fullsized":"2024-05-09T02:18:24.200009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194050+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:24.194050+0000","last_peered":"2024-05-09T02:18:24.194050+0000","last_clean":"2024-05-09T02:18:24.194050+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:24.194050+0000","last_undegraded":"2024-05-09T02:18:24.194050+0000","last_fullsized":"2024-05-09T02:18:24.194050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194934+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:24.194934+0000","last_peered":"2024-05-09T02:18:24.194934+0000","last_clean":"2024-05-09T02:18:24.194934+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:24.194934+0000","last_undegraded":"2024-05-09T02:18:24.194934+0000","last_fullsized":"2024-05-09T02:18:24.194934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545295+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:18:24.545295+0000","last_peered":"2024-05-09T02:18:24.545295+0000","last_clean":"2024-05-09T02:18:24.545295+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:18:24.545295+0000","last_undegraded":"2024-05-09T02:18:24.545295+0000","last_fullsized":"2024-05-09T02:18:24.545295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199929+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:18:24.199929+0000","last_peered":"2024-05-09T02:18:24.199929+0000","last_clean":"2024-05-09T02:18:24.199929+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:18:24.199929+0000","last_undegraded":"2024-05-09T02:18:24.199929+0000","last_fullsized":"2024-05-09T02:18:24.199929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117435+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:25.117435+0000","last_peered":"2024-05-09T02:18:25.117435+0000","last_clean":"2024-05-09T02:18:25.117435+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:25.117435+0000","last_undegraded":"2024-05-09T02:18:25.117435+0000","last_fullsized":"2024-05-09T02:18:25.117435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117643+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:25.117643+0000","last_peered":"2024-05-09T02:18:25.117643+0000","last_clean":"2024-05-09T02:18:25.117643+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:25.117643+0000","last_undegraded":"2024-05-09T02:18:25.117643+0000","last_fullsized":"2024-05-09T02:18:25.117643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212549+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:18:24.212549+0000","last_peered":"2024-05-09T02:18:24.212549+0000","last_clean":"2024-05-09T02:18:24.212549+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:18:24.212549+0000","last_undegraded":"2024-05-09T02:18:24.212549+0000","last_fullsized":"2024-05-09T02:18:24.212549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212872+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:18:24.212872+0000","last_peered":"2024-05-09T02:18:24.212872+0000","last_clean":"2024-05-09T02:18:24.212872+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:18:24.212872+0000","last_undegraded":"2024-05-09T02:18:24.212872+0000","last_fullsized":"2024-05-09T02:18:24.212872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201035+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:24.201035+0000","last_peered":"2024-05-09T02:18:24.201035+0000","last_clean":"2024-05-09T02:18:24.201035+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:24.201035+0000","last_undegraded":"2024-05-09T02:18:24.201035+0000","last_fullsized":"2024-05-09T02:18:24.201035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213593+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:24.213593+0000","last_peered":"2024-05-09T02:18:24.213593+0000","last_clean":"2024-05-09T02:18:24.213593+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:24.213593+0000","last_undegraded":"2024-05-09T02:18:24.213593+0000","last_fullsized":"2024-05-09T02:18:24.213593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200111+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:18:24.200111+0000","last_peered":"2024-05-09T02:18:24.200111+0000","last_clean":"2024-05-09T02:18:24.200111+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:18:24.200111+0000","last_undegraded":"2024-05-09T02:18:24.200111+0000","last_fullsized":"2024-05-09T02:18:24.200111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117015+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:18:25.117015+0000","last_peered":"2024-05-09T02:18:25.117015+0000","last_clean":"2024-05-09T02:18:25.117015+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:18:25.117015+0000","last_undegraded":"2024-05-09T02:18:25.117015+0000","last_fullsized":"2024-05-09T02:18:25.117015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194791+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:24.194791+0000","last_peered":"2024-05-09T02:18:24.194791+0000","last_clean":"2024-05-09T02:18:24.194791+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:24.194791+0000","last_undegraded":"2024-05-09T02:18:24.194791+0000","last_fullsized":"2024-05-09T02:18:24.194791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545365+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:24.545365+0000","last_peered":"2024-05-09T02:18:24.545365+0000","last_clean":"2024-05-09T02:18:24.545365+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:24.545365+0000","last_undegraded":"2024-05-09T02:18:24.545365+0000","last_fullsized":"2024-05-09T02:18:24.545365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199144+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:18:24.199144+0000","last_peered":"2024-05-09T02:18:24.199144+0000","last_clean":"2024-05-09T02:18:24.199144+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:18:24.199144+0000","last_undegraded":"2024-05-09T02:18:24.199144+0000","last_fullsized":"2024-05-09T02:18:24.199144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117861+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:18:25.117861+0000","last_peered":"2024-05-09T02:18:25.117861+0000","last_clean":"2024-05-09T02:18:25.117861+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:18:25.117861+0000","last_undegraded":"2024-05-09T02:18:25.117861+0000","last_fullsized":"2024-05-09T02:18:25.117861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545293+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:24.545293+0000","last_peered":"2024-05-09T02:18:24.545293+0000","last_clean":"2024-05-09T02:18:24.545293+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:24.545293+0000","last_undegraded":"2024-05-09T02:18:24.545293+0000","last_fullsized":"2024-05-09T02:18:24.545293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118231+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:25.118231+0000","last_peered":"2024-05-09T02:18:25.118231+0000","last_clean":"2024-05-09T02:18:25.118231+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:25.118231+0000","last_undegraded":"2024-05-09T02:18:25.118231+0000","last_fullsized":"2024-05-09T02:18:25.118231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199116+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:18:24.199116+0000","last_peered":"2024-05-09T02:18:24.199116+0000","last_clean":"2024-05-09T02:18:24.199116+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:18:24.199116+0000","last_undegraded":"2024-05-09T02:18:24.199116+0000","last_fullsized":"2024-05-09T02:18:24.199116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118154+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:18:25.118154+0000","last_peered":"2024-05-09T02:18:25.118154+0000","last_clean":"2024-05-09T02:18:25.118154+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:18:25.118154+0000","last_undegraded":"2024-05-09T02:18:25.118154+0000","last_fullsized":"2024-05-09T02:18:25.118154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194363+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:18:24.194363+0000","last_peered":"2024-05-09T02:18:24.194363+0000","last_clean":"2024-05-09T02:18:24.194363+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:18:24.194363+0000","last_undegraded":"2024-05-09T02:18:24.194363+0000","last_fullsized":"2024-05-09T02:18:24.194363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212490+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:24.212490+0000","last_peered":"2024-05-09T02:18:24.212490+0000","last_clean":"2024-05-09T02:18:24.212490+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:24.212490+0000","last_undegraded":"2024-05-09T02:18:24.212490+0000","last_fullsized":"2024-05-09T02:18:24.212490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194441+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:18:24.194441+0000","last_peered":"2024-05-09T02:18:24.194441+0000","last_clean":"2024-05-09T02:18:24.194441+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:18:24.194441+0000","last_undegraded":"2024-05-09T02:18:24.194441+0000","last_fullsized":"2024-05-09T02:18:24.194441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118101+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:18:25.118101+0000","last_peered":"2024-05-09T02:18:25.118101+0000","last_clean":"2024-05-09T02:18:25.118101+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:18:25.118101+0000","last_undegraded":"2024-05-09T02:18:25.118101+0000","last_fullsized":"2024-05-09T02:18:25.118101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199684+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:24.199684+0000","last_peered":"2024-05-09T02:18:24.199684+0000","last_clean":"2024-05-09T02:18:24.199684+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:24.199684+0000","last_undegraded":"2024-05-09T02:18:24.199684+0000","last_fullsized":"2024-05-09T02:18:24.199684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199561+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:24.199561+0000","last_peered":"2024-05-09T02:18:24.199561+0000","last_clean":"2024-05-09T02:18:24.199561+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:24.199561+0000","last_undegraded":"2024-05-09T02:18:24.199561+0000","last_fullsized":"2024-05-09T02:18:24.199561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213468+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:18:24.213468+0000","last_peered":"2024-05-09T02:18:24.213468+0000","last_clean":"2024-05-09T02:18:24.213468+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:18:24.213468+0000","last_undegraded":"2024-05-09T02:18:24.213468+0000","last_fullsized":"2024-05-09T02:18:24.213468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116796+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:25.116796+0000","last_peered":"2024-05-09T02:18:25.116796+0000","last_clean":"2024-05-09T02:18:25.116796+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:25.116796+0000","last_undegraded":"2024-05-09T02:18:25.116796+0000","last_fullsized":"2024-05-09T02:18:25.116796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194815+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:24.194815+0000","last_peered":"2024-05-09T02:18:24.194815+0000","last_clean":"2024-05-09T02:18:24.194815+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:24.194815+0000","last_undegraded":"2024-05-09T02:18:24.194815+0000","last_fullsized":"2024-05-09T02:18:24.194815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116805+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:18:25.116805+0000","last_peered":"2024-05-09T02:18:25.116805+0000","last_clean":"2024-05-09T02:18:25.116805+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:18:25.116805+0000","last_undegraded":"2024-05-09T02:18:25.116805+0000","last_fullsized":"2024-05-09T02:18:25.116805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200413+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:18:24.200413+0000","last_peered":"2024-05-09T02:18:24.200413+0000","last_clean":"2024-05-09T02:18:24.200413+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:18:24.200413+0000","last_undegraded":"2024-05-09T02:18:24.200413+0000","last_fullsized":"2024-05-09T02:18:24.200413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200002+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:24.200002+0000","last_peered":"2024-05-09T02:18:24.200002+0000","last_clean":"2024-05-09T02:18:24.200002+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:24.200002+0000","last_undegraded":"2024-05-09T02:18:24.200002+0000","last_fullsized":"2024-05-09T02:18:24.200002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200154+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:24.200154+0000","last_peered":"2024-05-09T02:18:24.200154+0000","last_clean":"2024-05-09T02:18:24.200154+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:24.200154+0000","last_undegraded":"2024-05-09T02:18:24.200154+0000","last_fullsized":"2024-05-09T02:18:24.200154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199852+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:18:24.199852+0000","last_peered":"2024-05-09T02:18:24.199852+0000","last_clean":"2024-05-09T02:18:24.199852+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:18:24.199852+0000","last_undegraded":"2024-05-09T02:18:24.199852+0000","last_fullsized":"2024-05-09T02:18:24.199852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200142+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:18:24.200142+0000","last_peered":"2024-05-09T02:18:24.200142+0000","last_clean":"2024-05-09T02:18:24.200142+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:18:24.200142+0000","last_undegraded":"2024-05-09T02:18:24.200142+0000","last_fullsized":"2024-05-09T02:18:24.200142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116363+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:25.116363+0000","last_peered":"2024-05-09T02:18:25.116363+0000","last_clean":"2024-05-09T02:18:25.116363+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:25.116363+0000","last_undegraded":"2024-05-09T02:18:25.116363+0000","last_fullsized":"2024-05-09T02:18:25.116363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213190+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:18:24.213190+0000","last_peered":"2024-05-09T02:18:24.213190+0000","last_clean":"2024-05-09T02:18:24.213190+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:18:24.213190+0000","last_undegraded":"2024-05-09T02:18:24.213190+0000","last_fullsized":"2024-05-09T02:18:24.213190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116452+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:25.116452+0000","last_peered":"2024-05-09T02:18:25.116452+0000","last_clean":"2024-05-09T02:18:25.116452+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:25.116452+0000","last_undegraded":"2024-05-09T02:18:25.116452+0000","last_fullsized":"2024-05-09T02:18:25.116452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544873+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:18:24.544873+0000","last_peered":"2024-05-09T02:18:24.544873+0000","last_clean":"2024-05-09T02:18:24.544873+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:18:24.544873+0000","last_undegraded":"2024-05-09T02:18:24.544873+0000","last_fullsized":"2024-05-09T02:18:24.544873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544891+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:24.544891+0000","last_peered":"2024-05-09T02:18:24.544891+0000","last_clean":"2024-05-09T02:18:24.544891+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:24.544891+0000","last_undegraded":"2024-05-09T02:18:24.544891+0000","last_fullsized":"2024-05-09T02:18:24.544891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213449+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:18:24.213449+0000","last_peered":"2024-05-09T02:18:24.213449+0000","last_clean":"2024-05-09T02:18:24.213449+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:18:24.213449+0000","last_undegraded":"2024-05-09T02:18:24.213449+0000","last_fullsized":"2024-05-09T02:18:24.213449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194691+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:24.194691+0000","last_peered":"2024-05-09T02:18:24.194691+0000","last_clean":"2024-05-09T02:18:24.194691+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:24.194691+0000","last_undegraded":"2024-05-09T02:18:24.194691+0000","last_fullsized":"2024-05-09T02:18:24.194691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116786+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:18:25.116786+0000","last_peered":"2024-05-09T02:18:25.116786+0000","last_clean":"2024-05-09T02:18:25.116786+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:18:25.116786+0000","last_undegraded":"2024-05-09T02:18:25.116786+0000","last_fullsized":"2024-05-09T02:18:25.116786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200069+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:24.200069+0000","last_peered":"2024-05-09T02:18:24.200069+0000","last_clean":"2024-05-09T02:18:24.200069+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:24.200069+0000","last_undegraded":"2024-05-09T02:18:24.200069+0000","last_fullsized":"2024-05-09T02:18:24.200069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199888+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:18:24.199888+0000","last_peered":"2024-05-09T02:18:24.199888+0000","last_clean":"2024-05-09T02:18:24.199888+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:18:24.199888+0000","last_undegraded":"2024-05-09T02:18:24.199888+0000","last_fullsized":"2024-05-09T02:18:24.199888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213517+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:24.213517+0000","last_peered":"2024-05-09T02:18:24.213517+0000","last_clean":"2024-05-09T02:18:24.213517+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:24.213517+0000","last_undegraded":"2024-05-09T02:18:24.213517+0000","last_fullsized":"2024-05-09T02:18:24.213517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116516+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:18:25.116516+0000","last_peered":"2024-05-09T02:18:25.116516+0000","last_clean":"2024-05-09T02:18:25.116516+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:18:25.116516+0000","last_undegraded":"2024-05-09T02:18:25.116516+0000","last_fullsized":"2024-05-09T02:18:25.116516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117856+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:25.117856+0000","last_peered":"2024-05-09T02:18:25.117856+0000","last_clean":"2024-05-09T02:18:25.117856+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:25.117856+0000","last_undegraded":"2024-05-09T02:18:25.117856+0000","last_fullsized":"2024-05-09T02:18:25.117856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116831+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:18:25.116831+0000","last_peered":"2024-05-09T02:18:25.116831+0000","last_clean":"2024-05-09T02:18:25.116831+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:18:25.116831+0000","last_undegraded":"2024-05-09T02:18:25.116831+0000","last_fullsized":"2024-05-09T02:18:25.116831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200256+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:24.200256+0000","last_peered":"2024-05-09T02:18:24.200256+0000","last_clean":"2024-05-09T02:18:24.200256+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:24.200256+0000","last_undegraded":"2024-05-09T02:18:24.200256+0000","last_fullsized":"2024-05-09T02:18:24.200256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200283+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:18:24.200283+0000","last_peered":"2024-05-09T02:18:24.200283+0000","last_clean":"2024-05-09T02:18:24.200283+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:18:24.200283+0000","last_undegraded":"2024-05-09T02:18:24.200283+0000","last_fullsized":"2024-05-09T02:18:24.200283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544524+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:24.544524+0000","last_peered":"2024-05-09T02:18:24.544524+0000","last_clean":"2024-05-09T02:18:24.544524+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:24.544524+0000","last_undegraded":"2024-05-09T02:18:24.544524+0000","last_fullsized":"2024-05-09T02:18:24.544524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118322+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:18:25.118322+0000","last_peered":"2024-05-09T02:18:25.118322+0000","last_clean":"2024-05-09T02:18:25.118322+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:18:25.118322+0000","last_undegraded":"2024-05-09T02:18:25.118322+0000","last_fullsized":"2024-05-09T02:18:25.118322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199333+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:24.199333+0000","last_peered":"2024-05-09T02:18:24.199333+0000","last_clean":"2024-05-09T02:18:24.199333+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:24.199333+0000","last_undegraded":"2024-05-09T02:18:24.199333+0000","last_fullsized":"2024-05-09T02:18:24.199333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116756+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:18:25.116756+0000","last_peered":"2024-05-09T02:18:25.116756+0000","last_clean":"2024-05-09T02:18:25.116756+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:18:25.116756+0000","last_undegraded":"2024-05-09T02:18:25.116756+0000","last_fullsized":"2024-05-09T02:18:25.116756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544741+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:24.544741+0000","last_peered":"2024-05-09T02:18:24.544741+0000","last_clean":"2024-05-09T02:18:24.544741+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:24.544741+0000","last_undegraded":"2024-05-09T02:18:24.544741+0000","last_fullsized":"2024-05-09T02:18:24.544741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199644+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:18:24.199644+0000","last_peered":"2024-05-09T02:18:24.199644+0000","last_clean":"2024-05-09T02:18:24.199644+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:18:24.199644+0000","last_undegraded":"2024-05-09T02:18:24.199644+0000","last_fullsized":"2024-05-09T02:18:24.199644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194548+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:24.194548+0000","last_peered":"2024-05-09T02:18:24.194548+0000","last_clean":"2024-05-09T02:18:24.194548+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:24.194548+0000","last_undegraded":"2024-05-09T02:18:24.194548+0000","last_fullsized":"2024-05-09T02:18:24.194548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200449+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:18:24.200449+0000","last_peered":"2024-05-09T02:18:24.200449+0000","last_clean":"2024-05-09T02:18:24.200449+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:18:24.200449+0000","last_undegraded":"2024-05-09T02:18:24.200449+0000","last_fullsized":"2024-05-09T02:18:24.200449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117511+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:25.117511+0000","last_peered":"2024-05-09T02:18:25.117511+0000","last_clean":"2024-05-09T02:18:25.117511+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:25.117511+0000","last_undegraded":"2024-05-09T02:18:25.117511+0000","last_fullsized":"2024-05-09T02:18:25.117511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199759+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:18:24.199759+0000","last_peered":"2024-05-09T02:18:24.199759+0000","last_clean":"2024-05-09T02:18:24.199759+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:18:24.199759+0000","last_undegraded":"2024-05-09T02:18:24.199759+0000","last_fullsized":"2024-05-09T02:18:24.199759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117792+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:25.117792+0000","last_peered":"2024-05-09T02:18:25.117792+0000","last_clean":"2024-05-09T02:18:25.117792+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:25.117792+0000","last_undegraded":"2024-05-09T02:18:25.117792+0000","last_fullsized":"2024-05-09T02:18:25.117792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544399+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:18:24.544399+0000","last_peered":"2024-05-09T02:18:24.544399+0000","last_clean":"2024-05-09T02:18:24.544399+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:18:24.544399+0000","last_undegraded":"2024-05-09T02:18:24.544399+0000","last_fullsized":"2024-05-09T02:18:24.544399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116838+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:25.116838+0000","last_peered":"2024-05-09T02:18:25.116838+0000","last_clean":"2024-05-09T02:18:25.116838+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:25.116838+0000","last_undegraded":"2024-05-09T02:18:25.116838+0000","last_fullsized":"2024-05-09T02:18:25.116838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193965+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:18:24.193965+0000","last_peered":"2024-05-09T02:18:24.193965+0000","last_clean":"2024-05-09T02:18:24.193965+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:18:24.193965+0000","last_undegraded":"2024-05-09T02:18:24.193965+0000","last_fullsized":"2024-05-09T02:18:24.193965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545650+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:24.545650+0000","last_peered":"2024-05-09T02:18:24.545650+0000","last_clean":"2024-05-09T02:18:24.545650+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:24.545650+0000","last_undegraded":"2024-05-09T02:18:24.545650+0000","last_fullsized":"2024-05-09T02:18:24.545650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213025+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:18:24.213025+0000","last_peered":"2024-05-09T02:18:24.213025+0000","last_clean":"2024-05-09T02:18:24.213025+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:18:24.213025+0000","last_undegraded":"2024-05-09T02:18:24.213025+0000","last_fullsized":"2024-05-09T02:18:24.213025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544509+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:24.544509+0000","last_peered":"2024-05-09T02:18:24.544509+0000","last_clean":"2024-05-09T02:18:24.544509+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:24.544509+0000","last_undegraded":"2024-05-09T02:18:24.544509+0000","last_fullsized":"2024-05-09T02:18:24.544509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200878+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:18:24.200878+0000","last_peered":"2024-05-09T02:18:24.200878+0000","last_clean":"2024-05-09T02:18:24.200878+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:18:24.200878+0000","last_undegraded":"2024-05-09T02:18:24.200878+0000","last_fullsized":"2024-05-09T02:18:24.200878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212585+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:24.212585+0000","last_peered":"2024-05-09T02:18:24.212585+0000","last_clean":"2024-05-09T02:18:24.212585+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:24.212585+0000","last_undegraded":"2024-05-09T02:18:24.212585+0000","last_fullsized":"2024-05-09T02:18:24.212585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544885+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:18:24.544885+0000","last_peered":"2024-05-09T02:18:24.544885+0000","last_clean":"2024-05-09T02:18:24.544885+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:18:24.544885+0000","last_undegraded":"2024-05-09T02:18:24.544885+0000","last_fullsized":"2024-05-09T02:18:24.544885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194082+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:24.194082+0000","last_peered":"2024-05-09T02:18:24.194082+0000","last_clean":"2024-05-09T02:18:24.194082+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:24.194082+0000","last_undegraded":"2024-05-09T02:18:24.194082+0000","last_fullsized":"2024-05-09T02:18:24.194082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118000+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:18:25.118000+0000","last_peered":"2024-05-09T02:18:25.118000+0000","last_clean":"2024-05-09T02:18:25.118000+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:18:25.118000+0000","last_undegraded":"2024-05-09T02:18:25.118000+0000","last_fullsized":"2024-05-09T02:18:25.118000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199427+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:24.199427+0000","last_peered":"2024-05-09T02:18:24.199427+0000","last_clean":"2024-05-09T02:18:24.199427+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:24.199427+0000","last_undegraded":"2024-05-09T02:18:24.199427+0000","last_fullsized":"2024-05-09T02:18:24.199427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199676+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:18:24.199676+0000","last_peered":"2024-05-09T02:18:24.199676+0000","last_clean":"2024-05-09T02:18:24.199676+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:18:24.199676+0000","last_undegraded":"2024-05-09T02:18:24.199676+0000","last_fullsized":"2024-05-09T02:18:24.199676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200953+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:24.200953+0000","last_peered":"2024-05-09T02:18:24.200953+0000","last_clean":"2024-05-09T02:18:24.200953+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:24.200953+0000","last_undegraded":"2024-05-09T02:18:24.200953+0000","last_fullsized":"2024-05-09T02:18:24.200953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116902+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:18:25.116902+0000","last_peered":"2024-05-09T02:18:25.116902+0000","last_clean":"2024-05-09T02:18:25.116902+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:18:25.116902+0000","last_undegraded":"2024-05-09T02:18:25.116902+0000","last_fullsized":"2024-05-09T02:18:25.116902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117232+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:25.117232+0000","last_peered":"2024-05-09T02:18:25.117232+0000","last_clean":"2024-05-09T02:18:25.117232+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:25.117232+0000","last_undegraded":"2024-05-09T02:18:25.117232+0000","last_fullsized":"2024-05-09T02:18:25.117232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117481+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:18:25.117481+0000","last_peered":"2024-05-09T02:18:25.117481+0000","last_clean":"2024-05-09T02:18:25.117481+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:18:25.117481+0000","last_undegraded":"2024-05-09T02:18:25.117481+0000","last_fullsized":"2024-05-09T02:18:25.117481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117736+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:25.117736+0000","last_peered":"2024-05-09T02:18:25.117736+0000","last_clean":"2024-05-09T02:18:25.117736+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:25.117736+0000","last_undegraded":"2024-05-09T02:18:25.117736+0000","last_fullsized":"2024-05-09T02:18:25.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544734+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:18:24.544734+0000","last_peered":"2024-05-09T02:18:24.544734+0000","last_clean":"2024-05-09T02:18:24.544734+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:18:24.544734+0000","last_undegraded":"2024-05-09T02:18:24.544734+0000","last_fullsized":"2024-05-09T02:18:24.544734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118260+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:25.118260+0000","last_peered":"2024-05-09T02:18:25.118260+0000","last_clean":"2024-05-09T02:18:25.118260+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:25.118260+0000","last_undegraded":"2024-05-09T02:18:25.118260+0000","last_fullsized":"2024-05-09T02:18:25.118260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199800+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:18:24.199800+0000","last_peered":"2024-05-09T02:18:24.199800+0000","last_clean":"2024-05-09T02:18:24.199800+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:18:24.199800+0000","last_undegraded":"2024-05-09T02:18:24.199800+0000","last_fullsized":"2024-05-09T02:18:24.199800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199349+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:24.199349+0000","last_peered":"2024-05-09T02:18:24.199349+0000","last_clean":"2024-05-09T02:18:24.199349+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:24.199349+0000","last_undegraded":"2024-05-09T02:18:24.199349+0000","last_fullsized":"2024-05-09T02:18:24.199349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118052+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:18:25.118052+0000","last_peered":"2024-05-09T02:18:25.118052+0000","last_clean":"2024-05-09T02:18:25.118052+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:18:25.118052+0000","last_undegraded":"2024-05-09T02:18:25.118052+0000","last_fullsized":"2024-05-09T02:18:25.118052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116863+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:25.116863+0000","last_peered":"2024-05-09T02:18:25.116863+0000","last_clean":"2024-05-09T02:18:25.116863+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:25.116863+0000","last_undegraded":"2024-05-09T02:18:25.116863+0000","last_fullsized":"2024-05-09T02:18:25.116863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213378+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:18:24.213378+0000","last_peered":"2024-05-09T02:18:24.213378+0000","last_clean":"2024-05-09T02:18:24.213378+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:18:24.213378+0000","last_undegraded":"2024-05-09T02:18:24.213378+0000","last_fullsized":"2024-05-09T02:18:24.213378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545227+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:18:24.545227+0000","last_peered":"2024-05-09T02:18:24.545227+0000","last_clean":"2024-05-09T02:18:24.545227+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:18:24.545227+0000","last_undegraded":"2024-05-09T02:18:24.545227+0000","last_fullsized":"2024-05-09T02:18:24.545227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199515+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:18:24.199515+0000","last_peered":"2024-05-09T02:18:24.199515+0000","last_clean":"2024-05-09T02:18:24.199515+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:18:24.199515+0000","last_undegraded":"2024-05-09T02:18:24.199515+0000","last_fullsized":"2024-05-09T02:18:24.199515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545003+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:24.545003+0000","last_peered":"2024-05-09T02:18:24.545003+0000","last_clean":"2024-05-09T02:18:24.545003+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:24.545003+0000","last_undegraded":"2024-05-09T02:18:24.545003+0000","last_fullsized":"2024-05-09T02:18:24.545003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116685+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:18:25.116685+0000","last_peered":"2024-05-09T02:18:25.116685+0000","last_clean":"2024-05-09T02:18:25.116685+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:18:25.116685+0000","last_undegraded":"2024-05-09T02:18:25.116685+0000","last_fullsized":"2024-05-09T02:18:25.116685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194258+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:24.194258+0000","last_peered":"2024-05-09T02:18:24.194258+0000","last_clean":"2024-05-09T02:18:24.194258+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:24.194258+0000","last_undegraded":"2024-05-09T02:18:24.194258+0000","last_fullsized":"2024-05-09T02:18:24.194258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116880+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:18:25.116880+0000","last_peered":"2024-05-09T02:18:25.116880+0000","last_clean":"2024-05-09T02:18:25.116880+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:18:25.116880+0000","last_undegraded":"2024-05-09T02:18:25.116880+0000","last_fullsized":"2024-05-09T02:18:25.116880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213092+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:24.213092+0000","last_peered":"2024-05-09T02:18:24.213092+0000","last_clean":"2024-05-09T02:18:24.213092+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:24.213092+0000","last_undegraded":"2024-05-09T02:18:24.213092+0000","last_fullsized":"2024-05-09T02:18:24.213092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116857+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:18:25.116857+0000","last_peered":"2024-05-09T02:18:25.116857+0000","last_clean":"2024-05-09T02:18:25.116857+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:18:25.116857+0000","last_undegraded":"2024-05-09T02:18:25.116857+0000","last_fullsized":"2024-05-09T02:18:25.116857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118184+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:25.118184+0000","last_peered":"2024-05-09T02:18:25.118184+0000","last_clean":"2024-05-09T02:18:25.118184+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:25.118184+0000","last_undegraded":"2024-05-09T02:18:25.118184+0000","last_fullsized":"2024-05-09T02:18:25.118184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:33.446 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T02:18:33.446 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T02:18:33.446 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T02:18:33.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T02:18:33.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.590+0000 7f2d7651c640 1 Processor -- start 2024-05-09T02:18:33.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.590+0000 7f2d7651c640 1 -- start start 2024-05-09T02:18:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d7651c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d700722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d7651c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d700c4e80 0x7f2d70072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d7651c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d700c83b0 con 0x7f2d70152ea0 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d7651c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f2d70159d00 con 0x7f2d700c4e80 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d7651c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2d70156c30 con 0x7f2d70070b30 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d6f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d700c4e80 0x7f2d70072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d6f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d700c4e80 0x7f2d70072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36404/0 (socket says 172.21.15.46:36404) 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d6f7fe640 1 -- 172.21.15.46:0/2554314709 learned_addr learned my addr 172.21.15.46:0/2554314709 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.591+0000 7f2d6ffff640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d700722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6f7fe640 1 -- 172.21.15.46:0/2554314709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 msgr2=0x7f2d700722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6f7fe640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d700722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6f7fe640 1 -- 172.21.15.46:0/2554314709 >> v1:172.21.15.107:6789/0 conn(0x7f2d70152ea0 legacy=0x7f2d70155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6f7fe640 1 -- 172.21.15.46:0/2554314709 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d70155740 con 0x7f2d700c4e80 2024-05-09T02:18:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6ffff640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d700722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:33.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6f7fe640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d700c4e80 0x7f2d70072800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d640098a0 tx=0x7f2d6402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c91081ef930ca4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6effd640 1 -- 172.21.15.46:0/2554314709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64037070 con 0x7f2d700c4e80 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6effd640 1 -- 172.21.15.46:0/2554314709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64032440 con 0x7f2d700c4e80 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.592+0000 7f2d6effd640 1 -- 172.21.15.46:0/2554314709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64032810 con 0x7f2d700c4e80 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 -- 172.21.15.46:0/2554314709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d700c4e80 msgr2=0x7f2d70072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d700c4e80 0x7f2d70072800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d640098a0 tx=0x7f2d6402a200 comp rx=0 tx=0).stop 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 -- 172.21.15.46:0/2554314709 shutdown_connections 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d700c4e80 0x7f2d70072800 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 --2- 172.21.15.46:0/2554314709 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d700722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 -- 172.21.15.46:0/2554314709 >> 172.21.15.46:0/2554314709 conn(0x7f2d70069040 msgr2=0x7f2d700ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 -- 172.21.15.46:0/2554314709 shutdown_connections 2024-05-09T02:18:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.593+0000 7f2d7651c640 1 -- 172.21.15.46:0/2554314709 wait complete. 2024-05-09T02:18:33.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.595+0000 7f2d7651c640 1 Processor -- start 2024-05-09T02:18:33.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.595+0000 7f2d7651c640 1 -- start start 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d7651c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d701deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d7651c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d700c4e80 0x7f2d700aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d7651c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 0x7f2d7014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d7651c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70159a20 con 0x7f2d70152ea0 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d7651c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2d700ca600 con 0x7f2d700c4e80 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d7651c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2d700ca8a0 con 0x7f2d70070b30 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d6ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d701deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 0x7f2d7014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d6f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d700c4e80 0x7f2d700aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d6ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d701deda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42660/0 (socket says 172.21.15.46:42660) 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 0x7f2d7014df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36420/0 (socket says 172.21.15.46:36420) 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d6ffff640 1 -- 172.21.15.46:0/365602432 learned_addr learned my addr 172.21.15.46:0/365602432 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 -- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 msgr2=0x7f2d701deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d701deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 -- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d700c4e80 msgr2=0x7f2d700aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d700c4e80 0x7f2d700aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 -- 172.21.15.46:0/365602432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d701ef6c0 con 0x7f2d70152ea0 2024-05-09T02:18:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.597+0000 7f2d74ab9640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 0x7f2d7014df90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c700 tx=0x7f2d6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.599+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68003b70 con 0x7f2d70152ea0 2024-05-09T02:18:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.599+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68003d10 con 0x7f2d70152ea0 2024-05-09T02:18:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.599+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d701eb650 con 0x7f2d70152ea0 2024-05-09T02:18:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.599+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680052f0 con 0x7f2d70152ea0 2024-05-09T02:18:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.599+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701ebc10 con 0x7f2d70152ea0 2024-05-09T02:18:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.600+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d701eb460 con 0x7f2d70152ea0 2024-05-09T02:18:33.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.601+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d68005490 con 0x7f2d70152ea0 2024-05-09T02:18:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.601+0000 7f2d6cff9640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2d5c076300 0x7f2d5c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.602+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2d680975d0 con 0x7f2d70152ea0 2024-05-09T02:18:33.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.602+0000 7f2d6ffff640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2d5c076300 0x7f2d5c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.602+0000 7f2d6ffff640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2d5c076300 0x7f2d5c078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d60006a90 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.606+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d68060520 con 0x7f2d70152ea0 2024-05-09T02:18:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.842+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2d7006a330 con 0x7f2d70152ea0 2024-05-09T02:18:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.842+0000 7f2d6cff9640 1 -- 172.21.15.46:0/365602432 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2d68064820 con 0x7f2d70152ea0 2024-05-09T02:18:33.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:33.845 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2d5c076300 msgr2=0x7f2d5c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2d5c076300 0x7f2d5c078810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d60006a90 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 msgr2=0x7f2d7014df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 0x7f2d7014df90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c700 tx=0x7f2d6800cbc0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 shutdown_connections 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2d5c076300 0x7f2d5c078810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d70152ea0 0x7f2d7014df90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d700c4e80 0x7f2d700aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 --2- 172.21.15.46:0/365602432 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d70070b30 0x7f2d701deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 >> 172.21.15.46:0/365602432 conn(0x7f2d70069040 msgr2=0x7f2d70157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 shutdown_connections 2024-05-09T02:18:33.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.845+0000 7f2d7651c640 1 -- 172.21.15.46:0/365602432 wait complete. 2024-05-09T02:18:33.859 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T02:18:33.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:33.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.970+0000 7f15a74e0640 1 Processor -- start 2024-05-09T02:18:33.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.970+0000 7f15a74e0640 1 -- start start 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.971+0000 7f15a74e0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a00c8410 0x7f15a01584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a74e0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15a00c1e20 0x7f15a00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a74e0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a006ed30 con 0x7f15a0140d40 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a74e0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f15a00c8820 con 0x7f15a00c1e20 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a74e0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f15a006f010 con 0x7f15a00c8410 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a5a7d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15a00c1e20 0x7f15a00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a527c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f15a0140d40 0x7f15a006e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44290/0 (socket says 172.21.15.46:44290) 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a527c640 1 -- 172.21.15.46:0/18246227 learned_addr learned my addr 172.21.15.46:0/18246227 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a5a7d640 1 -- 172.21.15.46:0/18246227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a00c8410 msgr2=0x7f15a01584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a4a7b640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a00c8410 0x7f15a01584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a5a7d640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a00c8410 0x7f15a01584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a5a7d640 1 -- 172.21.15.46:0/18246227 >> v1:172.21.15.46:6789/0 conn(0x7f15a0140d40 legacy=0x7f15a006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f159ffff640 1 -- 172.21.15.46:0/18246227 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408917025 0 0) 0x7f15a006ed30 con 0x7f15a0140d40 2024-05-09T02:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a5a7d640 1 -- 172.21.15.46:0/18246227 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a00c7930 con 0x7f15a00c1e20 2024-05-09T02:18:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.972+0000 7f15a4a7b640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a00c8410 0x7f15a01584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.973+0000 7f15a5a7d640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c1e20 0x7f15a00c8be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15980097d0 tx=0x7f159802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f27ac4bcea31394 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.973+0000 7f159ffff640 1 -- 172.21.15.46:0/18246227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598037070 con 0x7f15a00c1e20 2024-05-09T02:18:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.973+0000 7f159ffff640 1 -- 172.21.15.46:0/18246227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159802ae40 con 0x7f15a00c1e20 2024-05-09T02:18:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.973+0000 7f159ffff640 1 -- 172.21.15.46:0/18246227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598032660 con 0x7f15a00c1e20 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 -- 172.21.15.46:0/18246227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c1e20 msgr2=0x7f15a00c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c1e20 0x7f15a00c8be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15980097d0 tx=0x7f159802a130 comp rx=0 tx=0).stop 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 -- 172.21.15.46:0/18246227 shutdown_connections 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c1e20 0x7f15a00c8be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 --2- 172.21.15.46:0/18246227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a00c8410 0x7f15a01584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 -- 172.21.15.46:0/18246227 >> 172.21.15.46:0/18246227 conn(0x7f15a0068e00 msgr2=0x7f15a00c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 -- 172.21.15.46:0/18246227 shutdown_connections 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.974+0000 7f15a74e0640 1 -- 172.21.15.46:0/18246227 wait complete. 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.975+0000 7f15a74e0640 1 Processor -- start 2024-05-09T02:18:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.975+0000 7f15a74e0640 1 -- start start 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a00c1e20 0x7f15a01ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 0x7f15a013f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a0140d40 0x7f15a01f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f15a00c9120 con 0x7f15a00c8410 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f15a00c7ef0 con 0x7f15a00c1e20 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f15a00c92a0 con 0x7f15a0140d40 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 0x7f15a013f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 0x7f15a013f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36448/0 (socket says 172.21.15.46:36448) 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 -- 172.21.15.46:0/3072471038 learned_addr learned my addr 172.21.15.46:0/3072471038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a5a7d640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a0140d40 0x7f15a01f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a527c640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a00c1e20 0x7f15a01ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 -- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a0140d40 msgr2=0x7f15a01f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a0140d40 0x7f15a01f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 -- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a00c1e20 msgr2=0x7f15a01ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a00c1e20 0x7f15a01ee0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 -- 172.21.15.46:0/3072471038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a00c6830 con 0x7f15a00c8410 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a527c640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a00c1e20 0x7f15a01ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a4a7b640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 0x7f15a013f610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f159400c7f0 tx=0x7f159400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594015070 con 0x7f15a00c8410 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1594007820 con 0x7f15a00c8410 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a00c6b10 con 0x7f15a00c8410 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.977+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594007bd0 con 0x7f15a00c8410 2024-05-09T02:18:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.978+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a01f0da0 con 0x7f15a00c8410 2024-05-09T02:18:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.979+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a006a330 con 0x7f15a00c8410 2024-05-09T02:18:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.979+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1594018070 con 0x7f15a00c8410 2024-05-09T02:18:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.980+0000 7f159dffb640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f158c076300 0x7f158c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.980+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1594097980 con 0x7f15a00c8410 2024-05-09T02:18:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.980+0000 7f15a527c640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f158c076300 0x7f158c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.981+0000 7f15a527c640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f158c076300 0x7f158c078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1590007fd0 tx=0x7f1590009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:33.985+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1594061040 con 0x7f15a00c8410 2024-05-09T02:18:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.214+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15a00c89c0 con 0x7f15a00c8410 2024-05-09T02:18:34.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.214+0000 7f159dffb640 1 -- 172.21.15.46:0/3072471038 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f1594060940 con 0x7f15a00c8410 2024-05-09T02:18:34.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:34.217 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f158c076300 msgr2=0x7f158c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f158c076300 0x7f158c078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1590007fd0 tx=0x7f1590009040 comp rx=0 tx=0).stop 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 msgr2=0x7f15a013f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 0x7f15a013f610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f159400c7f0 tx=0x7f159400ccb0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 shutdown_connections 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f158c076300 0x7f158c078810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f15a0140d40 0x7f15a01f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15a00c8410 0x7f15a013f610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 --2- 172.21.15.46:0/3072471038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a00c1e20 0x7f15a01ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 >> 172.21.15.46:0/3072471038 conn(0x7f15a0068e00 msgr2=0x7f15a013d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 shutdown_connections 2024-05-09T02:18:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.217+0000 7f15a74e0640 1 -- 172.21.15.46:0/3072471038 wait complete. 2024-05-09T02:18:34.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:34.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.341+0000 7f443e613640 1 Processor -- start 2024-05-09T02:18:34.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.342+0000 7f443e613640 1 -- start start 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f443e613640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 0x7f44380c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f443e613640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f443815b3a0 0x7f443815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f443e613640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4438158ae0 con 0x7f44380c84a0 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f443e613640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4438155570 con 0x7f443815b3a0 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f443e613640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4438157ed0 con 0x7f4438155160 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f4437fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 0x7f44380c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f443cbb0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f443815b3a0 0x7f443815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f4437fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 0x7f44380c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:42684/0 (socket says 172.21.15.46:42684) 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f4437fff640 1 -- 172.21.15.46:0/1996150120 learned_addr learned my addr 172.21.15.46:0/1996150120 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.343+0000 7f442ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f44380c84a0 0x7f44380c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37982/0 (socket says 172.21.15.46:37982) 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.344+0000 7f443cbb0640 1 -- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 msgr2=0x7f44380c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.344+0000 7f443cbb0640 1 --2- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 0x7f44380c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.344+0000 7f443cbb0640 1 -- 172.21.15.46:0/1996150120 >> v1:172.21.15.107:6789/0 conn(0x7f44380c84a0 legacy=0x7f44380c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.344+0000 7f443cbb0640 1 -- 172.21.15.46:0/1996150120 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44381581b0 con 0x7f443815b3a0 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.344+0000 7f4437fff640 1 --2- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 0x7f44380c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.344+0000 7f443cbb0640 1 --2- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443815b3a0 0x7f443815b7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4430009d90 tx=0x7f443002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c335e26f0089172 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f44377fe640 1 -- 172.21.15.46:0/1996150120 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430007740 con 0x7f443815b3a0 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f44377fe640 1 -- 172.21.15.46:0/1996150120 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44300078e0 con 0x7f443815b3a0 2024-05-09T02:18:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f44377fe640 1 -- 172.21.15.46:0/1996150120 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430007cb0 con 0x7f443815b3a0 2024-05-09T02:18:34.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 -- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443815b3a0 msgr2=0x7f443815b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 --2- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443815b3a0 0x7f443815b7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4430009d90 tx=0x7f443002a530 comp rx=0 tx=0).stop 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 -- 172.21.15.46:0/1996150120 shutdown_connections 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 --2- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443815b3a0 0x7f443815b7b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 --2- 172.21.15.46:0/1996150120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4438155160 0x7f44380c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 -- 172.21.15.46:0/1996150120 >> 172.21.15.46:0/1996150120 conn(0x7f44380aebe0 msgr2=0x7f44380aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 -- 172.21.15.46:0/1996150120 shutdown_connections 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.345+0000 7f443e613640 1 -- 172.21.15.46:0/1996150120 wait complete. 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.347+0000 7f443e613640 1 Processor -- start 2024-05-09T02:18:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.347+0000 7f443e613640 1 -- start start 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f443e613640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44380c84a0 0x7f443814c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f443e613640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 0x7f44380ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f443e613640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f443815b3a0 0x7f44380adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f443e613640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4438157b30 con 0x7f4438155160 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f443e613640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4438158770 con 0x7f44380c84a0 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f443e613640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4438157cb0 con 0x7f443815b3a0 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f442ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 0x7f44380ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f442ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 0x7f44380ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36460/0 (socket says 172.21.15.46:36460) 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.348+0000 7f442ffff640 1 -- 172.21.15.46:0/82940773 learned_addr learned my addr 172.21.15.46:0/82940773 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f443cbb0640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f443815b3a0 0x7f44380adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f4437fff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44380c84a0 0x7f443814c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f442ffff640 1 -- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f443815b3a0 msgr2=0x7f44380adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f442ffff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f443815b3a0 0x7f44380adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f442ffff640 1 -- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44380c84a0 msgr2=0x7f443814c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f442ffff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44380c84a0 0x7f443814c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f442ffff640 1 -- 172.21.15.46:0/82940773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4438156320 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f4437fff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44380c84a0 0x7f443814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f443cbb0640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f443815b3a0 0x7f44380adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f442ffff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 0x7f44380ad7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f442000c3a0 tx=0x7f442000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44200074e0 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4420007680 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44381565c0 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420004a20 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.349+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4438159060 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.350+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443806a330 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.351+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f442001a020 con 0x7f4438155160 2024-05-09T02:18:34.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.351+0000 7f44357fa640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f44180762d0 0x7f44180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.352+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4420097240 con 0x7f4438155160 2024-05-09T02:18:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.352+0000 7f4437fff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f44180762d0 0x7f44180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.352+0000 7f4437fff640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f44180762d0 0x7f44180787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f443808e7e0 tx=0x7f4428008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:34.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.356+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f44200606c0 con 0x7f4438155160 2024-05-09T02:18:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.585+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44380ca3e0 con 0x7f4438155160 2024-05-09T02:18:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.586+0000 7f44357fa640 1 -- 172.21.15.46:0/82940773 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f442005ffc0 con 0x7f4438155160 2024-05-09T02:18:34.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:34.589 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f44180762d0 msgr2=0x7f44180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f44180762d0 0x7f44180787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f443808e7e0 tx=0x7f4428008040 comp rx=0 tx=0).stop 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 msgr2=0x7f44380ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 0x7f44380ad7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f442000c3a0 tx=0x7f442000c860 comp rx=0 tx=0).stop 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 shutdown_connections 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f44180762d0 0x7f44180787e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f443815b3a0 0x7f44380adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4438155160 0x7f44380ad7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 --2- 172.21.15.46:0/82940773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44380c84a0 0x7f443814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 >> 172.21.15.46:0/82940773 conn(0x7f44380aebe0 msgr2=0x7f44380c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 shutdown_connections 2024-05-09T02:18:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.588+0000 7f443e613640 1 -- 172.21.15.46:0/82940773 wait complete. 2024-05-09T02:18:34.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:34.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.713+0000 7fc47e825640 1 Processor -- start 2024-05-09T02:18:34.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.713+0000 7fc47e825640 1 -- start start 2024-05-09T02:18:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc47e825640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 0x7fc4781583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc47e825640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4780c7880 con 0x7fc4780c90a0 2024-05-09T02:18:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc47e825640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4780c7b20 con 0x7fc4780c5900 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc47e825640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc4780c7e00 con 0x7fc478151a20 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc477fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc4780c90a0 0x7fc47806ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44302/0 (socket says 172.21.15.46:44302) 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc477fff640 1 -- 172.21.15.46:0/284145690 learned_addr learned my addr 172.21.15.46:0/284145690 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc46ffff640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 0x7fc4781583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158442117 0 0) 0x7fc4780c7880 con 0x7fc4780c90a0 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464003520 con 0x7fc4780c90a0 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4110092055 0 0) 0x7fc464003520 con 0x7fc4780c90a0 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 msgr2=0x7fc4781583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 0x7fc4781583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 >> v1:172.21.15.107:6789/0 conn(0x7fc4780c5900 legacy=0x7fc4780c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4780c80e0 con 0x7fc4780c90a0 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7fc4680016f0 con 0x7fc4780c90a0 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 >> v1:172.21.15.46:6789/0 conn(0x7fc4780c90a0 legacy=0x7fc47806ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc464003a30 0x7fc464003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 0x7fc464004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc464004d40 0x7fc4640051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc4780c7e00 con 0x7fc464004d40 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc46400bb80 con 0x7fc464003a30 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.715+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc46400bd80 con 0x7fc478151a20 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc477fff640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc464003a30 0x7fc464003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc47cdc2640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc464004d40 0x7fc4640051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc46ffff640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 0x7fc464004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc47cdc2640 1 -- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 msgr2=0x7fc464004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc47cdc2640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc478151a20 0x7fc464004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc47cdc2640 1 -- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc464003a30 msgr2=0x7fc464003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc47cdc2640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc464003a30 0x7fc464003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.716+0000 7fc47cdc2640 1 -- 172.21.15.46:0/284145690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc464003520 con 0x7fc464004d40 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc47cdc2640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc464004d40 0x7fc4640051f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc470001e60 tx=0x7fc464005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c56c87739b0a93 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:34.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470001ab0 con 0x7fc464004d40 2024-05-09T02:18:34.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47002ae40 con 0x7fc464004d40 2024-05-09T02:18:34.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc4777fe640 1 -- 172.21.15.46:0/284145690 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470003b70 con 0x7fc464004d40 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc47e825640 1 -- 172.21.15.46:0/284145690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc464004d40 msgr2=0x7fc4640051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc47e825640 1 --2- 172.21.15.46:0/284145690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc464004d40 0x7fc4640051f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc470001e60 tx=0x7fc464005830 comp rx=0 tx=0).stop 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.717+0000 7fc47cdc2640 1 -- 172.21.15.46:0/284145690 reap_dead start 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.718+0000 7fc47e825640 1 -- 172.21.15.46:0/284145690 shutdown_connections 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.718+0000 7fc47e825640 1 -- 172.21.15.46:0/284145690 >> 172.21.15.46:0/284145690 conn(0x7fc4780cd280 msgr2=0x7fc4780cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.718+0000 7fc47e825640 1 -- 172.21.15.46:0/284145690 shutdown_connections 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.718+0000 7fc47e825640 1 -- 172.21.15.46:0/284145690 wait complete. 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.719+0000 7fc47e825640 1 Processor -- start 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.719+0000 7fc47e825640 1 -- start start 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.720+0000 7fc47e825640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc464004d40 0x7fc4780c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.720+0000 7fc47e825640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 0x7fc47814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.720+0000 7fc47e825640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc47814bb30 0x7fc47814bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.720+0000 7fc47e825640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc47806f460 con 0x7fc47814c6d0 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.720+0000 7fc47e825640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc47806f2e0 con 0x7fc47814bb30 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.720+0000 7fc47e825640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc4780c8600 con 0x7fc464004d40 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 0x7fc47814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 0x7fc47814d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36468/0 (socket says 172.21.15.46:36468) 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 -- 172.21.15.46:0/2916069236 learned_addr learned my addr 172.21.15.46:0/2916069236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc477fff640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc464004d40 0x7fc4780c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc47cdc2640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc47814bb30 0x7fc47814bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 -- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc464004d40 msgr2=0x7fc4780c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc464004d40 0x7fc4780c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 -- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc47814bb30 msgr2=0x7fc47814bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc47814bb30 0x7fc47814bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 -- 172.21.15.46:0/2916069236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4780c3860 con 0x7fc47814c6d0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc46ffff640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 0x7fc47814d870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4600118e0 tx=0x7fc460011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460019070 con 0x7fc47814c6d0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc460004240 con 0x7fc47814c6d0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47814c480 con 0x7fc47814c6d0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46000f7c0 con 0x7fc47814c6d0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.721+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4781ee300 con 0x7fc47814c6d0 2024-05-09T02:18:34.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.722+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47806a330 con 0x7fc47814c6d0 2024-05-09T02:18:34.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.723+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc46001c070 con 0x7fc47814c6d0 2024-05-09T02:18:34.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.724+0000 7fc4757fa640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc4580762d0 0x7fc4580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:34.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.724+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fc460097d40 con 0x7fc47814c6d0 2024-05-09T02:18:34.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.724+0000 7fc477fff640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc4580762d0 0x7fc4580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:34.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.725+0000 7fc477fff640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc4580762d0 0x7fc4580787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc468001220 tx=0x7fc468001110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:34.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.729+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc460060c80 con 0x7fc47814c6d0 2024-05-09T02:18:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.921+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4780c1dc0 con 0x7fc47814c6d0 2024-05-09T02:18:34.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.923+0000 7fc4757fa640 1 -- 172.21.15.46:0/2916069236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7fc460064f80 con 0x7fc47814c6d0 2024-05-09T02:18:34.926 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:34.926 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc4580762d0 msgr2=0x7fc4580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc4580762d0 0x7fc4580787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc468001220 tx=0x7fc468001110 comp rx=0 tx=0).stop 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 msgr2=0x7fc47814d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 0x7fc47814d870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4600118e0 tx=0x7fc460011da0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 shutdown_connections 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc4580762d0 0x7fc4580787e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc47814bb30 0x7fc47814bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47814c6d0 0x7fc47814d870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 --2- 172.21.15.46:0/2916069236 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc464004d40 0x7fc4780c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 >> 172.21.15.46:0/2916069236 conn(0x7fc4780cd280 msgr2=0x7fc478157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 shutdown_connections 2024-05-09T02:18:34.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:34.925+0000 7fc47e825640 1 -- 172.21.15.46:0/2916069236 wait complete. 2024-05-09T02:18:34.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:35.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.050+0000 7efc85a9f640 1 Processor -- start 2024-05-09T02:18:35.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.050+0000 7efc85a9f640 1 -- start start 2024-05-09T02:18:35.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc85a9f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc800c8410 0x7efc801584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc85a9f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc800c1e20 0x7efc800c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc85a9f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc8006ed30 con 0x7efc80140d40 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc85a9f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7efc800c8820 con 0x7efc800c8410 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc85a9f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efc8006f010 con 0x7efc800c1e20 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc800c8410 0x7efc801584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc800c8410 0x7efc801584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36472/0 (socket says 172.21.15.46:36472) 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7f7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efc80140d40 0x7efc8006e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44318/0 (socket says 172.21.15.46:44318) 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 -- 172.21.15.46:0/2165990345 learned_addr learned my addr 172.21.15.46:0/2165990345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7ffff640 1 --2- 172.21.15.46:0/2165990345 >> v2:172.21.15.107:3300/0 conn(0x7efc800c1e20 0x7efc800c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 -- 172.21.15.46:0/2165990345 >> v2:172.21.15.107:3300/0 conn(0x7efc800c1e20 msgr2=0x7efc800c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 --2- 172.21.15.46:0/2165990345 >> v2:172.21.15.107:3300/0 conn(0x7efc800c1e20 0x7efc800c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 -- 172.21.15.46:0/2165990345 >> v1:172.21.15.46:6789/0 conn(0x7efc80140d40 legacy=0x7efc8006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7effd640 1 -- 172.21.15.46:0/2165990345 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc800c7930 con 0x7efc800c8410 2024-05-09T02:18:35.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7e7fc640 1 -- 172.21.15.46:0/2165990345 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689913675 0 0) 0x7efc8006ed30 con 0x7efc80140d40 2024-05-09T02:18:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.052+0000 7efc7ffff640 1 --2- 172.21.15.46:0/2165990345 >> v2:172.21.15.107:3300/0 conn(0x7efc800c1e20 0x7efc800c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.053+0000 7efc7effd640 1 --2- 172.21.15.46:0/2165990345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c8410 0x7efc801584a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc800c4fd0 tx=0x7efc7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca641453b7788c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.053+0000 7efc7e7fc640 1 -- 172.21.15.46:0/2165990345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74037070 con 0x7efc800c8410 2024-05-09T02:18:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.053+0000 7efc7e7fc640 1 -- 172.21.15.46:0/2165990345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc74032440 con 0x7efc800c8410 2024-05-09T02:18:35.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.053+0000 7efc7e7fc640 1 -- 172.21.15.46:0/2165990345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74032810 con 0x7efc800c8410 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 -- 172.21.15.46:0/2165990345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c8410 msgr2=0x7efc801584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2165990345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c8410 0x7efc801584a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc800c4fd0 tx=0x7efc7402a1e0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 -- 172.21.15.46:0/2165990345 shutdown_connections 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2165990345 >> v2:172.21.15.107:3300/0 conn(0x7efc800c1e20 0x7efc800c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2165990345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c8410 0x7efc801584a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 -- 172.21.15.46:0/2165990345 >> 172.21.15.46:0/2165990345 conn(0x7efc80068e00 msgr2=0x7efc800c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 -- 172.21.15.46:0/2165990345 shutdown_connections 2024-05-09T02:18:35.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.054+0000 7efc85a9f640 1 -- 172.21.15.46:0/2165990345 wait complete. 2024-05-09T02:18:35.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.055+0000 7efc85a9f640 1 Processor -- start 2024-05-09T02:18:35.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.056+0000 7efc85a9f640 1 -- start start 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc85a9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 0x7efc80153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc85a9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc800c8410 0x7efc801edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc85a9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc80140d40 0x7efc8013fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc85a9f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efc800c9120 con 0x7efc800c1e20 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc85a9f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc800c7ef0 con 0x7efc80140d40 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc85a9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efc800c92a0 con 0x7efc800c8410 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 0x7efc80153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 0x7efc80153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36482/0 (socket says 172.21.15.46:36482) 2024-05-09T02:18:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 -- 172.21.15.46:0/2659100610 learned_addr learned my addr 172.21.15.46:0/2659100610 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7effd640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc800c8410 0x7efc801edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7ffff640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc80140d40 0x7efc8013fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 -- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc800c8410 msgr2=0x7efc801edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc800c8410 0x7efc801edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 -- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc80140d40 msgr2=0x7efc8013fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc80140d40 0x7efc8013fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 -- 172.21.15.46:0/2659100610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc801f1c30 con 0x7efc800c1e20 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.057+0000 7efc7f7fe640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 0x7efc80153e80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c3c0 tx=0x7efc7000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.058+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700074e0 con 0x7efc800c1e20 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.058+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc700047e0 con 0x7efc800c1e20 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.058+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc801f1ed0 con 0x7efc800c1e20 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.058+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70004bd0 con 0x7efc800c1e20 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.058+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc8013b9f0 con 0x7efc800c1e20 2024-05-09T02:18:35.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.058+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc8006a330 con 0x7efc800c1e20 2024-05-09T02:18:35.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.059+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc70011070 con 0x7efc800c1e20 2024-05-09T02:18:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.060+0000 7efc67fff640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7efc6c076300 0x7efc6c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.060+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7efc70097990 con 0x7efc800c1e20 2024-05-09T02:18:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.060+0000 7efc7effd640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7efc6c076300 0x7efc6c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.061+0000 7efc7effd640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7efc6c076300 0x7efc6c078810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc74034000 tx=0x7efc7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.064+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc801f1c30 con 0x7efc800c1e20 2024-05-09T02:18:35.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.293+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc800c89c0 con 0x7efc800c1e20 2024-05-09T02:18:35.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.294+0000 7efc67fff640 1 -- 172.21.15.46:0/2659100610 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7efc70060970 con 0x7efc800c1e20 2024-05-09T02:18:35.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:35.297 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:35.297 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:35.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.296+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7efc6c076300 msgr2=0x7efc6c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.296+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7efc6c076300 0x7efc6c078810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc74034000 tx=0x7efc7402e000 comp rx=0 tx=0).stop 2024-05-09T02:18:35.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.296+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 msgr2=0x7efc80153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.296+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 0x7efc80153e80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c3c0 tx=0x7efc7000c880 comp rx=0 tx=0).stop 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 shutdown_connections 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7efc6c076300 0x7efc6c078810 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc80140d40 0x7efc8013fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc800c8410 0x7efc801edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 --2- 172.21.15.46:0/2659100610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc800c1e20 0x7efc80153e80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 >> 172.21.15.46:0/2659100610 conn(0x7efc80068e00 msgr2=0x7efc8006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 shutdown_connections 2024-05-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.297+0000 7efc85a9f640 1 -- 172.21.15.46:0/2659100610 wait complete. 2024-05-09T02:18:35.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T02:18:13.523096+0000', 'modified': '2024-05-09T02:18:17.542144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/16654146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 16654146}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 16654146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4293, 'qdb_cluster': [4293]} 2024-05-09T02:18:35.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T02:18:35.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T02:18:35.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.839+0000 7f239c706640 1 Processor -- start 2024-05-09T02:18:35.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.839+0000 7f239c706640 1 -- start start 2024-05-09T02:18:35.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239c706640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23940b1890 0x7f23941550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239c706640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f239406e8b0 0x7f23940c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239c706640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239406ecc0 con 0x7f239406e4a0 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239c706640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f23940c1e30 con 0x7f239406e8b0 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239c706640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2394158820 con 0x7f23940b1890 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239a4a2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23940b1890 0x7f23941550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239aca3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f239406e8b0 0x7f23940c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f2399ca1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f239406e4a0 0x7f23940c2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:38000/0 (socket says 172.21.15.46:38000) 2024-05-09T02:18:35.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f2399ca1640 1 -- 172.21.15.46:0/83592798 learned_addr learned my addr 172.21.15.46:0/83592798 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f23994a0640 1 -- 172.21.15.46:0/83592798 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990189517 0 0) 0x7f239406ecc0 con 0x7f239406e4a0 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f23994a0640 1 -- 172.21.15.46:0/83592798 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f237c003520 con 0x7f239406e4a0 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239a4a2640 1 -- 172.21.15.46:0/83592798 >> v2:172.21.15.107:3300/0 conn(0x7f239406e8b0 msgr2=0x7f23940c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239a4a2640 1 --2- 172.21.15.46:0/83592798 >> v2:172.21.15.107:3300/0 conn(0x7f239406e8b0 0x7f23940c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239a4a2640 1 -- 172.21.15.46:0/83592798 >> v1:172.21.15.107:6789/0 conn(0x7f239406e4a0 legacy=0x7f23940c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239a4a2640 1 -- 172.21.15.46:0/83592798 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23940c2080 con 0x7f23940b1890 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.841+0000 7f239aca3640 1 --2- 172.21.15.46:0/83592798 >> v2:172.21.15.107:3300/0 conn(0x7f239406e8b0 0x7f23940c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.842+0000 7f239a4a2640 1 --2- 172.21.15.46:0/83592798 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23940b1890 0x7f23941550b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2384009d90 tx=0x7f238402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae7a2008edbd55d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.842+0000 7f23994a0640 1 -- 172.21.15.46:0/83592798 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384031600 con 0x7f23940b1890 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.842+0000 7f23994a0640 1 -- 172.21.15.46:0/83592798 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23840317a0 con 0x7f23940b1890 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.842+0000 7f23994a0640 1 -- 172.21.15.46:0/83592798 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384031b50 con 0x7f23940b1890 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 -- 172.21.15.46:0/83592798 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23940b1890 msgr2=0x7f23941550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 --2- 172.21.15.46:0/83592798 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23940b1890 0x7f23941550b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2384009d90 tx=0x7f238402a5d0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 -- 172.21.15.46:0/83592798 shutdown_connections 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 --2- 172.21.15.46:0/83592798 >> v2:172.21.15.107:3300/0 conn(0x7f239406e8b0 0x7f23940c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 --2- 172.21.15.46:0/83592798 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23940b1890 0x7f23941550b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 -- 172.21.15.46:0/83592798 >> 172.21.15.46:0/83592798 conn(0x7f2394068e90 msgr2=0x7f23940cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 -- 172.21.15.46:0/83592798 shutdown_connections 2024-05-09T02:18:35.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.843+0000 7f239c706640 1 -- 172.21.15.46:0/83592798 wait complete. 2024-05-09T02:18:35.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.845+0000 7f239c706640 1 Processor -- start 2024-05-09T02:18:35.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.845+0000 7f239c706640 1 -- start start 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239c706640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f239406e4a0 0x7f239414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239c706640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 0x7f239414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239c706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940b1890 0x7f2394146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239c706640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23941555f0 con 0x7f239406e8b0 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239c706640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23940c2640 con 0x7f23940b1890 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239c706640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23940c37b0 con 0x7f239406e4a0 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f2399ca1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 0x7f239414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f2399ca1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 0x7f239414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36494/0 (socket says 172.21.15.46:36494) 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f2399ca1640 1 -- 172.21.15.46:0/1143196604 learned_addr learned my addr 172.21.15.46:0/1143196604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239a4a2640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f239406e4a0 0x7f239414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.846+0000 7f239aca3640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940b1890 0x7f2394146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2399ca1640 1 -- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f239406e4a0 msgr2=0x7f239414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2399ca1640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f239406e4a0 0x7f239414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2399ca1640 1 -- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940b1890 msgr2=0x7f2394146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2399ca1640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940b1890 0x7f2394146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2399ca1640 1 -- 172.21.15.46:0/1143196604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941edff0 con 0x7f239406e8b0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2399ca1640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 0x7f239414ef20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f238800c3c0 tx=0x7f238800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2392ffd640 1 -- 172.21.15.46:0/1143196604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388017070 con 0x7f239406e8b0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2394154720 con 0x7f239406e8b0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2392ffd640 1 -- 172.21.15.46:0/1143196604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388005da0 con 0x7f239406e8b0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f2392ffd640 1 -- 172.21.15.46:0/1143196604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880072d0 con 0x7f239406e8b0 2024-05-09T02:18:35.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.847+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2394152a10 con 0x7f239406e8b0 2024-05-09T02:18:35.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.850+0000 7f2392ffd640 1 -- 172.21.15.46:0/1143196604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f238801a070 con 0x7f239406e8b0 2024-05-09T02:18:35.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.850+0000 7f2392ffd640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2380076300 0x7f2380078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.850+0000 7f2392ffd640 1 -- 172.21.15.46:0/1143196604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2388096ad0 con 0x7f239406e8b0 2024-05-09T02:18:35.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.850+0000 7f239a4a2640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2380076300 0x7f2380078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.851+0000 7f23a35bf740 1 Processor -- start 2024-05-09T02:18:35.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.851+0000 7f23a35bf740 1 -- start start 2024-05-09T02:18:35.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.851+0000 7f239a4a2640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2380076300 0x7f2380078810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2384034000 tx=0x7f238402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e8534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e8751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e892af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f23a35bf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564c2e7ba4e0 con 0x564c2e491590 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c2e755ff0 con 0x564c2e4b2270 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x564c2e7b64a0 con 0x564c2e4893b0 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e892af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e892af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36498/0 (socket says 172.21.15.46:36498) 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 -- 172.21.15.46:0/2299603533 learned_addr learned my addr 172.21.15.46:0/2299603533 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239a4a2640 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e8534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f2399ca1640 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e8751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 -- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 msgr2=0x564c2e8751f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e8751f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 -- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 msgr2=0x564c2e8534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e8534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.852+0000 7f239aca3640 1 -- 172.21.15.46:0/2299603533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2e73c720 con 0x564c2e491590 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.853+0000 7f239aca3640 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e892af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f238c009af0 tx=0x7f238c0112c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947e371f82b6020 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.853+0000 7f237bfff640 1 -- 172.21.15.46:0/2299603533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c011dc0 con 0x564c2e491590 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.853+0000 7f237bfff640 1 -- 172.21.15.46:0/2299603533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c004020 con 0x564c2e491590 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.853+0000 7f237bfff640 1 -- 172.21.15.46:0/2299603533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0043f0 con 0x564c2e491590 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.853+0000 7f23a35bf740 1 -- 172.21.15.46:0/2299603533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 msgr2=0x564c2e892af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e892af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f238c009af0 tx=0x7f238c0112c0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 -- 172.21.15.46:0/2299603533 shutdown_connections 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e892af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e8751f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 --2- 172.21.15.46:0/2299603533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e8534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 -- 172.21.15.46:0/2299603533 >> 172.21.15.46:0/2299603533 conn(0x564c2e4a63c0 msgr2=0x564c2e855300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 -- 172.21.15.46:0/2299603533 shutdown_connections 2024-05-09T02:18:35.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.854+0000 7f23a35bf740 1 -- 172.21.15.46:0/2299603533 wait complete. 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.855+0000 7f23a35bf740 1 -- start start 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.855+0000 7f23a35bf740 1 Processor -- start 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e873820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e491590 0x564c2e8773c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 0x564c2e8a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564c2e896350 con 0x564c2e4b2270 2024-05-09T02:18:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c2e741760 con 0x564c2e491590 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x564c2e88b530 con 0x564c2e4893b0 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f23a35bf740 10 client.0 _ll_register_callbacks cb 0x564c2e7644b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f239aca3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 0x564c2e8a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f239aca3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 0x564c2e8a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36514/0 (socket says 172.21.15.46:36514) 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f239aca3640 1 -- 172.21.15.46:0/4165409168 learned_addr learned my addr 172.21.15.46:0/4165409168 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f2399ca1640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e491590 0x564c2e8773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f239a4a2640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e873820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.856+0000 7f239aca3640 1 -- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 msgr2=0x564c2e873820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f239aca3640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e873820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f239aca3640 1 -- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e491590 msgr2=0x564c2e8773c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f239aca3640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e491590 0x564c2e8773c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f239aca3640 1 -- 172.21.15.46:0/4165409168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2e782bd0 con 0x564c2e4b2270 2024-05-09T02:18:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f239aca3640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 0x564c2e8a6920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f238c019000 tx=0x7f238c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54906b6dd8b9b523 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23797fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23797fa640 1 -- 172.21.15.46:0/4165409168 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c009710 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c004020 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23797fa640 1 -- 172.21.15.46:0/4165409168 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f238c003820 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23797fa640 1 -- 172.21.15.46:0/4165409168 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f238c030050 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 10 client.4674 fetch_fsmap learned FSMap version 14 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564c2e768280 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23797fa640 1 -- 172.21.15.46:0/4165409168 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c004020 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23797fa640 1 -- 172.21.15.46:0/4165409168 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 14) ==== 4128+0+0 (secure 0 0 0) 0x7f238c003a20 con 0x564c2e4b2270 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 10 client.4674 fetch_fsmap finished waiting for FSMap version 14 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 20 client.4674 populate_metadata read hostname 'smithi046' 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e470e40 0x564c2e8a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 4 client.4674 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.857+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 --> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c2e7c80f0 con 0x564c2e470e40 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.858+0000 7f239a4a2640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e470e40 0x564c2e8a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.858+0000 7f239a4a2640 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e470e40 0x564c2e8a3940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8bfa37d9811d92f server_cookie=ac1c25f6a792da7c in_seq=0 out_seq=0 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.858+0000 7f23797fa640 10 client.4674 ms_handle_connect on v2:172.21.15.107:6835/16654146 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.859+0000 7f23797fa640 1 -- 172.21.15.46:0/4165409168 <== mds.0 v2:172.21.15.107:6835/16654146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564c2e7c80f0 con 0x564c2e470e40 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.859+0000 7f23797fa640 10 client.4674 handle_command_reply: tid=0 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.859+0000 7f23a35bf740 1 client.4674 shutdown 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.859+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 msgr2=0x564c2e8a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.859+0000 7f23a35bf740 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 0x564c2e8a6920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f238c019000 tx=0x7f238c004730 comp rx=0 tx=0).stop 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 shutdown_connections 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4b2270 0x564c2e8a6920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e470e40 0x564c2e8a3940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e491590 0x564c2e8773c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 --2- 172.21.15.46:0/4165409168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e873820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 >> 172.21.15.46:0/4165409168 conn(0x564c2e4a63c0 msgr2=0x564c2e855720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23797fa640 0 client.4674 ms_handle_reset on v2:172.21.15.107:6835/16654146 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 shutdown_connections 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 1 -- 172.21.15.46:0/4165409168 wait complete. 2024-05-09T02:18:35.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.860+0000 7f23a35bf740 20 client.4674 trim_cache size 0 max 16384 2024-05-09T02:18:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.879+0000 7f23a35bf740 1 Processor -- start 2024-05-09T02:18:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.879+0000 7f23a35bf740 1 -- start start 2024-05-09T02:18:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e852630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e88a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e887d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f23a35bf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23941fd560 con 0x564c2e491590 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23941f1650 con 0x564c2e4b2270 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23941fb610 con 0x564c2e4893b0 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e88a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e88a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36528/0 (socket says 172.21.15.46:36528) 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 -- 172.21.15.46:0/320247254 learned_addr learned my addr 172.21.15.46:0/320247254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 -- 172.21.15.46:0/320247254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 msgr2=0x564c2e852630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e852630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 -- 172.21.15.46:0/320247254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 msgr2=0x564c2e887d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e887d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.880+0000 7f2399ca1640 1 -- 172.21.15.46:0/320247254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2e51d850 con 0x564c2e491590 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.881+0000 7f2399ca1640 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e88a5c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2388005830 tx=0x7f2388066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c795af0b49da977 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.881+0000 7f237b7fe640 1 -- 172.21.15.46:0/320247254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238807a070 con 0x564c2e491590 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.881+0000 7f237b7fe640 1 -- 172.21.15.46:0/320247254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238805fac0 con 0x564c2e491590 2024-05-09T02:18:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.881+0000 7f237b7fe640 1 -- 172.21.15.46:0/320247254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388063dc0 con 0x564c2e491590 2024-05-09T02:18:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.881+0000 7f23a35bf740 1 -- 172.21.15.46:0/320247254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 msgr2=0x564c2e88a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.881+0000 7f23a35bf740 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e88a5c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2388005830 tx=0x7f2388066040 comp rx=0 tx=0).stop 2024-05-09T02:18:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 -- 172.21.15.46:0/320247254 shutdown_connections 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e887d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e491590 0x564c2e88a5c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 --2- 172.21.15.46:0/320247254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e4893b0 0x564c2e852630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 -- 172.21.15.46:0/320247254 >> 172.21.15.46:0/320247254 conn(0x564c2e4a63c0 msgr2=0x564c2e873560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 -- 172.21.15.46:0/320247254 shutdown_connections 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 -- 172.21.15.46:0/320247254 wait complete. 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 -- start start 2024-05-09T02:18:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.882+0000 7f23a35bf740 1 Processor -- start 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 0x564c2e855900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e491590 0x564c2e90e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e90e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564c2e88a410 con 0x564c2e4893b0 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c2e88b270 con 0x564c2e4b2270 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x564c2e8a33b0 con 0x564c2e491590 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23a35bf740 10 client.0 _ll_register_callbacks cb 0x7f238c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 0x564c2e855900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 0x564c2e855900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36542/0 (socket says 172.21.15.46:36542) 2024-05-09T02:18:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 -- 172.21.15.46:0/1589775158 learned_addr learned my addr 172.21.15.46:0/1589775158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f2399ca1640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e491590 0x564c2e90e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239aca3640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e90e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 -- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e491590 msgr2=0x564c2e90e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e491590 0x564c2e90e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 -- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 msgr2=0x564c2e90e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e90e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 -- 172.21.15.46:0/1589775158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2e5946b0 con 0x564c2e4893b0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f239a4a2640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 0x564c2e855900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2384009eb0 tx=0x7f2384004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df88ad238e2ed47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.884+0000 7f23797fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23797fa640 1 -- 172.21.15.46:0/1589775158 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23840045d0 con 0x564c2e4893b0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23797fa640 1 -- 172.21.15.46:0/1589775158 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2384004770 con 0x564c2e4893b0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238805fac0 con 0x564c2e4893b0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23797fa640 1 -- 172.21.15.46:0/1589775158 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f2384063050 con 0x564c2e4893b0 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 10 client.4680 fetch_fsmap learned FSMap version 14 2024-05-09T02:18:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564c2e776630 con 0x564c2e4893b0 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23797fa640 1 -- 172.21.15.46:0/1589775158 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238805fac0 con 0x564c2e4893b0 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23797fa640 1 -- 172.21.15.46:0/1589775158 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 14) ==== 4128+0+0 (secure 0 0 0) 0x7f2384066020 con 0x564c2e4893b0 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 10 client.4680 fetch_fsmap finished waiting for FSMap version 14 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 20 client.4680 populate_metadata read hostname 'smithi046' 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e914310 0x564c2e914720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 4 client.4680 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 --> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] -- command(tid 0: {"prefix": "status"}) -- 0x564c2e7c1f60 con 0x564c2e914310 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.885+0000 7f2399ca1640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e914310 0x564c2e914720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23797fa640 10 client.4680 ms_handle_connect on v2:172.21.15.107:6835/16654146 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f2399ca1640 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e914310 0x564c2e914720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a17d2e2dbd53cf server_cookie=a57e14765aed030d in_seq=0 out_seq=0 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23797fa640 1 -- 172.21.15.46:0/1589775158 <== mds.0 v2:172.21.15.107:6835/16654146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x564c2e7c1f60 con 0x564c2e914310 2024-05-09T02:18:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23797fa640 10 client.4680 handle_command_reply: tid=0 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 client.4680 shutdown 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 msgr2=0x564c2e855900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 0x564c2e855900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2384009eb0 tx=0x7f2384004ab0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 shutdown_connections 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:6835/16654146,v1:172.21.15.107:6837/16654146] conn(0x564c2e914310 0x564c2e914720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c2e4b2270 0x564c2e90e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564c2e491590 0x564c2e90e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23797fa640 0 client.4680 ms_handle_reset on v2:172.21.15.107:6835/16654146 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 --2- 172.21.15.46:0/1589775158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564c2e4893b0 0x564c2e855900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 >> 172.21.15.46:0/1589775158 conn(0x564c2e4a63c0 msgr2=0x564c2e892bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 shutdown_connections 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 1 -- 172.21.15.46:0/1589775158 wait complete. 2024-05-09T02:18:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.886+0000 7f23a35bf740 20 client.4680 trim_cache size 0 max 16384 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fbf7bc7e-7778-49a9-881a-45aca90d45c0", 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4293, 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "a", 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 21.759930579999999, 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 8, 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 27.775913697 2024-05-09T02:18:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:18:35.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2380076300 msgr2=0x7f2380078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2380076300 0x7f2380078810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2384034000 tx=0x7f238402f000 comp rx=0 tx=0).stop 2024-05-09T02:18:35.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 msgr2=0x7f239414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:35.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 0x7f239414ef20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f238800c3c0 tx=0x7f238800c7c0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 shutdown_connections 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2380076300 0x7f2380078810 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940b1890 0x7f2394146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f239406e8b0 0x7f239414ef20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 --2- 172.21.15.46:0/1143196604 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f239406e4a0 0x7f239414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 >> 172.21.15.46:0/1143196604 conn(0x7f2394068e90 msgr2=0x7f2394076500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 shutdown_connections 2024-05-09T02:18:35.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:35.887+0000 7f239c706640 1 -- 172.21.15.46:0/1143196604 wait complete. 2024-05-09T02:18:35.901 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:36.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.012+0000 7ff50fda8640 1 Processor -- start 2024-05-09T02:18:36.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.012+0000 7ff50fda8640 1 -- start start 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50fda8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff5080c8410 0x7ff5081584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50fda8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 0x7ff5080c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50fda8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50806ed30 con 0x7ff508140d40 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50fda8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff5080c8820 con 0x7ff5080c8410 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50fda8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff50806f010 con 0x7ff5080c1e20 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50db44640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff508140d40 0x7ff50806e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44328/0 (socket says 172.21.15.46:44328) 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.013+0000 7ff50db44640 1 -- 172.21.15.46:0/2086652787 learned_addr learned my addr 172.21.15.46:0/2086652787 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50e345640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 0x7ff5080c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50d343640 1 --2- 172.21.15.46:0/2086652787 >> v2:172.21.15.107:3300/0 conn(0x7ff5080c8410 0x7ff5081584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635575490 0 0) 0x7ff50806ed30 con 0x7ff508140d40 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f4003520 con 0x7ff508140d40 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1590790768 0 0) 0x7ff4f4003520 con 0x7ff508140d40 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 msgr2=0x7ff5080c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 0x7ff5080c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 >> v2:172.21.15.107:3300/0 conn(0x7ff5080c8410 msgr2=0x7ff5081584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 --2- 172.21.15.46:0/2086652787 >> v2:172.21.15.107:3300/0 conn(0x7ff5080c8410 0x7ff5081584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080c7930 con 0x7ff508140d40 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7ff5040016f0 con 0x7ff508140d40 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 >> v1:172.21.15.46:6789/0 conn(0x7ff508140d40 legacy=0x7ff50806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f4003a30 0x7ff4f4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 0x7ff4f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4004d40 0x7ff4f4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080c8820 con 0x7ff4f4003a30 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff50806f010 con 0x7ff4f4004d40 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f400bb20 con 0x7ff5080c1e20 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50db44640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f4003a30 0x7ff4f4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50d343640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 0x7ff4f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50e345640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4004d40 0x7ff4f4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50db44640 1 -- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 msgr2=0x7ff4f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50db44640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5080c1e20 0x7ff4f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50db44640 1 -- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4004d40 msgr2=0x7ff4f4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50db44640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4004d40 0x7ff4f4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.014+0000 7ff50db44640 1 -- 172.21.15.46:0/2086652787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f4003520 con 0x7ff4f4003a30 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.015+0000 7ff50db44640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f4003a30 0x7ff4f4003ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff5080b25f0 tx=0x7ff4f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c9f630435cb912 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.015+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504007d50 con 0x7ff4f4003a30 2024-05-09T02:18:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.015+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff504005ad0 con 0x7ff4f4003a30 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.015+0000 7ff50cb42640 1 -- 172.21.15.46:0/2086652787 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504007070 con 0x7ff4f4003a30 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50fda8640 1 -- 172.21.15.46:0/2086652787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f4003a30 msgr2=0x7ff4f4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2086652787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f4003a30 0x7ff4f4003ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff5080b25f0 tx=0x7ff4f4005830 comp rx=0 tx=0).stop 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50e345640 1 -- 172.21.15.46:0/2086652787 reap_dead start 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50fda8640 1 -- 172.21.15.46:0/2086652787 shutdown_connections 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50fda8640 1 -- 172.21.15.46:0/2086652787 >> 172.21.15.46:0/2086652787 conn(0x7ff508068e00 msgr2=0x7ff5080c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50fda8640 1 -- 172.21.15.46:0/2086652787 shutdown_connections 2024-05-09T02:18:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.016+0000 7ff50fda8640 1 -- 172.21.15.46:0/2086652787 wait complete. 2024-05-09T02:18:36.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.018+0000 7ff50fda8640 1 Processor -- start 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.018+0000 7ff50fda8640 1 -- start start 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50fda8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f4003a30 0x7ff5080c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50fda8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5080c5590 0x7ff508138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50fda8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 0x7ff5081541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50fda8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080c2230 con 0x7ff508153dc0 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50fda8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080c7ef0 con 0x7ff5080c5590 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50fda8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080c23b0 con 0x7ff4f4003a30 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 0x7ff5081541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 0x7ff5081541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36556/0 (socket says 172.21.15.46:36556) 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 -- 172.21.15.46:0/2450411532 learned_addr learned my addr 172.21.15.46:0/2450411532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50db44640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f4003a30 0x7ff5080c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50d343640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5080c5590 0x7ff508138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 -- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f4003a30 msgr2=0x7ff5080c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f4003a30 0x7ff5080c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 -- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5080c5590 msgr2=0x7ff508138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5080c5590 0x7ff508138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50e345640 1 -- 172.21.15.46:0/2450411532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080cc5b0 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.019+0000 7ff50db44640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f4003a30 0x7ff5080c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.020+0000 7ff50e345640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 0x7ff5081541d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5080c98b0 tx=0x7ff50000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.020+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000fde0 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.020+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50001d070 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.020+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5080c52e0 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.020+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500015670 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.020+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081eea60 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.021+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50806a330 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.021+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff500015810 con 0x7ff508153dc0 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.022+0000 7ff4fe7fc640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff4ec076300 0x7ff4ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.022+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff500098260 con 0x7ff508153dc0 2024-05-09T02:18:36.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.022+0000 7ff50db44640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff4ec076300 0x7ff4ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.023+0000 7ff50db44640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff4ec076300 0x7ff4ec078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff504032000 tx=0x7ff50402d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.027+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5080cc5b0 con 0x7ff508153dc0 2024-05-09T02:18:36.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.256+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff508154c70 con 0x7ff508153dc0 2024-05-09T02:18:36.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.257+0000 7ff4fe7fc640 1 -- 172.21.15.46:0/2450411532 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7ff500010040 con 0x7ff508153dc0 2024-05-09T02:18:36.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:36.260 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:36.260 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:36.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff4ec076300 msgr2=0x7ff4ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff4ec076300 0x7ff4ec078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff504032000 tx=0x7ff50402d000 comp rx=0 tx=0).stop 2024-05-09T02:18:36.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 msgr2=0x7ff5081541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 0x7ff5081541d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5080c98b0 tx=0x7ff50000f580 comp rx=0 tx=0).stop 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 shutdown_connections 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff4ec076300 0x7ff4ec078810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff508153dc0 0x7ff5081541d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5080c5590 0x7ff508138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 --2- 172.21.15.46:0/2450411532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f4003a30 0x7ff5080c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 >> 172.21.15.46:0/2450411532 conn(0x7ff508068e00 msgr2=0x7ff508155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 shutdown_connections 2024-05-09T02:18:36.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.259+0000 7ff50fda8640 1 -- 172.21.15.46:0/2450411532 wait complete. 2024-05-09T02:18:36.273 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:36.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.385+0000 7f207ccbd640 1 Processor -- start 2024-05-09T02:18:36.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.385+0000 7f207ccbd640 1 -- start start 2024-05-09T02:18:36.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f207ccbd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f20781602f0 0x7f2078162710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f207ccbd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20781553e0 con 0x7f2078154fd0 2024-05-09T02:18:36.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f207ccbd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2078158580 con 0x7f20780c6d70 2024-05-09T02:18:36.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f207ccbd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f20780c2690 con 0x7f20781602f0 2024-05-09T02:18:36.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f206dd9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2078154fd0 0x7f20780c9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42730/0 (socket says 172.21.15.46:42730) 2024-05-09T02:18:36.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f206dd9b640 1 -- 172.21.15.46:0/1419882466 learned_addr learned my addr 172.21.15.46:0/1419882466 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.386+0000 7f2076d9d640 1 --2- 172.21.15.46:0/1419882466 >> v2:172.21.15.107:3300/0 conn(0x7f20781602f0 0x7f2078162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502480893 0 0) 0x7f2060001110 con 0x7f2078154fd0 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2064003520 con 0x7f2078154fd0 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644286840 0 0) 0x7f2078158580 con 0x7f20780c6d70 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2060001110 con 0x7f20780c6d70 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1531534559 0 0) 0x7f2064003520 con 0x7f2078154fd0 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 >> v2:172.21.15.107:3300/0 conn(0x7f20781602f0 msgr2=0x7f2078162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 --2- 172.21.15.46:0/1419882466 >> v2:172.21.15.107:3300/0 conn(0x7f20781602f0 0x7f2078162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 >> v1:172.21.15.107:6789/0 conn(0x7f20780c6d70 legacy=0x7f20780c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078158860 con 0x7f2078154fd0 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f20600018c0 con 0x7f2078154fd0 2024-05-09T02:18:36.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 >> v1:172.21.15.46:6789/0 conn(0x7f2078154fd0 legacy=0x7f20780c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2064003c60 0x7f20640040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2064004850 0x7f2064004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20640053f0 0x7f206400bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f20780c2690 con 0x7f20640053f0 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f206400c390 con 0x7f2064004850 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f206400c590 con 0x7f2064003c60 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2076d9d640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20640053f0 0x7f206400bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f207659c640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2064003c60 0x7f20640040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f206dd9b640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2064004850 0x7f2064004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2076d9d640 1 -- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2064003c60 msgr2=0x7f20640040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2076d9d640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2064003c60 0x7f20640040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2076d9d640 1 -- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2064004850 msgr2=0x7f2064004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2076d9d640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2064004850 0x7f2064004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.387+0000 7f2076d9d640 1 -- 172.21.15.46:0/1419882466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2064003520 con 0x7f20640053f0 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.388+0000 7f2076d9d640 1 -- 172.21.15.46:0/1419882466 reap_dead start 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.388+0000 7f2076d9d640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20640053f0 0x7f206400bab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2070009fc0 tx=0x7f2064005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6b6698208cc6f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.388+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070035020 con 0x7f20640053f0 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.388+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2070003b90 con 0x7f20640053f0 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.388+0000 7f2075d9b640 1 -- 172.21.15.46:0/1419882466 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070009c10 con 0x7f20640053f0 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 -- 172.21.15.46:0/1419882466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20640053f0 msgr2=0x7f206400bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20640053f0 0x7f206400bab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2070009fc0 tx=0x7f2064005830 comp rx=0 tx=0).stop 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 -- 172.21.15.46:0/1419882466 shutdown_connections 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 --2- 172.21.15.46:0/1419882466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20640053f0 0x7f206400bab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 -- 172.21.15.46:0/1419882466 >> 172.21.15.46:0/1419882466 conn(0x7f207806e8f0 msgr2=0x7f207806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 -- 172.21.15.46:0/1419882466 shutdown_connections 2024-05-09T02:18:36.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.389+0000 7f207ccbd640 1 -- 172.21.15.46:0/1419882466 wait complete. 2024-05-09T02:18:36.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.391+0000 7f207ccbd640 1 Processor -- start 2024-05-09T02:18:36.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.391+0000 7f207ccbd640 1 -- start start 2024-05-09T02:18:36.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207ccbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 0x7f2078149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207ccbd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2078149f60 0x7f207815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207ccbd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f207814a720 0x7f2078152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207ccbd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f20780c92f0 con 0x7f20781ee5f0 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207ccbd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20780c2320 con 0x7f207814a720 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207ccbd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f20780c9470 con 0x7f2078149f60 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 0x7f2078149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 0x7f2078149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38310/0 (socket says 172.21.15.46:38310) 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.392+0000 7f207659c640 1 -- 172.21.15.46:0/4057347733 learned_addr learned my addr 172.21.15.46:0/4057347733 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f206dd9b640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2078149f60 0x7f207815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f2076d9d640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f207814a720 0x7f2078152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207659c640 1 -- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2078149f60 msgr2=0x7f207815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207659c640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2078149f60 0x7f207815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207659c640 1 -- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f207814a720 msgr2=0x7f2078152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207659c640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f207814a720 0x7f2078152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207659c640 1 -- 172.21.15.46:0/4057347733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078152750 con 0x7f20781ee5f0 2024-05-09T02:18:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f2076d9d640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f207814a720 0x7f2078152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207659c640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 0x7f2078149a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f206800f7f0 tx=0x7f206800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680050d0 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2068018070 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2078153e30 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206800d730 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.393+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2078148e20 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.394+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207806a330 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.395+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f206800d8d0 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.395+0000 7f206f7fe640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f20580762d0 0x7f20580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.396+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f20680976f0 con 0x7f20781ee5f0 2024-05-09T02:18:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.396+0000 7f206dd9b640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f20580762d0 0x7f20580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.396+0000 7f206dd9b640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f20580762d0 0x7f20580787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2060000c00 tx=0x7f2060009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.400+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2068060db0 con 0x7f20781ee5f0 2024-05-09T02:18:36.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.591+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2078069e80 con 0x7f20781ee5f0 2024-05-09T02:18:36.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.592+0000 7f206f7fe640 1 -- 172.21.15.46:0/4057347733 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7f20680606b0 con 0x7f20781ee5f0 2024-05-09T02:18:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:36.595 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:36.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f20580762d0 msgr2=0x7f20580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f20580762d0 0x7f20580787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2060000c00 tx=0x7f2060009040 comp rx=0 tx=0).stop 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 msgr2=0x7f2078149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 0x7f2078149a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f206800f7f0 tx=0x7f206800fcb0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 shutdown_connections 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f20580762d0 0x7f20580787e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f207814a720 0x7f2078152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2078149f60 0x7f207815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 --2- 172.21.15.46:0/4057347733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20781ee5f0 0x7f2078149a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 >> 172.21.15.46:0/4057347733 conn(0x7f207806e8f0 msgr2=0x7f20780b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 shutdown_connections 2024-05-09T02:18:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.595+0000 7f207ccbd640 1 -- 172.21.15.46:0/4057347733 wait complete. 2024-05-09T02:18:36.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:36.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.721+0000 7f55d3025640 1 Processor -- start 2024-05-09T02:18:36.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.721+0000 7f55d3025640 1 -- start start 2024-05-09T02:18:36.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d3025640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d3025640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f55cc071580 0x7f55cc157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d3025640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55cc070e00 con 0x7f55cc15b900 2024-05-09T02:18:36.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d3025640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f55cc15b190 con 0x7f55cc071580 2024-05-09T02:18:36.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d3025640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55cc15b470 con 0x7f55cc071030 2024-05-09T02:18:36.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d0dc1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55cbfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f55cc071580 0x7f55cc157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d0dc1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:53290/0 (socket says 172.21.15.46:53290) 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d0dc1640 1 -- 172.21.15.46:0/1541295181 learned_addr learned my addr 172.21.15.46:0/1541295181 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.722+0000 7f55d15c2640 1 --1- 172.21.15.46:0/1541295181 >> v1:172.21.15.107:6789/0 conn(0x7f55cc15b900 0x7f55cc073ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:52816/0 (socket says 172.21.15.46:52816) 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.723+0000 7f55cbfff640 1 -- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 msgr2=0x7f55cc1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.723+0000 7f55cbfff640 1 --2- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.723+0000 7f55cbfff640 1 -- 172.21.15.46:0/1541295181 >> v1:172.21.15.107:6789/0 conn(0x7f55cc15b900 legacy=0x7f55cc073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.723+0000 7f55cbfff640 1 -- 172.21.15.46:0/1541295181 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55cc0c5100 con 0x7f55cc071580 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.723+0000 7f55d0dc1640 1 --2- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.724+0000 7f55cbfff640 1 --2- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc157c20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f55b80097a0 tx=0x7f55b802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca42e562b2dc2aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.724+0000 7f55cb7fe640 1 -- 172.21.15.46:0/1541295181 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8037070 con 0x7f55cc071580 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.724+0000 7f55cb7fe640 1 -- 172.21.15.46:0/1541295181 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b802adb0 con 0x7f55cc071580 2024-05-09T02:18:36.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.724+0000 7f55cb7fe640 1 -- 172.21.15.46:0/1541295181 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8032660 con 0x7f55cc071580 2024-05-09T02:18:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.724+0000 7f55d3025640 1 -- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 msgr2=0x7f55cc157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.724+0000 7f55d3025640 1 --2- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc157c20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f55b80097a0 tx=0x7f55b802a060 comp rx=0 tx=0).stop 2024-05-09T02:18:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.725+0000 7f55d3025640 1 -- 172.21.15.46:0/1541295181 shutdown_connections 2024-05-09T02:18:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.725+0000 7f55d3025640 1 --2- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc157c20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.725+0000 7f55d3025640 1 --2- 172.21.15.46:0/1541295181 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.725+0000 7f55d3025640 1 -- 172.21.15.46:0/1541295181 >> 172.21.15.46:0/1541295181 conn(0x7f55cc0aba90 msgr2=0x7f55cc0abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.725+0000 7f55d3025640 1 -- 172.21.15.46:0/1541295181 shutdown_connections 2024-05-09T02:18:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.725+0000 7f55d3025640 1 -- 172.21.15.46:0/1541295181 wait complete. 2024-05-09T02:18:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.726+0000 7f55d3025640 1 Processor -- start 2024-05-09T02:18:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.726+0000 7f55d3025640 1 -- start start 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc0a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 0x7f55cc155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc0741f0 con 0x7f55cc15b900 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc070a90 con 0x7f55cc071580 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55cc074370 con 0x7f55cc071030 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 0x7f55cc155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 0x7f55cc155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38320/0 (socket says 172.21.15.46:38320) 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 -- 172.21.15.46:0/2226315964 learned_addr learned my addr 172.21.15.46:0/2226315964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55cbfff640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d0dc1640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc0a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 -- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 msgr2=0x7f55cc0a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc0a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 -- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 msgr2=0x7f55cc15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 -- 172.21.15.46:0/2226315964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55cc1f14b0 con 0x7f55cc15b900 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55cbfff640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d15c2640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 0x7f55cc155b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c730 tx=0x7f55c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4017070 con 0x7f55cc15b900 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c400ce40 con 0x7f55cc15b900 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55cc1f1790 con 0x7f55cc15b900 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.728+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c400a840 con 0x7f55cc15b900 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.729+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55cc1f1d50 con 0x7f55cc15b900 2024-05-09T02:18:36.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.729+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55cc0a96e0 con 0x7f55cc15b900 2024-05-09T02:18:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.730+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55c401a070 con 0x7f55cc15b900 2024-05-09T02:18:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.731+0000 7f55c97fa640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55b00762d0 0x7f55b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.731+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f55c4097260 con 0x7f55cc15b900 2024-05-09T02:18:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.731+0000 7f55d0dc1640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55b00762d0 0x7f55b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:36.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.732+0000 7f55d0dc1640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55b00762d0 0x7f55b00787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0cad40 tx=0x7f55c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:36.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.735+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55cc0a96e0 con 0x7f55cc15b900 2024-05-09T02:18:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.968+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55cc06a330 con 0x7f55cc15b900 2024-05-09T02:18:36.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.968+0000 7f55c97fa640 1 -- 172.21.15.46:0/2226315964 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f55c40602d0 con 0x7f55cc15b900 2024-05-09T02:18:36.971 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:36.972 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55b00762d0 msgr2=0x7f55b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55b00762d0 0x7f55b00787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0cad40 tx=0x7f55c0008040 comp rx=0 tx=0).stop 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 msgr2=0x7f55cc155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 0x7f55cc155b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c730 tx=0x7f55c400cbf0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 shutdown_connections 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55b00762d0 0x7f55b00787e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55cc15b900 0x7f55cc155b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55cc071580 0x7f55cc15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 --2- 172.21.15.46:0/2226315964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55cc071030 0x7f55cc0a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.970+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 >> 172.21.15.46:0/2226315964 conn(0x7f55cc0aba90 msgr2=0x7f55cc075eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.971+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 shutdown_connections 2024-05-09T02:18:36.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:36.971+0000 7f55d3025640 1 -- 172.21.15.46:0/2226315964 wait complete. 2024-05-09T02:18:37.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T02:18:22.572836+0000', 'modified': '2024-05-09T02:18:26.603395+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'c', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.46:6833/268323982', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6832', 'nonce': 268323982}, {'type': 'v1', 'addr': '172.21.15.46:6833', 'nonce': 268323982}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-05-09T02:18:37.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T02:18:37.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-09T02:18:37.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.504+0000 7fbbd3b08640 1 Processor -- start 2024-05-09T02:18:37.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.505+0000 7fbbd3b08640 1 -- start start 2024-05-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd3b08640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc0c62d0 0x7fbbcc0c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd3b08640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbbcc155ff0 0x7fbbcc156400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd3b08640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbbcc152cf0 0x7fbbcc153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd3b08640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fbbcc156940 con 0x7fbbcc152cf0 2024-05-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd3b08640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbbcc153640 con 0x7fbbcc155ff0 2024-05-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd3b08640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc070d80 con 0x7fbbcc0c62d0 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbbcc152cf0 0x7fbbcc153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbbcc152cf0 0x7fbbcc153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38334/0 (socket says 172.21.15.46:38334) 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 -- 172.21.15.46:0/1157018457 learned_addr learned my addr 172.21.15.46:0/1157018457 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/1157018457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc0c62d0 0x7fbbcc0c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/1157018457 >> v2:172.21.15.107:3300/0 conn(0x7fbbcc155ff0 0x7fbbcc156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 -- 172.21.15.46:0/1157018457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc0c62d0 msgr2=0x7fbbcc0c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/1157018457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc0c62d0 0x7fbbcc0c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 -- 172.21.15.46:0/1157018457 >> v2:172.21.15.107:3300/0 conn(0x7fbbcc155ff0 msgr2=0x7fbbcc156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/1157018457 >> v2:172.21.15.107:3300/0 conn(0x7fbbcc155ff0 0x7fbbcc156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.506+0000 7fbbd20a5640 1 -- 172.21.15.46:0/1157018457 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc071060 con 0x7fbbcc152cf0 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.507+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/1157018457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc152cf0 0x7fbbcc153100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0ca5b0 tx=0x7fbbc402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5620c67fab0e3ff2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.507+0000 7fbbd08a2640 1 -- 172.21.15.46:0/1157018457 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4036070 con 0x7fbbcc152cf0 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.507+0000 7fbbd08a2640 1 -- 172.21.15.46:0/1157018457 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc4031600 con 0x7fbbcc152cf0 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.507+0000 7fbbd08a2640 1 -- 172.21.15.46:0/1157018457 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40319d0 con 0x7fbbcc152cf0 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 -- 172.21.15.46:0/1157018457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc152cf0 msgr2=0x7fbbcc153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/1157018457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc152cf0 0x7fbbcc153100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0ca5b0 tx=0x7fbbc402a610 comp rx=0 tx=0).stop 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 -- 172.21.15.46:0/1157018457 shutdown_connections 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/1157018457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc152cf0 0x7fbbcc153100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/1157018457 >> v2:172.21.15.107:3300/0 conn(0x7fbbcc155ff0 0x7fbbcc156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/1157018457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc0c62d0 0x7fbbcc0c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 -- 172.21.15.46:0/1157018457 >> 172.21.15.46:0/1157018457 conn(0x7fbbcc0acec0 msgr2=0x7fbbcc0cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 -- 172.21.15.46:0/1157018457 shutdown_connections 2024-05-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.508+0000 7fbbd3b08640 1 -- 172.21.15.46:0/1157018457 wait complete. 2024-05-09T02:18:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.510+0000 7fbbd3b08640 1 Processor -- start 2024-05-09T02:18:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.510+0000 7fbbd3b08640 1 -- start start 2024-05-09T02:18:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd3b08640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbcc0c62d0 0x7fbbcc0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd3b08640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc152cf0 0x7fbbcc0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd3b08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 0x7fbbcc0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd3b08640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc155ad0 con 0x7fbbcc155ff0 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd3b08640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc071620 con 0x7fbbcc0c62d0 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd3b08640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc0aa3b0 con 0x7fbbcc152cf0 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 0x7fbbcc0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 0x7fbbcc0af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38342/0 (socket says 172.21.15.46:38342) 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 -- 172.21.15.46:0/352651205 learned_addr learned my addr 172.21.15.46:0/352651205 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbcc0c62d0 0x7fbbcc0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc152cf0 0x7fbbcc0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 -- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc152cf0 msgr2=0x7fbbcc0aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc152cf0 0x7fbbcc0aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 -- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbcc0c62d0 msgr2=0x7fbbcc0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbcc0c62d0 0x7fbbcc0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.511+0000 7fbbd20a5640 1 -- 172.21.15.46:0/352651205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc1ded10 con 0x7fbbcc155ff0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.512+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 0x7fbbcc0af000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009f40 tx=0x7fbbc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.512+0000 7fbbc27fc640 1 -- 172.21.15.46:0/352651205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4036050 con 0x7fbbcc155ff0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.512+0000 7fbbc27fc640 1 -- 172.21.15.46:0/352651205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc4042070 con 0x7fbbcc155ff0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.512+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbcc1e2900 con 0x7fbbcc155ff0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.512+0000 7fbbc27fc640 1 -- 172.21.15.46:0/352651205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4009510 con 0x7fbbcc155ff0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.512+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbcc0af740 con 0x7fbbcc155ff0 2024-05-09T02:18:37.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.514+0000 7fbbc27fc640 1 -- 172.21.15.46:0/352651205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbbc4007bf0 con 0x7fbbcc155ff0 2024-05-09T02:18:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.514+0000 7fbbc27fc640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbb0076300 0x7fbbb0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.515+0000 7fbbc27fc640 1 -- 172.21.15.46:0/352651205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbbc40b8660 con 0x7fbbcc155ff0 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.515+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbb0076300 0x7fbbb0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.515+0000 7fbbda9b7740 1 Processor -- start 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.515+0000 7fbbda9b7740 1 -- start start 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.515+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbb0076300 0x7fbbb0078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0ca4f0 tx=0x7fbbc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.516+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26f844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.516+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fa61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.516+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fc3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.516+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd26eeb4e0 con 0x55cd26bba3b0 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.516+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd26e86ff0 con 0x55cd26be3270 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.516+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55cd26ee74a0 con 0x55cd26bc2590 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fa61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fa61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38356/0 (socket says 172.21.15.46:38356) 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 -- 172.21.15.46:0/2824766183 learned_addr learned my addr 172.21.15.46:0/2824766183 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26f844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fc3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 -- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 msgr2=0x55cd26fc3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fc3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 -- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 msgr2=0x55cd26f844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26f844c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 -- 172.21.15.46:0/2824766183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd26e6d720 con 0x55cd26bba3b0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fc3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fa61f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0099c0 tx=0x7fbbbc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674f4c53f0fcbe7f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbaf7fe640 1 -- 172.21.15.46:0/2824766183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc019070 con 0x55cd26bba3b0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbaf7fe640 1 -- 172.21.15.46:0/2824766183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc011b00 con 0x55cd26bba3b0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.517+0000 7fbbaf7fe640 1 -- 172.21.15.46:0/2824766183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc015460 con 0x55cd26bba3b0 2024-05-09T02:18:37.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2824766183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 msgr2=0x55cd26fa61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fa61f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0099c0 tx=0x7fbbbc009190 comp rx=0 tx=0).stop 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2824766183 shutdown_connections 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fc3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fa61f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2824766183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26f844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2824766183 >> 172.21.15.46:0/2824766183 conn(0x55cd26bd73c0 msgr2=0x55cd26f86300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2824766183 shutdown_connections 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.518+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2824766183 wait complete. 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.519+0000 7fbbda9b7740 1 -- start start 2024-05-09T02:18:37.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.519+0000 7fbbda9b7740 1 Processor -- start 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fd78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fa7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fc0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd26fc7350 con 0x55cd26bba3b0 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd26e72760 con 0x55cd26be3270 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55cd26fa88d0 con 0x55cd26bc2590 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbda9b7740 10 client.0 _ll_register_callbacks cb 0x55cd26e954b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.520+0000 7fbbd18a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fd78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fd78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38372/0 (socket says 172.21.15.46:38372) 2024-05-09T02:18:37.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 -- 172.21.15.46:0/1640860746 learned_addr learned my addr 172.21.15.46:0/1640860746 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fa7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fc0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 -- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 msgr2=0x55cd26fa7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fa7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 -- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 msgr2=0x55cd26fc0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fc0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 -- 172.21.15.46:0/1640860746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd26eb3bd0 con 0x55cd26bba3b0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fd78a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80156f0 tx=0x7fbbc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49748df9e0594a36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbacff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbacff9640 1 -- 172.21.15.46:0/1640860746 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8026070 con 0x55cd26bba3b0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbacff9640 1 -- 172.21.15.46:0/1640860746 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbbc80147b0 con 0x55cd26bba3b0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbbc011b00 con 0x55cd26bba3b0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbacff9640 1 -- 172.21.15.46:0/1640860746 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fbbc8031050 con 0x55cd26bba3b0 2024-05-09T02:18:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbda9b7740 10 client.4707 fetch_fsmap learned FSMap version 14 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.521+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55cd26e99280 con 0x55cd26bba3b0 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbacff9640 1 -- 172.21.15.46:0/1640860746 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc011b00 con 0x55cd26bba3b0 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbacff9640 1 -- 172.21.15.46:0/1640860746 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 14) ==== 4128+0+0 (secure 0 0 0) 0x7fbbc8034020 con 0x55cd26bba3b0 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbda9b7740 10 client.4707 fetch_fsmap finished waiting for FSMap version 14 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbda9b7740 10 client.4707 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbda9b7740 20 client.4707 populate_metadata read hostname 'smithi046' 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd26ba1e40 0x55cd26fd4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbda9b7740 4 client.4707 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 --> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd26ef90f0 con 0x55cd26ba1e40 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd26ba1e40 0x55cd26fd4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbacff9640 10 client.4707 ms_handle_connect on v2:172.21.15.46:6832/268323982 2024-05-09T02:18:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.522+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd26ba1e40 0x55cd26fd4440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8df6b85a49e2618 server_cookie=e244b1fa8ef25c24 in_seq=0 out_seq=0 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbacff9640 1 -- 172.21.15.46:0/1640860746 <== mds.0 v2:172.21.15.46:6832/268323982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cd26ef90f0 con 0x55cd26ba1e40 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbacff9640 10 client.4707 handle_command_reply: tid=0 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 client.4707 shutdown 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 msgr2=0x55cd26fd78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fd78a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80156f0 tx=0x7fbbc80046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 shutdown_connections 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fc0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fa7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd26ba1e40 0x55cd26fd4440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/1640860746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fd78a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbacff9640 0 client.4707 ms_handle_reset on v2:172.21.15.46:6832/268323982 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 >> 172.21.15.46:0/1640860746 conn(0x55cd26bd73c0 msgr2=0x55cd26f83f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 shutdown_connections 2024-05-09T02:18:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 1 -- 172.21.15.46:0/1640860746 wait complete. 2024-05-09T02:18:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.523+0000 7fbbda9b7740 20 client.4707 trim_cache size 0 max 16384 2024-05-09T02:18:37.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.542+0000 7fbbda9b7740 1 Processor -- start 2024-05-09T02:18:37.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.542+0000 7fbbda9b7740 1 -- start start 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.543+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fc0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fe6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fe70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc1fb520 con 0x55cd26bba3b0 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc1f8f40 con 0x55cd26be3270 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc1f9530 con 0x55cd26bc2590 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fc0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fc0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38388/0 (socket says 172.21.15.46:38388) 2024-05-09T02:18:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 -- 172.21.15.46:0/2940496368 learned_addr learned my addr 172.21.15.46:0/2940496368 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 -- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 msgr2=0x55cd26fe6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fe70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fe6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fe6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 -- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 msgr2=0x55cd26fe70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fe70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 -- 172.21.15.46:0/2940496368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd26c4e850 con 0x55cd26bba3b0 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fe70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fc0cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8008010 tx=0x7fbbc8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f4f2ee4520abdb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbaeffd640 1 -- 172.21.15.46:0/2940496368 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8026040 con 0x55cd26bba3b0 2024-05-09T02:18:37.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbaeffd640 1 -- 172.21.15.46:0/2940496368 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc803a070 con 0x55cd26bba3b0 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.544+0000 7fbbaeffd640 1 -- 172.21.15.46:0/2940496368 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8011df0 con 0x55cd26bba3b0 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2940496368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 msgr2=0x55cd26fc0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fc0cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8008010 tx=0x7fbbc8018000 comp rx=0 tx=0).stop 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2940496368 shutdown_connections 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26be3270 0x55cd26fe70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd26fe6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/2940496368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26bba3b0 0x55cd26fc0cc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2940496368 >> 172.21.15.46:0/2940496368 conn(0x55cd26bd73c0 msgr2=0x55cd26fd1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2940496368 shutdown_connections 2024-05-09T02:18:37.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.545+0000 7fbbda9b7740 1 -- 172.21.15.46:0/2940496368 wait complete. 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.546+0000 7fbbda9b7740 1 -- start start 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.546+0000 7fbbda9b7740 1 Processor -- start 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26bba3b0 0x55cd26fa9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd2700bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 0x55cd27045f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd26fa9f10 con 0x55cd26be3270 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd26fa8c10 con 0x55cd26bba3b0 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55cd26fd3eb0 con 0x55cd26bc2590 2024-05-09T02:18:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbda9b7740 10 client.0 _ll_register_callbacks cb 0x7fbbc80118e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbd20a5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 0x55cd27045f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbd20a5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 0x55cd27045f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38400/0 (socket says 172.21.15.46:38400) 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbd20a5640 1 -- 172.21.15.46:0/620942818 learned_addr learned my addr 172.21.15.46:0/620942818 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26bba3b0 0x55cd26fa9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.547+0000 7fbbd10a3640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd2700bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbd20a5640 1 -- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 msgr2=0x55cd2700bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd2700bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbd20a5640 1 -- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26bba3b0 msgr2=0x55cd26fa9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26bba3b0 0x55cd26fa9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbd20a5640 1 -- 172.21.15.46:0/620942818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd26cc56b0 con 0x55cd26be3270 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbd20a5640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 0x55cd27045f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4034040 tx=0x7fbbc4045660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1cdfd744e77024 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbacff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbacff9640 1 -- 172.21.15.46:0/620942818 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc409a070 con 0x55cd26be3270 2024-05-09T02:18:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbacff9640 1 -- 172.21.15.46:0/620942818 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbbc40807f0 con 0x55cd26be3270 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc803a070 con 0x55cd26be3270 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbacff9640 1 -- 172.21.15.46:0/620942818 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fbbc4080d00 con 0x55cd26be3270 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 10 client.4713 fetch_fsmap learned FSMap version 14 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55cd26ea7630 con 0x55cd26be3270 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbacff9640 1 -- 172.21.15.46:0/620942818 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc803a070 con 0x55cd26be3270 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbacff9640 1 -- 172.21.15.46:0/620942818 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 14) ==== 4128+0+0 (secure 0 0 0) 0x7fbbc407cf00 con 0x55cd26be3270 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 10 client.4713 fetch_fsmap finished waiting for FSMap version 14 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 10 client.4713 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 20 client.4713 populate_metadata read hostname 'smithi046' 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd270439b0 0x55cd26fbb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 4 client.4713 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T02:18:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.548+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 --> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] -- command(tid 0: {"prefix": "status"}) -- 0x55cd26ef2f60 con 0x55cd270439b0 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd270439b0 0x55cd26fbb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbacff9640 10 client.4713 ms_handle_connect on v2:172.21.15.46:6832/268323982 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbd18a4640 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd270439b0 0x55cd26fbb410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9931996629d833d0 server_cookie=4cacc53e92e154d0 in_seq=0 out_seq=0 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbacff9640 1 -- 172.21.15.46:0/620942818 <== mds.0 v2:172.21.15.46:6832/268323982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55cd26ef2f60 con 0x55cd270439b0 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbacff9640 10 client.4713 handle_command_reply: tid=0 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 client.4713 shutdown 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 msgr2=0x55cd27045f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 0x55cd27045f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4034040 tx=0x7fbbc4045660 comp rx=0 tx=0).stop 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 shutdown_connections 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:6832/268323982,v1:172.21.15.46:6833/268323982] conn(0x55cd270439b0 0x55cd26fbb410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd26be3270 0x55cd27045f80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55cd26bc2590 0x55cd2700bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbacff9640 0 client.4713 ms_handle_reset on v2:172.21.15.46:6832/268323982 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 --2- 172.21.15.46:0/620942818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd26bba3b0 0x55cd26fa9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.549+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 >> 172.21.15.46:0/620942818 conn(0x55cd26bd73c0 msgr2=0x55cd26fd43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 shutdown_connections 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbda9b7740 1 -- 172.21.15.46:0/620942818 wait complete. 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbda9b7740 20 client.4713 trim_cache size 0 max 16384 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fbf7bc7e-7778-49a9-881a-45aca90d45c0", 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4288, 2024-05-09T02:18:37.559 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "b", 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 14.345712167, 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 14, 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 25, 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 29.452577648999998 2024-05-09T02:18:37.560 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:18:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbb0076300 msgr2=0x7fbbb0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbb0076300 0x7fbbb0078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0ca4f0 tx=0x7fbbc8008040 comp rx=0 tx=0).stop 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 msgr2=0x7fbbcc0af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 0x7fbbcc0af000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009f40 tx=0x7fbbc4004a40 comp rx=0 tx=0).stop 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 shutdown_connections 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbb0076300 0x7fbbb0078810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbcc155ff0 0x7fbbcc0af000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbcc152cf0 0x7fbbcc0aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 --2- 172.21.15.46:0/352651205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbcc0c62d0 0x7fbbcc0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 >> 172.21.15.46:0/352651205 conn(0x7fbbcc0acec0 msgr2=0x7fbbcc150780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 shutdown_connections 2024-05-09T02:18:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.550+0000 7fbbd3b08640 1 -- 172.21.15.46:0/352651205 wait complete. 2024-05-09T02:18:37.564 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T02:18:37.574 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T02:18:37.574 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T02:18:37.575 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T02:18:37.575 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-09T02:18:37.613 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-09T02:18:37.613 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-05-09T02:18:37.613 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'a'} 2024-05-09T02:18:37.613 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T02:18:37.613 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:37.613 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'b'} 2024-05-09T02:18:37.613 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T02:18:37.613 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:37.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:37.614 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-05-09T02:18:37.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:37.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-05-09T02:18:37.698 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-05-09T02:18:37.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:18:37.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:37.700 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-09T02:18:37.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:37.720 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-09T02:18:37.792 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-05-09T02:18:37.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:18:37.793 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-09T02:18:37.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T02:18:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.906+0000 7f4c0d134640 1 Processor -- start 2024-05-09T02:18:37.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.906+0000 7f4c0d134640 1 -- start start 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0d134640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4c080c96c0 0x7f4c080c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0d134640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 0x7f4c0815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0d134640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c08158ae0 con 0x7f4c08155160 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0d134640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4c08155570 con 0x7f4c080c96c0 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0d134640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c08157ed0 con 0x7f4c0815b3a0 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c06d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4c08155160 0x7f4c080c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42738/0 (socket says 172.21.15.46:42738) 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c06d9d640 1 -- 172.21.15.46:0/1434240111 learned_addr learned my addr 172.21.15.46:0/1434240111 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/1434240111 >> v2:172.21.15.107:3300/0 conn(0x7f4c080c96c0 0x7f4c080c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845953177 0 0) 0x7f4c08158ae0 con 0x7f4c08155160 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0759e640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 0x7f4c0815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.907+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf4003520 con 0x7f4c08155160 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2623975877 0 0) 0x7f4bf4003520 con 0x7f4c08155160 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 msgr2=0x7f4c0815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 0x7f4c0815b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 >> v2:172.21.15.107:3300/0 conn(0x7f4c080c96c0 msgr2=0x7f4c080c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 --2- 172.21.15.46:0/1434240111 >> v2:172.21.15.107:3300/0 conn(0x7f4c080c96c0 0x7f4c080c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081581b0 con 0x7f4c08155160 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f4bf80016f0 con 0x7f4c08155160 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 >> v1:172.21.15.46:6789/0 conn(0x7f4c08155160 legacy=0x7f4c080c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 0x7f4bf4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bf4003fd0 0x7f4bf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 0x7f4bf4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08155570 con 0x7f4bf4003fd0 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08157ed0 con 0x7f4bf4004d40 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf400bc00 con 0x7f4c0815b3a0 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bf4003fd0 0x7f4bf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c06d9d640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 0x7f4bf4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4c0759e640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 0x7f4bf4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4bfe59c640 1 -- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 msgr2=0x7f4bf4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0815b3a0 0x7f4bf4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4bfe59c640 1 -- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 msgr2=0x7f4bf4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 0x7f4bf4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.908+0000 7f4bfe59c640 1 -- 172.21.15.46:0/1434240111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf4003520 con 0x7f4bf4003fd0 2024-05-09T02:18:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.909+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bf4003fd0 0x7f4bf4004800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009a90 tx=0x7f4bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b76e2ed067d9fcd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.909+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0036070 con 0x7f4bf4003fd0 2024-05-09T02:18:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.909+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0031400 con 0x7f4bf4003fd0 2024-05-09T02:18:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.909+0000 7f4c0659c640 1 -- 172.21.15.46:0/1434240111 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0009690 con 0x7f4bf4003fd0 2024-05-09T02:18:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0d134640 1 -- 172.21.15.46:0/1434240111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bf4003fd0 msgr2=0x7f4bf4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0d134640 1 --2- 172.21.15.46:0/1434240111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bf4003fd0 0x7f4bf4004800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009a90 tx=0x7f4bf4005830 comp rx=0 tx=0).stop 2024-05-09T02:18:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0759e640 1 -- 172.21.15.46:0/1434240111 reap_dead start 2024-05-09T02:18:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0d134640 1 -- 172.21.15.46:0/1434240111 shutdown_connections 2024-05-09T02:18:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0d134640 1 -- 172.21.15.46:0/1434240111 >> 172.21.15.46:0/1434240111 conn(0x7f4c080aebe0 msgr2=0x7f4c080aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0d134640 1 -- 172.21.15.46:0/1434240111 shutdown_connections 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.910+0000 7f4c0d134640 1 -- 172.21.15.46:0/1434240111 wait complete. 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.912+0000 7f4c0d134640 1 Processor -- start 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.912+0000 7f4c0d134640 1 -- start start 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4c0d134640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bf4003fd0 0x7f4c08153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4c0d134640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 0x7f4c08159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4c0d134640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c08159a90 0x7f4c081514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4c0d134640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4c080c8670 con 0x7f4c081543f0 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4c0d134640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08158770 con 0x7f4c08159a90 2024-05-09T02:18:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4c0d134640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c08157b30 con 0x7f4bf4003fd0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4bfe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 0x7f4c08159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4bfe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 0x7f4c08159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38428/0 (socket says 172.21.15.46:38428) 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.913+0000 7f4bfe59c640 1 -- 172.21.15.46:0/4054358861 learned_addr learned my addr 172.21.15.46:0/4054358861 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4c06d9d640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bf4003fd0 0x7f4c08153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4c0759e640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c08159a90 0x7f4c081514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfe59c640 1 -- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bf4003fd0 msgr2=0x7f4c08153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bf4003fd0 0x7f4c08153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfe59c640 1 -- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c08159a90 msgr2=0x7f4c081514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c08159a90 0x7f4c081514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfe59c640 1 -- 172.21.15.46:0/4054358861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081548f0 con 0x7f4c081543f0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfe59c640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 0x7f4c08159550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0034040 tx=0x7f4bf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0040020 con 0x7f4c081543f0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0003a40 con 0x7f4c081543f0 2024-05-09T02:18:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c081ee280 con 0x7f4c081543f0 2024-05-09T02:18:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0036040 con 0x7f4c081543f0 2024-05-09T02:18:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.914+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c08159030 con 0x7f4c081543f0 2024-05-09T02:18:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.915+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c08158e60 con 0x7f4c081543f0 2024-05-09T02:18:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.916+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4bf0043020 con 0x7f4c081543f0 2024-05-09T02:18:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.917+0000 7f4bfffff640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4be80762d0 0x7f4be80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.917+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4bf00b79a0 con 0x7f4c081543f0 2024-05-09T02:18:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.917+0000 7f4c06d9d640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4be80762d0 0x7f4be80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.918+0000 7f4c06d9d640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4be80762d0 0x7f4be80787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8001160 tx=0x7f4bf80078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:37.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:37.921+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4bf004a070 con 0x7f4c081543f0 2024-05-09T02:18:38.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.155+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4c081ee780 con 0x7f4c081543f0 2024-05-09T02:18:38.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.156+0000 7f4bfffff640 1 -- 172.21.15.46:0/4054358861 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+116 (secure 0 0 0) 0x7f4c081ee780 con 0x7f4c081543f0 2024-05-09T02:18:38.159 INFO:teuthology.orchestra.run.smithi046.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-05-09T02:18:38.159 INFO:teuthology.orchestra.run.smithi046.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-05-09T02:18:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4be80762d0 msgr2=0x7f4be80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4be80762d0 0x7f4be80787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8001160 tx=0x7f4bf80078f0 comp rx=0 tx=0).stop 2024-05-09T02:18:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 msgr2=0x7f4c08159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 0x7f4c08159550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0034040 tx=0x7f4bf0004730 comp rx=0 tx=0).stop 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 shutdown_connections 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4be80762d0 0x7f4be80787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c08159a90 0x7f4c081514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c081543f0 0x7f4c08159550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 --2- 172.21.15.46:0/4054358861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bf4003fd0 0x7f4c08153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 >> 172.21.15.46:0/4054358861 conn(0x7f4c080aebe0 msgr2=0x7f4c0814ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 shutdown_connections 2024-05-09T02:18:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38.158+0000 7f4c0d134640 1 -- 172.21.15.46:0/4054358861 wait complete. 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-05-09T02:18:38.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T02:18:38.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T02:18:38.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T02:18:38.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:38.174 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-05-09T02:18:38.191 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T02:18:38.191 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T02:18:38.192 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T02:18:38.192 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-05-09T02:18:38.192 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-05-09T02:18:38.192 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-05-09T02:18:38.192 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T02:18:38.193 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:38.193 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-05-09T02:18:38.193 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T02:18:38.193 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:38.193 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-05-09T02:18:38.193 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T02:18:38.194 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:38.194 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-05-09T02:18:38.194 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-09T02:18:38.194 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-05-09T02:18:38.194 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-05-09T02:18:38.195 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-05-09T02:18:38.195 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T02:18:38.195 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:38.195 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-05-09T02:18:38.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T02:18:38.196 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:38.196 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T02:18:38.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-05-09T02:18:38.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-05-09T02:18:38.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-05-09T02:18:38.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T02:18:38.197 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T02:18:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:38.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:38.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:38.400 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T02:18:38.427 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-05-09T02:18:38.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:38.429 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-05-09T02:18:38.496 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-05-09T02:18:38.496 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T02:18:38.496 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-09T02:18:38.496 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-09T02:18:38.496 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T02:18:38.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:38.497 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T02:18:38.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-09T02:18:38.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-09T02:18:38.498 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-09T02:18:38.498 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T02:18:38.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:38.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:38.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:38.803 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-05-09T02:18:38.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:38.820 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-05-09T02:18:38.875 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:38.875 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T02:18:38.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T02:18:38.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T02:18:38.876 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T02:18:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:38.996 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T02:18:38.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T02:18:38.997 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T02:18:39.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:39.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:39.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:39.132 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T02:18:39.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-05-09T02:18:39.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T02:18:39.133 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T02:18:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:39.213 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'a'} 2024-05-09T02:18:39.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T02:18:39.213 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:39.229 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T02:18:39.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T02:18:39.230 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:39.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-05-09T02:18:39.352 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-05-09T02:18:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-05-09T02:18:39.409 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T02:18:39.410 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T02:18:39.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:39.411 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-05-09T02:18:39.467 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T02:18:39.468 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=a) 2024-05-09T02:18:39.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-05-09T02:18:39.536 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T02:18:39.593 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-05-09T02:18:39.594 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T02:18:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T02:18:39.596 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T02:18:39.596 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T02:18:39.596 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-05-09T02:18:39.596 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T02:18:39.596 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T02:18:39.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:39.596 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-05-09T02:18:39.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-05-09T02:18:39.624+0000 7f170c31e480 -1 init, newargv = 0x7f16f0005700 newargc=15 2024-05-09T02:18:39.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[44816]: starting ceph client 2024-05-09T02:18:39.632 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[44816]: starting fuse 2024-05-09T02:18:39.643 INFO:teuthology.orchestra.run.smithi046.stdout:42 2024-05-09T02:18:39.643 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-09T02:18:39.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-05-09T02:18:39.643 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-05-09T02:18:39.643 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-05-09T02:18:39.644 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T02:18:39.645 DEBUG:teuthology.orchestra.run.smithi046:> 2024-05-09T02:18:39.646 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-05-09T02:18:39.646 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-05-09T02:18:39.765 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.44816.asok 2024-05-09T02:18:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:39.775 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44816.asok 2024-05-09T02:18:39.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:39.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44816.asok status 2024-05-09T02:18:39.924 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:18:39.924 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-05-09T02:18:39.924 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "c9da4049f638c0f84bdd9b4e33c42e86046ac554", 2024-05-09T02:18:39.924 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T02:18:39.924 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-05-09T02:18:39.924 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "44816", 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4725, 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4725 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-05-09T02:18:39.925 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3376060952 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3376060952 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4725 192.168.0.1:0/3376060952", 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/3376060952", 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-05-09T02:18:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 8, 2024-05-09T02:18:39.927 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 25, 2024-05-09T02:18:39.927 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-05-09T02:18:39.927 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-05-09T02:18:39.927 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "a" 2024-05-09T02:18:39.927 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:18:39.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T02:18:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.044+0000 7f975c89f640 1 Processor -- start 2024-05-09T02:18:40.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.044+0000 7f975c89f640 1 -- start start 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975c89f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9758140d40 0x7f97580c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975c89f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97581588b0 con 0x7f97580c1e20 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975c89f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975806ed30 con 0x7f97581584a0 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975c89f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f975806f010 con 0x7f9758140d40 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f9756d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f97580c1e20 0x7f97580c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42754/0 (socket says 172.21.15.46:42754) 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f9756d9d640 1 -- 172.21.15.46:0/4083301086 learned_addr learned my addr 172.21.15.46:0/4083301086 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:40.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975659c640 1 --2- 172.21.15.46:0/4083301086 >> v2:172.21.15.107:3300/0 conn(0x7f9758140d40 0x7f97580c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994872427 0 0) 0x7f97581588b0 con 0x7f97580c1e20 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9744003520 con 0x7f97580c1e20 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363219841 0 0) 0x7f975806ed30 con 0x7f97581584a0 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97581588b0 con 0x7f97581584a0 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975659c640 1 -- 172.21.15.46:0/4083301086 >> v1:172.21.15.107:6789/0 conn(0x7f97581584a0 legacy=0x7f975806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975659c640 1 -- 172.21.15.46:0/4083301086 >> v1:172.21.15.46:6789/0 conn(0x7f97580c1e20 legacy=0x7f97580c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.046+0000 7f975659c640 1 -- 172.21.15.46:0/4083301086 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97580c7930 con 0x7f9758140d40 2024-05-09T02:18:40.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.047+0000 7f975659c640 1 --2- 172.21.15.46:0/4083301086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9758140d40 0x7f97580c8410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f97500097a0 tx=0x7f975002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6782775f2ecdd0e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.047+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750037070 con 0x7f9758140d40 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.047+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750032440 con 0x7f9758140d40 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.047+0000 7f975559a640 1 -- 172.21.15.46:0/4083301086 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500327f0 con 0x7f9758140d40 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 -- 172.21.15.46:0/4083301086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9758140d40 msgr2=0x7f97580c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 --2- 172.21.15.46:0/4083301086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9758140d40 0x7f97580c8410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f97500097a0 tx=0x7f975002a1a0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 -- 172.21.15.46:0/4083301086 shutdown_connections 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 --2- 172.21.15.46:0/4083301086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9758140d40 0x7f97580c8410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 -- 172.21.15.46:0/4083301086 >> 172.21.15.46:0/4083301086 conn(0x7f9758068e00 msgr2=0x7f97580c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 -- 172.21.15.46:0/4083301086 shutdown_connections 2024-05-09T02:18:40.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.048+0000 7f975c89f640 1 -- 172.21.15.46:0/4083301086 wait complete. 2024-05-09T02:18:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.050+0000 7f975c89f640 1 Processor -- start 2024-05-09T02:18:40.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.050+0000 7f975c89f640 1 -- start start 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975c89f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580c1e20 0x7f975813b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975c89f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 0x7f97581edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975c89f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581584a0 0x7f9758159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975c89f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f97580c92f0 con 0x7f9758140d40 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975c89f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97580c7ef0 con 0x7f97580c1e20 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975c89f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f97580c9470 con 0x7f97581584a0 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f9755d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 0x7f97581edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:40.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f9755d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 0x7f97581edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38434/0 (socket says 172.21.15.46:38434) 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f9755d9b640 1 -- 172.21.15.46:0/1372446531 learned_addr learned my addr 172.21.15.46:0/1372446531 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f9756d9d640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581584a0 0x7f9758159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.051+0000 7f975659c640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580c1e20 0x7f975813b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f9755d9b640 1 -- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581584a0 msgr2=0x7f9758159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f9755d9b640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581584a0 0x7f9758159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f9755d9b640 1 -- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580c1e20 msgr2=0x7f975813b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f9755d9b640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580c1e20 0x7f975813b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f9755d9b640 1 -- 172.21.15.46:0/1372446531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9758155800 con 0x7f9758140d40 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f9755d9b640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 0x7f97581edc20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f974000c430 tx=0x7f974000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740017070 con 0x7f9758140d40 2024-05-09T02:18:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97400052d0 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97581ee940 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740003830 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.052+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97581f1b10 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.053+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975806a330 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.054+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f974001a070 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.054+0000 7f974effd640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9738076300 0x7f9738078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.054+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9740096c90 con 0x7f9758140d40 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.054+0000 7f975659c640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9738076300 0x7f9738078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.055+0000 7f975659c640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9738076300 0x7f9738078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9750034000 tx=0x7f975002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:40.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.059+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9758155800 con 0x7f9758140d40 2024-05-09T02:18:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.291+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f975815bd90 con 0x7f9758140d40 2024-05-09T02:18:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.292+0000 7f974effd640 1 -- 172.21.15.46:0/1372446531 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+116 (secure 0 0 0) 0x7f9740068230 con 0x7f9758140d40 2024-05-09T02:18:40.295 INFO:teuthology.orchestra.run.smithi046.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-05-09T02:18:40.295 INFO:teuthology.orchestra.run.smithi046.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9738076300 msgr2=0x7f9738078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9738076300 0x7f9738078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9750034000 tx=0x7f975002e000 comp rx=0 tx=0).stop 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 msgr2=0x7f97581edc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 0x7f97581edc20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f974000c430 tx=0x7f974000c8f0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 shutdown_connections 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9738076300 0x7f9738078810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97581584a0 0x7f9758159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9758140d40 0x7f97581edc20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 --2- 172.21.15.46:0/1372446531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97580c1e20 0x7f975813b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 >> 172.21.15.46:0/1372446531 conn(0x7f9758068e00 msgr2=0x7f975813d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 shutdown_connections 2024-05-09T02:18:40.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:40.294+0000 7f975c89f640 1 -- 172.21.15.46:0/1372446531 wait complete. 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T02:18:40.308 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-09T02:18:40.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:40.309 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-05-09T02:18:40.325 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T02:18:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42699sec preferred_lft 42699sec 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-09T02:18:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-09T02:18:40.327 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T02:18:40.328 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-09T02:18:40.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:40.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:40.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:40.589 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T02:18:40.615 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-09T02:18:40.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:40.616 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-05-09T02:18:40.689 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-05-09T02:18:40.689 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T02:18:40.689 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T02:18:40.689 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T02:18:40.689 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T02:18:40.690 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:40.690 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-09T02:18:40.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T02:18:40.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T02:18:40.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T02:18:40.690 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-09T02:18:40.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:40.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:40.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:40.975 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-09T02:18:40.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:40.991 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-05-09T02:18:41.047 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:41.047 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-09T02:18:41.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T02:18:41.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-09T02:18:41.047 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-09T02:18:41.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:41.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:41.165 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-09T02:18:41.166 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-09T02:18:41.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:41.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:41.316 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T02:18:41.316 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-09T02:18:41.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-05-09T02:18:41.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T02:18:41.316 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-09T02:18:41.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T02:18:41.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:41.392 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'b'} 2024-05-09T02:18:41.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T02:18:41.392 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:41.407 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-09T02:18:41.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T02:18:41.408 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:41.463 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-09T02:18:41.528 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-05-09T02:18:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T02:18:41.586 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-4 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-5 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-6 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-7 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T02:18:41.587 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T02:18:41.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:41.588 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-09T02:18:41.644 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T02:18:41.644 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=b) 2024-05-09T02:18:41.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-09T02:18:41.710 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-05-09T02:18:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T02:18:41.767 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-4 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-5 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-6 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph/osd/ceph-7 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T02:18:41.768 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T02:18:41.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:41.769 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-09T02:18:41.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:2024-05-09T02:18:41.783+0000 7f2da9f4e480 -1 init, newargv = 0x7f2d98001250 newargc=15 2024-05-09T02:18:41.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[41829]: starting ceph client 2024-05-09T02:18:41.793 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[41829]: starting fuse 2024-05-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi107.stdout:42 2024-05-09T02:18:41.801 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo stdin-killer -- python3 -c ' 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> import re 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> import os 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-09T02:18:41.802 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> return f 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T02:18:41.803 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-09T02:18:41.804 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.1")) 2024-05-09T02:18:41.804 DEBUG:teuthology.orchestra.run.smithi107:> ' 2024-05-09T02:18:41.919 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.1.41829.asok 2024-05-09T02:18:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-09T02:18:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T02:18:41.930 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41829.asok 2024-05-09T02:18:41.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:41.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41829.asok status 2024-05-09T02:18:42.072 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "c9da4049f638c0f84bdd9b4e33c42e86046ac554", 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "1", 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "41829", 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4526, 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2024-05-09T02:18:42.073 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4526 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 3689268124 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-09T02:18:42.074 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 3689268124 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4526 192.168.0.1:0/3689268124", 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.1:0/3689268124", 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 14, 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 25, 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "b" 2024-05-09T02:18:42.075 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-09T02:18:42.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:42.081 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-05-09T02:18:42.081 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:42.102 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-05-09T02:18:42.102 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:42.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:42.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:42.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:42.174 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2024-05-09T02:18:42.174 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:42.189 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2024-05-09T02:18:42.190 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:42.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:18:42.190 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-09T02:18:42.255 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-05-09T02:18:42.267 INFO:tasks.mds_thrash:mds thrasher using random seed: 1715221122 2024-05-09T02:18:42.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.390+0000 7fd292d27640 1 Processor -- start 2024-05-09T02:18:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.390+0000 7fd292d27640 1 -- start start 2024-05-09T02:18:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd292d27640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd28c155160 0x7fd28c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd292d27640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd28c15b3a0 0x7fd28c15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd292d27640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c158ae0 con 0x7fd28c0c84a0 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd292d27640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c155570 con 0x7fd28c15b3a0 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd292d27640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c157ed0 con 0x7fd28c155160 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd2912c4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd28c15b3a0 0x7fd28c15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd28bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd28c0c84a0 0x7fd28c0c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42768/0 (socket says 172.21.15.46:42768) 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd2912c4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd28c15b3a0 0x7fd28c15b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38436/0 (socket says 172.21.15.46:38436) 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd28bfff640 1 -- 172.21.15.46:0/1110553215 learned_addr learned my addr 172.21.15.46:0/1110553215 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd290ac3640 1 --2- 172.21.15.46:0/1110553215 >> v2:172.21.15.107:3300/0 conn(0x7fd28c155160 0x7fd28c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd2912c4640 1 -- 172.21.15.46:0/1110553215 >> v2:172.21.15.107:3300/0 conn(0x7fd28c155160 msgr2=0x7fd28c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd2912c4640 1 --2- 172.21.15.46:0/1110553215 >> v2:172.21.15.107:3300/0 conn(0x7fd28c155160 0x7fd28c0c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd2912c4640 1 -- 172.21.15.46:0/1110553215 >> v1:172.21.15.46:6789/0 conn(0x7fd28c0c84a0 legacy=0x7fd28c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd28b7fe640 1 -- 172.21.15.46:0/1110553215 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817282719 0 0) 0x7fd28c158ae0 con 0x7fd28c0c84a0 2024-05-09T02:18:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.391+0000 7fd2912c4640 1 -- 172.21.15.46:0/1110553215 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c1581b0 con 0x7fd28c15b3a0 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.392+0000 7fd2912c4640 1 --2- 172.21.15.46:0/1110553215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c15b3a0 0x7fd28c15b7b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd28c08e810 tx=0x7fd28402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791af263cbd50160 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.392+0000 7fd28b7fe640 1 -- 172.21.15.46:0/1110553215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284007740 con 0x7fd28c15b3a0 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.392+0000 7fd28b7fe640 1 -- 172.21.15.46:0/1110553215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2840078e0 con 0x7fd28c15b3a0 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.392+0000 7fd28b7fe640 1 -- 172.21.15.46:0/1110553215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284007cb0 con 0x7fd28c15b3a0 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 -- 172.21.15.46:0/1110553215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c15b3a0 msgr2=0x7fd28c15b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 --2- 172.21.15.46:0/1110553215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c15b3a0 0x7fd28c15b7b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd28c08e810 tx=0x7fd28402a560 comp rx=0 tx=0).stop 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 -- 172.21.15.46:0/1110553215 shutdown_connections 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 --2- 172.21.15.46:0/1110553215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c15b3a0 0x7fd28c15b7b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 --2- 172.21.15.46:0/1110553215 >> v2:172.21.15.107:3300/0 conn(0x7fd28c155160 0x7fd28c0c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 -- 172.21.15.46:0/1110553215 >> 172.21.15.46:0/1110553215 conn(0x7fd28c0aebe0 msgr2=0x7fd28c0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 -- 172.21.15.46:0/1110553215 shutdown_connections 2024-05-09T02:18:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.393+0000 7fd292d27640 1 -- 172.21.15.46:0/1110553215 wait complete. 2024-05-09T02:18:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.395+0000 7fd292d27640 1 Processor -- start 2024-05-09T02:18:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.395+0000 7fd292d27640 1 -- start start 2024-05-09T02:18:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd292d27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 0x7fd28c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd292d27640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd28c155160 0x7fd28c1edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd292d27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd28c15b3a0 0x7fd28c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd292d27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c157b30 con 0x7fd28c0c84a0 2024-05-09T02:18:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd292d27640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c158770 con 0x7fd28c155160 2024-05-09T02:18:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd292d27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c157cb0 con 0x7fd28c15b3a0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd290ac3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 0x7fd28c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd290ac3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 0x7fd28c1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38452/0 (socket says 172.21.15.46:38452) 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd290ac3640 1 -- 172.21.15.46:0/2697949211 learned_addr learned my addr 172.21.15.46:0/2697949211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.396+0000 7fd28bfff640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd28c155160 0x7fd28c1edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd2912c4640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd28c15b3a0 0x7fd28c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd290ac3640 1 -- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd28c15b3a0 msgr2=0x7fd28c14bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd290ac3640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd28c15b3a0 0x7fd28c14bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd290ac3640 1 -- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd28c155160 msgr2=0x7fd28c1edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd290ac3640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd28c155160 0x7fd28c1edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd290ac3640 1 -- 172.21.15.46:0/2697949211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0c5dc0 con 0x7fd28c0c84a0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd290ac3640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 0x7fd28c1598a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00e870 tx=0x7fd27c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c017070 con 0x7fd28c0c84a0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c00ee60 con 0x7fd28c0c84a0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00cb40 con 0x7fd28c0c84a0 2024-05-09T02:18:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c0c60a0 con 0x7fd28c0c84a0 2024-05-09T02:18:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.397+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c0c4600 con 0x7fd28c0c84a0 2024-05-09T02:18:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.398+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c06a330 con 0x7fd28c0c84a0 2024-05-09T02:18:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.399+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd27c01a070 con 0x7fd28c0c84a0 2024-05-09T02:18:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.399+0000 7fd2897fa640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd26c0762d0 0x7fd26c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.400+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd27c097cf0 con 0x7fd28c0c84a0 2024-05-09T02:18:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.400+0000 7fd28bfff640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd26c0762d0 0x7fd26c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.400+0000 7fd28bfff640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd26c0762d0 0x7fd26c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd28c154430 tx=0x7fd274007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.404+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd27c060e40 con 0x7fd28c0c84a0 2024-05-09T02:18:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.595+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd28c0c6e50 con 0x7fd28c0c84a0 2024-05-09T02:18:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.596+0000 7fd2897fa640 1 -- 172.21.15.46:0/2697949211 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7fd27c065140 con 0x7fd28c0c84a0 2024-05-09T02:18:42.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:42.599 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd26c0762d0 msgr2=0x7fd26c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd26c0762d0 0x7fd26c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd28c154430 tx=0x7fd274007de0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 msgr2=0x7fd28c1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 0x7fd28c1598a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00e870 tx=0x7fd27c00ed30 comp rx=0 tx=0).stop 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 shutdown_connections 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd26c0762d0 0x7fd26c0787e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd28c15b3a0 0x7fd28c14bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd28c155160 0x7fd28c1edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 --2- 172.21.15.46:0/2697949211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd28c0c84a0 0x7fd28c1598a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 >> 172.21.15.46:0/2697949211 conn(0x7fd28c0aebe0 msgr2=0x7fd28c0c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 shutdown_connections 2024-05-09T02:18:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.598+0000 7fd292d27640 1 -- 172.21.15.46:0/2697949211 wait complete. 2024-05-09T02:18:42.612 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T02:18:02.515951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-09T02:18:11.443101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-09T02:18:12.479871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-09T02:18:20.332161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-09T02:18:21.534409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T02:18:42.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T02:18:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.727+0000 7f763f50d640 1 Processor -- start 2024-05-09T02:18:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.728+0000 7f763f50d640 1 -- start start 2024-05-09T02:18:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763f50d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76380b1890 0x7f76381550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763f50d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f763806e8b0 0x7f76380c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763f50d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f763806ecc0 con 0x7f763806e4a0 2024-05-09T02:18:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763f50d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f76380c1e30 con 0x7f763806e8b0 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763f50d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7638158820 con 0x7f76380b1890 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f763806e8b0 0x7f76380c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f763806e8b0 0x7f76380c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38464/0 (socket says 172.21.15.46:38464) 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 -- 172.21.15.46:0/1527046199 learned_addr learned my addr 172.21.15.46:0/1527046199 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763d2a9640 1 --2- 172.21.15.46:0/1527046199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76380b1890 0x7f76381550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 -- 172.21.15.46:0/1527046199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76380b1890 msgr2=0x7f76381550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 --2- 172.21.15.46:0/1527046199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76380b1890 0x7f76381550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 -- 172.21.15.46:0/1527046199 >> v1:172.21.15.107:6789/0 conn(0x7f763806e4a0 legacy=0x7f76380c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.729+0000 7f763daaa640 1 -- 172.21.15.46:0/1527046199 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76380c2080 con 0x7f763806e8b0 2024-05-09T02:18:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.730+0000 7f763daaa640 1 --2- 172.21.15.46:0/1527046199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f763806e8b0 0x7f76380c3270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7628009e50 tx=0x7f762802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9121715c116f4c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.730+0000 7f7637fff640 1 -- 172.21.15.46:0/1527046199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628036070 con 0x7f763806e8b0 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.730+0000 7f7637fff640 1 -- 172.21.15.46:0/1527046199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7628031600 con 0x7f763806e8b0 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.730+0000 7f7637fff640 1 -- 172.21.15.46:0/1527046199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280319d0 con 0x7f763806e8b0 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 -- 172.21.15.46:0/1527046199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f763806e8b0 msgr2=0x7f76380c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 --2- 172.21.15.46:0/1527046199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f763806e8b0 0x7f76380c3270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7628009e50 tx=0x7f762802a680 comp rx=0 tx=0).stop 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 -- 172.21.15.46:0/1527046199 shutdown_connections 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 --2- 172.21.15.46:0/1527046199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f763806e8b0 0x7f76380c3270 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 --2- 172.21.15.46:0/1527046199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76380b1890 0x7f76381550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 -- 172.21.15.46:0/1527046199 >> 172.21.15.46:0/1527046199 conn(0x7f7638068e90 msgr2=0x7f76380cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 -- 172.21.15.46:0/1527046199 shutdown_connections 2024-05-09T02:18:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.731+0000 7f763f50d640 1 -- 172.21.15.46:0/1527046199 wait complete. 2024-05-09T02:18:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.733+0000 7f763f50d640 1 Processor -- start 2024-05-09T02:18:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.733+0000 7f763f50d640 1 -- start start 2024-05-09T02:18:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763f50d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f763806e4a0 0x7f763814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763f50d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f763806e8b0 0x7f7638156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763f50d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 0x7f763814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763f50d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f76381555f0 con 0x7f76380b1890 2024-05-09T02:18:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763f50d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f76380c2640 con 0x7f763806e4a0 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763f50d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f76380c37b0 con 0x7f763806e8b0 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763daaa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 0x7f763814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763daaa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 0x7f763814c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38466/0 (socket says 172.21.15.46:38466) 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763daaa640 1 -- 172.21.15.46:0/4059683164 learned_addr learned my addr 172.21.15.46:0/4059683164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763d2a9640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f763806e4a0 0x7f763814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.734+0000 7f763caa8640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f763806e8b0 0x7f7638156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763daaa640 1 -- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f763806e8b0 msgr2=0x7f7638156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763daaa640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f763806e8b0 0x7f7638156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763daaa640 1 -- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f763806e4a0 msgr2=0x7f763814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763daaa640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f763806e4a0 0x7f763814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763daaa640 1 -- 172.21.15.46:0/4059683164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76380cb8b0 con 0x7f76380b1890 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763d2a9640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f763806e4a0 0x7f763814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763daaa640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 0x7f763814c7d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7628009f70 tx=0x7f7628004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628036050 con 0x7f76380b1890 2024-05-09T02:18:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7628042070 con 0x7f76380b1890 2024-05-09T02:18:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76380cbb90 con 0x7f76380b1890 2024-05-09T02:18:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628009510 con 0x7f76380b1890 2024-05-09T02:18:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.735+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76380cc150 con 0x7f76380b1890 2024-05-09T02:18:42.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.736+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763806a330 con 0x7f76380b1890 2024-05-09T02:18:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.737+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7628007bf0 con 0x7f76380b1890 2024-05-09T02:18:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.738+0000 7f7635ffb640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f76240762d0 0x7f76240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.738+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f76280b8800 con 0x7f76380b1890 2024-05-09T02:18:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.738+0000 7f763d2a9640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f76240762d0 0x7f76240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.738+0000 7f763d2a9640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f76240762d0 0x7f76240787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f76380c4c80 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.742+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7628081d90 con 0x7f76380b1890 2024-05-09T02:18:42.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.930+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f76380c6d90 con 0x7f76380b1890 2024-05-09T02:18:42.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.930+0000 7f7635ffb640 1 -- 172.21.15.46:0/4059683164 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f7628081690 con 0x7f76380b1890 2024-05-09T02:18:42.933 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f76240762d0 msgr2=0x7f76240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f76240762d0 0x7f76240787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f76380c4c80 tx=0x7f7630008040 comp rx=0 tx=0).stop 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 msgr2=0x7f763814c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 0x7f763814c7d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7628009f70 tx=0x7f7628004a40 comp rx=0 tx=0).stop 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 shutdown_connections 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f76240762d0 0x7f76240787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76380b1890 0x7f763814c7d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f763806e8b0 0x7f7638156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 --2- 172.21.15.46:0/4059683164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f763806e4a0 0x7f763814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 >> 172.21.15.46:0/4059683164 conn(0x7f7638068e90 msgr2=0x7f7638151000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 shutdown_connections 2024-05-09T02:18:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:42.932+0000 7f763f50d640 1 -- 172.21.15.46:0/4059683164 wait complete. 2024-05-09T02:18:42.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-09T02:18:43.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.061+0000 7fd1a26d1640 1 Processor -- start 2024-05-09T02:18:43.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.061+0000 7fd1a26d1640 1 -- start start 2024-05-09T02:18:43.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a26d1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd19c0c80f0 0x7fd19c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a26d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd19c0cd520 0x7fd19c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a26d1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd19c157b10 con 0x7fd19c155060 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a26d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd19c157e10 con 0x7fd19c0cd520 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a26d1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd19c1589b0 con 0x7fd19c0c80f0 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd19c0cd520 0x7fd19c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd19c0cd520 0x7fd19c0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38468/0 (socket says 172.21.15.46:38468) 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd19b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd19c155060 0x7fd19c1582a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42774/0 (socket says 172.21.15.46:42774) 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/2831826490 learned_addr learned my addr 172.21.15.46:0/2831826490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd19bfff640 1 --2- 172.21.15.46:0/2831826490 >> v2:172.21.15.107:3300/0 conn(0x7fd19c0c80f0 0x7fd19c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/2831826490 >> v2:172.21.15.107:3300/0 conn(0x7fd19c0c80f0 msgr2=0x7fd19c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 --2- 172.21.15.46:0/2831826490 >> v2:172.21.15.107:3300/0 conn(0x7fd19c0c80f0 0x7fd19c15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/2831826490 >> v1:172.21.15.46:6789/0 conn(0x7fd19c155060 legacy=0x7fd19c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/2831826490 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c15b7c0 con 0x7fd19c0cd520 2024-05-09T02:18:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd19affd640 1 -- 172.21.15.46:0/2831826490 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723100908 0 0) 0x7fd19c157b10 con 0x7fd19c155060 2024-05-09T02:18:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.062+0000 7fd19bfff640 1 --2- 172.21.15.46:0/2831826490 >> v2:172.21.15.107:3300/0 conn(0x7fd19c0c80f0 0x7fd19c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.063+0000 7fd1a0c6e640 1 --2- 172.21.15.46:0/2831826490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c0cd520 0x7fd19c0cd930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0c9860 tx=0x7fd19402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5e6837a0a199ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.063+0000 7fd19affd640 1 -- 172.21.15.46:0/2831826490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194036070 con 0x7fd19c0cd520 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.063+0000 7fd19affd640 1 -- 172.21.15.46:0/2831826490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd194031600 con 0x7fd19c0cd520 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.063+0000 7fd19affd640 1 -- 172.21.15.46:0/2831826490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940319d0 con 0x7fd19c0cd520 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 -- 172.21.15.46:0/2831826490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c0cd520 msgr2=0x7fd19c0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/2831826490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c0cd520 0x7fd19c0cd930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0c9860 tx=0x7fd19402a610 comp rx=0 tx=0).stop 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 -- 172.21.15.46:0/2831826490 shutdown_connections 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/2831826490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c0cd520 0x7fd19c0cd930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/2831826490 >> v2:172.21.15.107:3300/0 conn(0x7fd19c0c80f0 0x7fd19c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 -- 172.21.15.46:0/2831826490 >> 172.21.15.46:0/2831826490 conn(0x7fd19c0aefc0 msgr2=0x7fd19c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 -- 172.21.15.46:0/2831826490 shutdown_connections 2024-05-09T02:18:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.064+0000 7fd1a26d1640 1 -- 172.21.15.46:0/2831826490 wait complete. 2024-05-09T02:18:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.066+0000 7fd1a26d1640 1 Processor -- start 2024-05-09T02:18:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.066+0000 7fd1a26d1640 1 -- start start 2024-05-09T02:18:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a26d1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19c0c80f0 0x7fd19c1e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a26d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19c0cd520 0x7fd19c0ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a26d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 0x7fd19c1e3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a26d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c15bd80 con 0x7fd19c155060 2024-05-09T02:18:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a26d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c15b4b0 con 0x7fd19c0cd520 2024-05-09T02:18:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a26d1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd19c155470 con 0x7fd19c0c80f0 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a0c6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 0x7fd19c1e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a0c6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 0x7fd19c1e3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38482/0 (socket says 172.21.15.46:38482) 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/1967935316 learned_addr learned my addr 172.21.15.46:0/1967935316 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd19b7fe640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19c0cd520 0x7fd19c0ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.067+0000 7fd19bfff640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19c0c80f0 0x7fd19c1e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19c0c80f0 msgr2=0x7fd19c1e0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a0c6e640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19c0c80f0 0x7fd19c1e0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19c0cd520 msgr2=0x7fd19c0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a0c6e640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19c0cd520 0x7fd19c0ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a0c6e640 1 -- 172.21.15.46:0/1967935316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c0b16d0 con 0x7fd19c155060 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a0c6e640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 0x7fd19c1e3be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd194009f40 tx=0x7fd194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194041020 con 0x7fd19c155060 2024-05-09T02:18:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd194037040 con 0x7fd19c155060 2024-05-09T02:18:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c1f1ec0 con 0x7fd19c155060 2024-05-09T02:18:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194036050 con 0x7fd19c155060 2024-05-09T02:18:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.068+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c0ae310 con 0x7fd19c155060 2024-05-09T02:18:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.069+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd19c06a330 con 0x7fd19c155060 2024-05-09T02:18:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.070+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd194007c70 con 0x7fd19c155060 2024-05-09T02:18:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.070+0000 7fd198ff9640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1880762d0 0x7fd1880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.071+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd1940b7fd0 con 0x7fd19c155060 2024-05-09T02:18:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.071+0000 7fd19bfff640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1880762d0 0x7fd1880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.071+0000 7fd19bfff640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1880762d0 0x7fd1880787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd18c006fd0 tx=0x7fd18c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.076+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd19404b060 con 0x7fd19c155060 2024-05-09T02:18:43.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.267+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fd19c0ae580 con 0x7fd19c155060 2024-05-09T02:18:43.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.267+0000 7fd198ff9640 1 -- 172.21.15.46:0/1967935316 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7fd194080fa0 con 0x7fd19c155060 2024-05-09T02:18:43.270 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-05-09T02:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1880762d0 msgr2=0x7fd1880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1880762d0 0x7fd1880787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd18c006fd0 tx=0x7fd18c008040 comp rx=0 tx=0).stop 2024-05-09T02:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 msgr2=0x7fd19c1e3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 0x7fd19c1e3be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd194009f40 tx=0x7fd194004a40 comp rx=0 tx=0).stop 2024-05-09T02:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 shutdown_connections 2024-05-09T02:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1880762d0 0x7fd1880787e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd19c155060 0x7fd19c1e3be0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd19c0cd520 0x7fd19c0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 --2- 172.21.15.46:0/1967935316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd19c0c80f0 0x7fd19c1e0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.269+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 >> 172.21.15.46:0/1967935316 conn(0x7fd19c0aefc0 msgr2=0x7fd19c154530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.270+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 shutdown_connections 2024-05-09T02:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.270+0000 7fd1a26d1640 1 -- 172.21.15.46:0/1967935316 wait complete. 2024-05-09T02:18:43.284 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-09T02:18:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.399+0000 7f5676e0d640 1 Processor -- start 2024-05-09T02:18:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.399+0000 7f5676e0d640 1 -- start start 2024-05-09T02:18:43.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f5676e0d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5670152f10 0x7f5670071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f5676e0d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5670158d40 0x7f5670159150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f5676e0d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56700c9670 con 0x7f56700c5bb0 2024-05-09T02:18:43.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f5676e0d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f56700c9f60 con 0x7f5670158d40 2024-05-09T02:18:43.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f5676e0d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f56700ca3f0 con 0x7f5670152f10 2024-05-09T02:18:43.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f56753aa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5670158d40 0x7f5670159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f56753aa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5670158d40 0x7f5670159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38498/0 (socket says 172.21.15.46:38498) 2024-05-09T02:18:43.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f56753aa640 1 -- 172.21.15.46:0/3751191345 learned_addr learned my addr 172.21.15.46:0/3751191345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:43.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.400+0000 7f5674ba9640 1 --2- 172.21.15.46:0/3751191345 >> v2:172.21.15.107:3300/0 conn(0x7f5670152f10 0x7f5670071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.401+0000 7f56753aa640 1 -- 172.21.15.46:0/3751191345 >> v2:172.21.15.107:3300/0 conn(0x7f5670152f10 msgr2=0x7f5670071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.401+0000 7f56753aa640 1 --2- 172.21.15.46:0/3751191345 >> v2:172.21.15.107:3300/0 conn(0x7f5670152f10 0x7f5670071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.401+0000 7f56753aa640 1 -- 172.21.15.46:0/3751191345 >> v1:172.21.15.107:6789/0 conn(0x7f56700c5bb0 legacy=0x7f56700c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.401+0000 7f56753aa640 1 -- 172.21.15.46:0/3751191345 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56700c9910 con 0x7f5670158d40 2024-05-09T02:18:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.401+0000 7f56753aa640 1 --2- 172.21.15.46:0/3751191345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670158d40 0x7f5670159150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56700ca660 tx=0x7f566802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586090a5f5f0233c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f56677fe640 1 -- 172.21.15.46:0/3751191345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668037070 con 0x7f5670158d40 2024-05-09T02:18:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f56677fe640 1 -- 172.21.15.46:0/3751191345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5668032440 con 0x7f5670158d40 2024-05-09T02:18:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f56677fe640 1 -- 172.21.15.46:0/3751191345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668032810 con 0x7f5670158d40 2024-05-09T02:18:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 -- 172.21.15.46:0/3751191345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670158d40 msgr2=0x7f5670159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3751191345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670158d40 0x7f5670159150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56700ca660 tx=0x7f566802a270 comp rx=0 tx=0).stop 2024-05-09T02:18:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 -- 172.21.15.46:0/3751191345 shutdown_connections 2024-05-09T02:18:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3751191345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670158d40 0x7f5670159150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3751191345 >> v2:172.21.15.107:3300/0 conn(0x7f5670152f10 0x7f5670071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 -- 172.21.15.46:0/3751191345 >> 172.21.15.46:0/3751191345 conn(0x7f56700ad060 msgr2=0x7f56700c7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 -- 172.21.15.46:0/3751191345 shutdown_connections 2024-05-09T02:18:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.402+0000 7f5676e0d640 1 -- 172.21.15.46:0/3751191345 wait complete. 2024-05-09T02:18:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.404+0000 7f5676e0d640 1 Processor -- start 2024-05-09T02:18:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.404+0000 7f5676e0d640 1 -- start start 2024-05-09T02:18:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.405+0000 7f5676e0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56700c5bb0 0x7f56701551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.405+0000 7f5676e0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 0x7f56701ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.405+0000 7f5676e0d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5670158d40 0x7f567014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.405+0000 7f5676e0d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5670159c10 con 0x7f5670152f10 2024-05-09T02:18:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.405+0000 7f5676e0d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f56700aa6e0 con 0x7f56700c5bb0 2024-05-09T02:18:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.405+0000 7f5676e0d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5670159690 con 0x7f5670158d40 2024-05-09T02:18:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 0x7f56701ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 0x7f56701ef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38504/0 (socket says 172.21.15.46:38504) 2024-05-09T02:18:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 -- 172.21.15.46:0/3885017973 learned_addr learned my addr 172.21.15.46:0/3885017973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5674ba9640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56700c5bb0 0x7f56701551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f56753aa640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5670158d40 0x7f567014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 -- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5670158d40 msgr2=0x7f567014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5670158d40 0x7f567014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 -- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56700c5bb0 msgr2=0x7f56701551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56700c5bb0 0x7f56701551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 -- 172.21.15.46:0/3885017973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56701572d0 con 0x7f5670152f10 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5674ba9640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56700c5bb0 0x7f56701551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5667fff640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 0x7f56701ef780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f566000c3d0 tx=0x7f566000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660017070 con 0x7f5670152f10 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56600052d0 con 0x7f5670152f10 2024-05-09T02:18:43.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56701eca90 con 0x7f5670152f10 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660003830 con 0x7f5670152f10 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.406+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56700b0cf0 con 0x7f5670152f10 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.407+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5670158b60 con 0x7f5670152f10 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.408+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f566001a070 con 0x7f5670152f10 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.409+0000 7f56657fa640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f565c076300 0x7f565c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.409+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f5660096b30 con 0x7f5670152f10 2024-05-09T02:18:43.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.409+0000 7f5674ba9640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f565c076300 0x7f565c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.409+0000 7f5674ba9640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f565c076300 0x7f565c078810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f566c009fd0 tx=0x7f566c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.413+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5670158b60 con 0x7f5670152f10 2024-05-09T02:18:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.603+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f567006a330 con 0x7f5670152f10 2024-05-09T02:18:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.603+0000 7f56657fa640 1 -- 172.21.15.46:0/3885017973 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7f56600681e0 con 0x7f5670152f10 2024-05-09T02:18:43.607 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-05-09T02:18:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f565c076300 msgr2=0x7f565c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f565c076300 0x7f565c078810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f566c009fd0 tx=0x7f566c00b040 comp rx=0 tx=0).stop 2024-05-09T02:18:43.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 msgr2=0x7f56701ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 0x7f56701ef780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f566000c3d0 tx=0x7f566000c890 comp rx=0 tx=0).stop 2024-05-09T02:18:43.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 shutdown_connections 2024-05-09T02:18:43.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f565c076300 0x7f565c078810 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5670158d40 0x7f567014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670152f10 0x7f56701ef780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 --2- 172.21.15.46:0/3885017973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56700c5bb0 0x7f56701551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 >> 172.21.15.46:0/3885017973 conn(0x7f56700ad060 msgr2=0x7f5670158050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:43.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 shutdown_connections 2024-05-09T02:18:43.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.606+0000 7f5676e0d640 1 -- 172.21.15.46:0/3885017973 wait complete. 2024-05-09T02:18:43.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-09T02:18:43.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.735+0000 7fbdbcaa7640 1 Processor -- start 2024-05-09T02:18:43.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.735+0000 7fbdbcaa7640 1 -- start start 2024-05-09T02:18:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdbcaa7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbdb8070860 0x7fbdb8154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdbcaa7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb8157a70 con 0x7fbdb8158630 2024-05-09T02:18:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdbcaa7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb8070c70 con 0x7fbdb80c9b30 2024-05-09T02:18:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdbcaa7640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb81553f0 con 0x7fbdb8070860 2024-05-09T02:18:43.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdb659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbdb8070860 0x7fbdb8154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdb659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbdb8070860 0x7fbdb8154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38516/0 (socket says 172.21.15.46:38516) 2024-05-09T02:18:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdb6d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbdb8158630 0x7fbdb81622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42784/0 (socket says 172.21.15.46:42784) 2024-05-09T02:18:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.736+0000 7fbdb659c640 1 -- 172.21.15.46:0/2995299939 learned_addr learned my addr 172.21.15.46:0/2995299939 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.737+0000 7fbdb659c640 1 -- 172.21.15.46:0/2995299939 >> v1:172.21.15.107:6789/0 conn(0x7fbdb80c9b30 legacy=0x7fbdb8157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.737+0000 7fbdb659c640 1 -- 172.21.15.46:0/2995299939 >> v1:172.21.15.46:6789/0 conn(0x7fbdb8158630 legacy=0x7fbdb81622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.737+0000 7fbdb659c640 1 -- 172.21.15.46:0/2995299939 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb8071420 con 0x7fbdb8070860 2024-05-09T02:18:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.737+0000 7fbdb559a640 1 -- 172.21.15.46:0/2995299939 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233119363 0 0) 0x7fbdb8157a70 con 0x7fbdb8158630 2024-05-09T02:18:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.737+0000 7fbdb659c640 1 --2- 172.21.15.46:0/2995299939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb8070860 0x7fbdb8154eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbda80098a0 tx=0x7fbda802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e246e475b1ccbc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdb559a640 1 -- 172.21.15.46:0/2995299939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8037070 con 0x7fbdb8070860 2024-05-09T02:18:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdb559a640 1 -- 172.21.15.46:0/2995299939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8032440 con 0x7fbdb8070860 2024-05-09T02:18:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdb559a640 1 -- 172.21.15.46:0/2995299939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8032810 con 0x7fbdb8070860 2024-05-09T02:18:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2995299939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb8070860 msgr2=0x7fbdb8154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2995299939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb8070860 0x7fbdb8154eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbda80098a0 tx=0x7fbda802a210 comp rx=0 tx=0).stop 2024-05-09T02:18:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2995299939 shutdown_connections 2024-05-09T02:18:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2995299939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb8070860 0x7fbdb8154eb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2995299939 >> 172.21.15.46:0/2995299939 conn(0x7fbdb806d7d0 msgr2=0x7fbdb806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2995299939 shutdown_connections 2024-05-09T02:18:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.738+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2995299939 wait complete. 2024-05-09T02:18:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.740+0000 7fbdbcaa7640 1 Processor -- start 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.740+0000 7fbdbcaa7640 1 -- start start 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.741+0000 7fbdbcaa7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdb8070860 0x7fbdb81edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.741+0000 7fbdbcaa7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 0x7fbdb8149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.741+0000 7fbdbcaa7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdb8158630 0x7fbdb81e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.741+0000 7fbdbcaa7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80716c0 con 0x7fbdb80c9b30 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.741+0000 7fbdbcaa7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80c33c0 con 0x7fbdb8158630 2024-05-09T02:18:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.741+0000 7fbdbcaa7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb80719a0 con 0x7fbdb8070860 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 0x7fbdb8149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 0x7fbdb8149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38526/0 (socket says 172.21.15.46:38526) 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 -- 172.21.15.46:0/2029858326 learned_addr learned my addr 172.21.15.46:0/2029858326 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb6d9d640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdb8158630 0x7fbdb81e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb659c640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdb8070860 0x7fbdb81edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 -- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdb8070860 msgr2=0x7fbdb81edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdb8070860 0x7fbdb81edb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 -- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdb8158630 msgr2=0x7fbdb81e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdb8158630 0x7fbdb81e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 -- 172.21.15.46:0/2029858326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb8155780 con 0x7fbdb80c9b30 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdb5d9b640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 0x7fbdb8149fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c460 tx=0x7fbdac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0052d0 con 0x7fbdb80c9b30 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac005470 con 0x7fbdb80c9b30 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb814b3d0 con 0x7fbdb80c9b30 2024-05-09T02:18:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac012870 con 0x7fbdb80c9b30 2024-05-09T02:18:43.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.742+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb81ee120 con 0x7fbdb80c9b30 2024-05-09T02:18:43.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.743+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb806a330 con 0x7fbdb80c9b30 2024-05-09T02:18:43.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.744+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbdac012a10 con 0x7fbdb80c9b30 2024-05-09T02:18:43.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.745+0000 7fbda6ffd640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd98076300 0x7fbd98078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:43.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.745+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbdac097cb0 con 0x7fbdb80c9b30 2024-05-09T02:18:43.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.745+0000 7fbdb659c640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd98076300 0x7fbd98078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:43.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.746+0000 7fbdb659c640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd98076300 0x7fbd98078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbda8034000 tx=0x7fbda802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:43.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.748+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbdac060e00 con 0x7fbdb80c9b30 2024-05-09T02:18:43.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.940+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fbdb806e0a0 con 0x7fbdb80c9b30 2024-05-09T02:18:43.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.940+0000 7fbda6ffd640 1 -- 172.21.15.46:0/2029858326 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7fbdac065100 con 0x7fbdb80c9b30 2024-05-09T02:18:43.944 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-05-09T02:18:43.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd98076300 msgr2=0x7fbd98078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd98076300 0x7fbd98078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbda8034000 tx=0x7fbda802e000 comp rx=0 tx=0).stop 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 msgr2=0x7fbdb8149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 0x7fbdb8149fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c460 tx=0x7fbdac00c920 comp rx=0 tx=0).stop 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 shutdown_connections 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd98076300 0x7fbd98078810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbdb8158630 0x7fbdb81e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb80c9b30 0x7fbdb8149fd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 --2- 172.21.15.46:0/2029858326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbdb8070860 0x7fbdb81edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:43.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 >> 172.21.15.46:0/2029858326 conn(0x7fbdb806d7d0 msgr2=0x7fbdb814d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:43.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 shutdown_connections 2024-05-09T02:18:43.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:43.942+0000 7fbdbcaa7640 1 -- 172.21.15.46:0/2029858326 wait complete. 2024-05-09T02:18:43.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-09T02:18:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.072+0000 7fae16d34640 1 Processor -- start 2024-05-09T02:18:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.072+0000 7fae16d34640 1 -- start start 2024-05-09T02:18:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae16d34640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae101584f0 0x7fae100c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae16d34640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae100c8e40 con 0x7fae100c9230 2024-05-09T02:18:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae16d34640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1015b100 con 0x7fae100c3d60 2024-05-09T02:18:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae16d34640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fae1015bd10 con 0x7fae101584f0 2024-05-09T02:18:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae14ad0640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fae100c9230 0x7fae1006e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42794/0 (socket says 172.21.15.46:42794) 2024-05-09T02:18:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae14ad0640 1 -- 172.21.15.46:0/471632909 learned_addr learned my addr 172.21.15.46:0/471632909 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae152d1640 1 --2- 172.21.15.46:0/471632909 >> v2:172.21.15.107:3300/0 conn(0x7fae101584f0 0x7fae100c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858859832 0 0) 0x7fae100c8e40 con 0x7fae100c9230 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadf8003520 con 0x7fae100c9230 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280791772 0 0) 0x7fae1015b100 con 0x7fae100c3d60 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae100c8e40 con 0x7fae100c3d60 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae152d1640 1 -- 172.21.15.46:0/471632909 >> v1:172.21.15.107:6789/0 conn(0x7fae100c3d60 legacy=0x7fae100c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae152d1640 1 -- 172.21.15.46:0/471632909 >> v1:172.21.15.46:6789/0 conn(0x7fae100c9230 legacy=0x7fae1006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.074+0000 7fae152d1640 1 -- 172.21.15.46:0/471632909 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1015b3e0 con 0x7fae101584f0 2024-05-09T02:18:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.075+0000 7fae152d1640 1 --2- 172.21.15.46:0/471632909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae101584f0 0x7fae100c2cb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae08009d90 tx=0x7fae0802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e924af0d2ad2cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.075+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08007740 con 0x7fae101584f0 2024-05-09T02:18:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.075+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae080078e0 con 0x7fae101584f0 2024-05-09T02:18:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.075+0000 7fae0f7fe640 1 -- 172.21.15.46:0/471632909 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08007c90 con 0x7fae101584f0 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 -- 172.21.15.46:0/471632909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae101584f0 msgr2=0x7fae100c2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 --2- 172.21.15.46:0/471632909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae101584f0 0x7fae100c2cb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae08009d90 tx=0x7fae0802a660 comp rx=0 tx=0).stop 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 -- 172.21.15.46:0/471632909 shutdown_connections 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 --2- 172.21.15.46:0/471632909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae101584f0 0x7fae100c2cb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 -- 172.21.15.46:0/471632909 >> 172.21.15.46:0/471632909 conn(0x7fae100ccec0 msgr2=0x7fae100cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 -- 172.21.15.46:0/471632909 shutdown_connections 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.076+0000 7fae16d34640 1 -- 172.21.15.46:0/471632909 wait complete. 2024-05-09T02:18:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.078+0000 7fae16d34640 1 Processor -- start 2024-05-09T02:18:44.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.078+0000 7fae16d34640 1 -- start start 2024-05-09T02:18:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae16d34640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 0x7fae101e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae16d34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae100c9230 0x7fae100b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae16d34640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae101584f0 0x7fae10151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae16d34640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae100c31f0 con 0x7fae100c3d60 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae16d34640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae1015b9a0 con 0x7fae100c9230 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae16d34640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae10158900 con 0x7fae101584f0 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae14ad0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 0x7fae101e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae14ad0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 0x7fae101e45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38542/0 (socket says 172.21.15.46:38542) 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae14ad0640 1 -- 172.21.15.46:0/160247208 learned_addr learned my addr 172.21.15.46:0/160247208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae0ffff640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae100c9230 0x7fae100b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.079+0000 7fae152d1640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae101584f0 0x7fae10151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae14ad0640 1 -- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae101584f0 msgr2=0x7fae10151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae14ad0640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae101584f0 0x7fae10151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae14ad0640 1 -- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae100c9230 msgr2=0x7fae100b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae14ad0640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae100c9230 0x7fae100b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae14ad0640 1 -- 172.21.15.46:0/160247208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae101f22a0 con 0x7fae100c3d60 2024-05-09T02:18:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae14ad0640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 0x7fae101e45c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae0000c430 tx=0x7fae0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00017070 con 0x7fae100c3d60 2024-05-09T02:18:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00005ce0 con 0x7fae100c3d60 2024-05-09T02:18:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae101f14e0 con 0x7fae100c3d60 2024-05-09T02:18:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae000072f0 con 0x7fae100c3d60 2024-05-09T02:18:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.080+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae101f1aa0 con 0x7fae100c3d60 2024-05-09T02:18:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.081+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1006a330 con 0x7fae100c3d60 2024-05-09T02:18:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.082+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae0001a070 con 0x7fae100c3d60 2024-05-09T02:18:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.082+0000 7fae0d7fa640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fadfc076300 0x7fadfc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.082+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fae00096bb0 con 0x7fae100c3d60 2024-05-09T02:18:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.082+0000 7fae0ffff640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fadfc076300 0x7fadfc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.083+0000 7fae0ffff640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fadfc076300 0x7fadfc078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae101ebbf0 tx=0x7fae04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.087+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fae0005fba0 con 0x7fae100c3d60 2024-05-09T02:18:44.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.278+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fae100c9010 con 0x7fae100c3d60 2024-05-09T02:18:44.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.278+0000 7fae0d7fa640 1 -- 172.21.15.46:0/160247208 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7fae00063ea0 con 0x7fae100c3d60 2024-05-09T02:18:44.281 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fadfc076300 msgr2=0x7fadfc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fadfc076300 0x7fadfc078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae101ebbf0 tx=0x7fae04009040 comp rx=0 tx=0).stop 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 msgr2=0x7fae101e45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 0x7fae101e45c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae0000c430 tx=0x7fae0000c8f0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 shutdown_connections 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fadfc076300 0x7fadfc078810 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae101584f0 0x7fae10151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae100c9230 0x7fae100b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 --2- 172.21.15.46:0/160247208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae100c3d60 0x7fae101e45c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 >> 172.21.15.46:0/160247208 conn(0x7fae100ccec0 msgr2=0x7fae10076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 shutdown_connections 2024-05-09T02:18:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.281+0000 7fae16d34640 1 -- 172.21.15.46:0/160247208 wait complete. 2024-05-09T02:18:44.294 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-05-09T02:18:44.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.406+0000 7f6453906640 1 Processor -- start 2024-05-09T02:18:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.406+0000 7f6453906640 1 -- start start 2024-05-09T02:18:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.407+0000 7f6453906640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f644c06f470 0x7f644c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.407+0000 7f6453906640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c0c43b0 0x7f644c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.407+0000 7f6453906640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f644c15b6b0 0x7f644c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.407+0000 7f6453906640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f644c0701d0 con 0x7f644c15b6b0 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.407+0000 7f6453906640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f644c06f930 con 0x7f644c06f470 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.407+0000 7f6453906640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f644c06fc10 con 0x7f644c0c43b0 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f644c15b6b0 0x7f644c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f644c15b6b0 0x7f644c15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38558/0 (socket says 172.21.15.46:38558) 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 -- 172.21.15.46:0/186338900 learned_addr learned my addr 172.21.15.46:0/186338900 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f64516a2640 1 --2- 172.21.15.46:0/186338900 >> v2:172.21.15.107:3300/0 conn(0x7f644c06f470 0x7f644c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6450ea1640 1 --2- 172.21.15.46:0/186338900 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c0c43b0 0x7f644c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 -- 172.21.15.46:0/186338900 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c0c43b0 msgr2=0x7f644c157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 --2- 172.21.15.46:0/186338900 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c0c43b0 0x7f644c157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 -- 172.21.15.46:0/186338900 >> v2:172.21.15.107:3300/0 conn(0x7f644c06f470 msgr2=0x7f644c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 --2- 172.21.15.46:0/186338900 >> v2:172.21.15.107:3300/0 conn(0x7f644c06f470 0x7f644c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.408+0000 7f6451ea3640 1 -- 172.21.15.46:0/186338900 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c06fef0 con 0x7f644c15b6b0 2024-05-09T02:18:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.409+0000 7f6451ea3640 1 --2- 172.21.15.46:0/186338900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c15b6b0 0x7f644c15bac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f644c0c3a10 tx=0x7f643c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2d79e8f68bffb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.409+0000 7f644bfff640 1 -- 172.21.15.46:0/186338900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c036070 con 0x7f644c15b6b0 2024-05-09T02:18:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.409+0000 7f644bfff640 1 -- 172.21.15.46:0/186338900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c031600 con 0x7f644c15b6b0 2024-05-09T02:18:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.409+0000 7f644bfff640 1 -- 172.21.15.46:0/186338900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c0319d0 con 0x7f644c15b6b0 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 -- 172.21.15.46:0/186338900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c15b6b0 msgr2=0x7f644c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 --2- 172.21.15.46:0/186338900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c15b6b0 0x7f644c15bac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f644c0c3a10 tx=0x7f643c02a6a0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 -- 172.21.15.46:0/186338900 shutdown_connections 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 --2- 172.21.15.46:0/186338900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c15b6b0 0x7f644c15bac0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 --2- 172.21.15.46:0/186338900 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c0c43b0 0x7f644c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 --2- 172.21.15.46:0/186338900 >> v2:172.21.15.107:3300/0 conn(0x7f644c06f470 0x7f644c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 -- 172.21.15.46:0/186338900 >> 172.21.15.46:0/186338900 conn(0x7f644c0733f0 msgr2=0x7f644c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 -- 172.21.15.46:0/186338900 shutdown_connections 2024-05-09T02:18:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.410+0000 7f6453906640 1 -- 172.21.15.46:0/186338900 wait complete. 2024-05-09T02:18:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.411+0000 7f6453906640 1 Processor -- start 2024-05-09T02:18:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.411+0000 7f6453906640 1 -- start start 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 0x7f644c14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c15b6b0 0x7f644c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f644c156f40 0x7f644c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0710f0 con 0x7f644c0c43b0 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f644c070f70 con 0x7f644c156f40 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f644c06d6d0 con 0x7f644c15b6b0 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 0x7f644c14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 0x7f644c14d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38562/0 (socket says 172.21.15.46:38562) 2024-05-09T02:18:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 -- 172.21.15.46:0/4280994838 learned_addr learned my addr 172.21.15.46:0/4280994838 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6450ea1640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c15b6b0 0x7f644c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6451ea3640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f644c156f40 0x7f644c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 -- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c15b6b0 msgr2=0x7f644c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c15b6b0 0x7f644c156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 -- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f644c156f40 msgr2=0x7f644c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f644c156f40 0x7f644c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 -- 172.21.15.46:0/4280994838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c14e600 con 0x7f644c0c43b0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f64516a2640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 0x7f644c14d450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f644400e870 tx=0x7f644400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444017070 con 0x7f644c0c43b0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644400c940 con 0x7f644c0c43b0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644400cd10 con 0x7f644c0c43b0 2024-05-09T02:18:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.413+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c157460 con 0x7f644c0c43b0 2024-05-09T02:18:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.414+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c155f20 con 0x7f644c0c43b0 2024-05-09T02:18:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.415+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c06a330 con 0x7f644c0c43b0 2024-05-09T02:18:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.415+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f644401a070 con 0x7f644c0c43b0 2024-05-09T02:18:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.416+0000 7f6449ffb640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64380762d0 0x7f64380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.416+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6444097700 con 0x7f644c0c43b0 2024-05-09T02:18:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.416+0000 7f6450ea1640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64380762d0 0x7f64380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.417+0000 7f6450ea1640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64380762d0 0x7f64380787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f644c15bc10 tx=0x7f6440009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.421+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64440606e0 con 0x7f644c0c43b0 2024-05-09T02:18:44.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.649+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f644c0c5710 con 0x7f644c0c43b0 2024-05-09T02:18:44.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.650+0000 7f6449ffb640 1 -- 172.21.15.46:0/4280994838 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f64440649e0 con 0x7f644c0c43b0 2024-05-09T02:18:44.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:44.653 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:44.653 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64380762d0 msgr2=0x7f64380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64380762d0 0x7f64380787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f644c15bc10 tx=0x7f6440009190 comp rx=0 tx=0).stop 2024-05-09T02:18:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 msgr2=0x7f644c14d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 0x7f644c14d450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f644400e870 tx=0x7f644400ed30 comp rx=0 tx=0).stop 2024-05-09T02:18:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 shutdown_connections 2024-05-09T02:18:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64380762d0 0x7f64380787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f644c156f40 0x7f644c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f644c15b6b0 0x7f644c156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 --2- 172.21.15.46:0/4280994838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f644c0c43b0 0x7f644c14d450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 >> 172.21.15.46:0/4280994838 conn(0x7f644c0733f0 msgr2=0x7f644c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 shutdown_connections 2024-05-09T02:18:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.652+0000 7f6453906640 1 -- 172.21.15.46:0/4280994838 wait complete. 2024-05-09T02:18:44.666 INFO:tasks.mds_thrash:Ready to start thrashing 2024-05-09T02:18:44.666 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-05-09T02:18:44.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.777+0000 7f5fefa19640 1 Processor -- start 2024-05-09T02:18:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.778+0000 7f5fefa19640 1 -- start start 2024-05-09T02:18:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fefa19640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5fe8155160 0x7f5fe80c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fefa19640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fefa19640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe8158ae0 con 0x7f5fe80c84a0 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fefa19640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe8155570 con 0x7f5fe8155160 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fefa19640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe8157ed0 con 0x7f5fe815b3a0 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fecfb4640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5fe80c84a0 0x7f5fe80c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42800/0 (socket says 172.21.15.46:42800) 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fecfb4640 1 -- 172.21.15.46:0/889157217 learned_addr learned my addr 172.21.15.46:0/889157217 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fed7b5640 1 --2- 172.21.15.46:0/889157217 >> v2:172.21.15.107:3300/0 conn(0x7f5fe8155160 0x7f5fe80c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fedfb6640 1 --2- 172.21.15.46:0/889157217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.779+0000 7f5fe7fff640 1 -- 172.21.15.46:0/889157217 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403287380 0 0) 0x7f5fe8158ae0 con 0x7f5fe80c84a0 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fe7fff640 1 -- 172.21.15.46:0/889157217 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd0003520 con 0x7f5fe80c84a0 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fedfb6640 1 -- 172.21.15.46:0/889157217 >> v2:172.21.15.107:3300/0 conn(0x7f5fe8155160 msgr2=0x7f5fe80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fedfb6640 1 --2- 172.21.15.46:0/889157217 >> v2:172.21.15.107:3300/0 conn(0x7f5fe8155160 0x7f5fe80c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fedfb6640 1 -- 172.21.15.46:0/889157217 >> v1:172.21.15.46:6789/0 conn(0x7f5fe80c84a0 legacy=0x7f5fe80c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fedfb6640 1 -- 172.21.15.46:0/889157217 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe81581b0 con 0x7f5fe815b3a0 2024-05-09T02:18:44.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fed7b5640 1 --2- 172.21.15.46:0/889157217 >> v2:172.21.15.107:3300/0 conn(0x7f5fe8155160 0x7f5fe80c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.780+0000 7f5fedfb6640 1 --2- 172.21.15.46:0/889157217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe815b7b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee37464ba4f6bacf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fe7fff640 1 -- 172.21.15.46:0/889157217 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8007740 con 0x7f5fe815b3a0 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fe7fff640 1 -- 172.21.15.46:0/889157217 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd80078e0 con 0x7f5fe815b3a0 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fe7fff640 1 -- 172.21.15.46:0/889157217 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8007cb0 con 0x7f5fe815b3a0 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 -- 172.21.15.46:0/889157217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 msgr2=0x7f5fe815b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 --2- 172.21.15.46:0/889157217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe815b7b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd802a530 comp rx=0 tx=0).stop 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 -- 172.21.15.46:0/889157217 shutdown_connections 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 --2- 172.21.15.46:0/889157217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe815b7b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 --2- 172.21.15.46:0/889157217 >> v2:172.21.15.107:3300/0 conn(0x7f5fe8155160 0x7f5fe80c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 -- 172.21.15.46:0/889157217 >> 172.21.15.46:0/889157217 conn(0x7f5fe80aebe0 msgr2=0x7f5fe80aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 -- 172.21.15.46:0/889157217 shutdown_connections 2024-05-09T02:18:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.781+0000 7f5fefa19640 1 -- 172.21.15.46:0/889157217 wait complete. 2024-05-09T02:18:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.783+0000 7f5fefa19640 1 Processor -- start 2024-05-09T02:18:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.783+0000 7f5fefa19640 1 -- start start 2024-05-09T02:18:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fefa19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fe80c84a0 0x7f5fe8151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fefa19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 0x7f5fe80adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fefa19640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe81edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fefa19640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8157b30 con 0x7f5fe8155160 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fefa19640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8158770 con 0x7f5fe80c84a0 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fefa19640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe8157cb0 con 0x7f5fe815b3a0 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fecfb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 0x7f5fe80adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fecfb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 0x7f5fe80adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38578/0 (socket says 172.21.15.46:38578) 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.784+0000 7f5fecfb4640 1 -- 172.21.15.46:0/1932074169 learned_addr learned my addr 172.21.15.46:0/1932074169 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fedfb6640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe81edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fed7b5640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fe80c84a0 0x7f5fe8151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fecfb4640 1 -- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 msgr2=0x7f5fe81edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fecfb4640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe81edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fecfb4640 1 -- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fe80c84a0 msgr2=0x7f5fe8151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fecfb4640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fe80c84a0 0x7f5fe8151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fecfb4640 1 -- 172.21.15.46:0/1932074169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe8152600 con 0x7f5fe8155160 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fecfb4640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 0x7f5fe80adad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c440 tx=0x7f5fdc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc017070 con 0x7f5fe8155160 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc005ce0 con 0x7f5fe8155160 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe814c7d0 con 0x7f5fe8155160 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc007270 con 0x7f5fe8155160 2024-05-09T02:18:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.785+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe8153480 con 0x7f5fe8155160 2024-05-09T02:18:44.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.786+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe806a330 con 0x7f5fe8155160 2024-05-09T02:18:44.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.787+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5fdc01a070 con 0x7f5fe8155160 2024-05-09T02:18:44.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.788+0000 7f5fe5ffb640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5fd40762d0 0x7f5fd40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:44.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.788+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f5fdc096ad0 con 0x7f5fe8155160 2024-05-09T02:18:44.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.788+0000 7f5fed7b5640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5fd40762d0 0x7f5fd40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:44.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.789+0000 7f5fed7b5640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5fd40762d0 0x7f5fd40787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fe808e7e0 tx=0x7f5fe0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:44.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.792+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5fe814c7d0 con 0x7f5fe8155160 2024-05-09T02:18:44.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.980+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fe8154410 con 0x7f5fd40762d0 2024-05-09T02:18:44.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.992+0000 7f5fe5ffb640 1 -- 172.21.15.46:0/1932074169 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490290 (secure 0 0 0) 0x7f5fe8154410 con 0x7f5fd40762d0 2024-05-09T02:18:44.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:45.013 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5fd40762d0 msgr2=0x7f5fd40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5fd40762d0 0x7f5fd40787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fe808e7e0 tx=0x7f5fe0008040 comp rx=0 tx=0).stop 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 msgr2=0x7f5fe80adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 0x7f5fe80adad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c440 tx=0x7f5fdc00c900 comp rx=0 tx=0).stop 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 shutdown_connections 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5fd40762d0 0x7f5fd40787e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5fe815b3a0 0x7f5fe81edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe8155160 0x7f5fe80adad0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 --2- 172.21.15.46:0/1932074169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fe80c84a0 0x7f5fe8151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 >> 172.21.15.46:0/1932074169 conn(0x7f5fe80aebe0 msgr2=0x7f5fe80cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 shutdown_connections 2024-05-09T02:18:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:44.996+0000 7f5fefa19640 1 -- 172.21.15.46:0/1932074169 wait complete. 2024-05-09T02:18:45.016 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-09T02:18:44.507169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595629,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":193,"num_write_kb":1658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":3448832,"data_stored":2022714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":441,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003910"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199693+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:18:24.199693+0000","last_peered":"2024-05-09T02:18:24.199693+0000","last_clean":"2024-05-09T02:18:24.199693+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:18:24.199693+0000","last_undegraded":"2024-05-09T02:18:24.199693+0000","last_fullsized":"2024-05-09T02:18:24.199693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194809+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:24.194809+0000","last_peered":"2024-05-09T02:18:24.194809+0000","last_clean":"2024-05-09T02:18:24.194809+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:24.194809+0000","last_undegraded":"2024-05-09T02:18:24.194809+0000","last_fullsized":"2024-05-09T02:18:24.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200366+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:24.200366+0000","last_peered":"2024-05-09T02:18:24.200366+0000","last_clean":"2024-05-09T02:18:24.200366+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:24.200366+0000","last_undegraded":"2024-05-09T02:18:24.200366+0000","last_fullsized":"2024-05-09T02:18:24.200366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199237+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:18:24.199237+0000","last_peered":"2024-05-09T02:18:24.199237+0000","last_clean":"2024-05-09T02:18:24.199237+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:18:24.199237+0000","last_undegraded":"2024-05-09T02:18:24.199237+0000","last_fullsized":"2024-05-09T02:18:24.199237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212516+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:18:24.212516+0000","last_peered":"2024-05-09T02:18:24.212516+0000","last_clean":"2024-05-09T02:18:24.212516+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:18:24.212516+0000","last_undegraded":"2024-05-09T02:18:24.212516+0000","last_fullsized":"2024-05-09T02:18:24.212516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200409+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:24.200409+0000","last_peered":"2024-05-09T02:18:24.200409+0000","last_clean":"2024-05-09T02:18:24.200409+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:24.200409+0000","last_undegraded":"2024-05-09T02:18:24.200409+0000","last_fullsized":"2024-05-09T02:18:24.200409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194737+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:24.194737+0000","last_peered":"2024-05-09T02:18:24.194737+0000","last_clean":"2024-05-09T02:18:24.194737+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:24.194737+0000","last_undegraded":"2024-05-09T02:18:24.194737+0000","last_fullsized":"2024-05-09T02:18:24.194737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199565+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:18:24.199565+0000","last_peered":"2024-05-09T02:18:24.199565+0000","last_clean":"2024-05-09T02:18:24.199565+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:18:24.199565+0000","last_undegraded":"2024-05-09T02:18:24.199565+0000","last_fullsized":"2024-05-09T02:18:24.199565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117680+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:25.117680+0000","last_peered":"2024-05-09T02:18:25.117680+0000","last_clean":"2024-05-09T02:18:25.117680+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:25.117680+0000","last_undegraded":"2024-05-09T02:18:25.117680+0000","last_fullsized":"2024-05-09T02:18:25.117680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545151+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:24.545151+0000","last_peered":"2024-05-09T02:18:24.545151+0000","last_clean":"2024-05-09T02:18:24.545151+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:24.545151+0000","last_undegraded":"2024-05-09T02:18:24.545151+0000","last_fullsized":"2024-05-09T02:18:24.545151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199967+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:18:24.199967+0000","last_peered":"2024-05-09T02:18:24.199967+0000","last_clean":"2024-05-09T02:18:24.199967+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:18:24.199967+0000","last_undegraded":"2024-05-09T02:18:24.199967+0000","last_fullsized":"2024-05-09T02:18:24.199967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544707+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:18:24.544707+0000","last_peered":"2024-05-09T02:18:24.544707+0000","last_clean":"2024-05-09T02:18:24.544707+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:18:24.544707+0000","last_undegraded":"2024-05-09T02:18:24.544707+0000","last_fullsized":"2024-05-09T02:18:24.544707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117346+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:25.117346+0000","last_peered":"2024-05-09T02:18:25.117346+0000","last_clean":"2024-05-09T02:18:25.117346+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:25.117346+0000","last_undegraded":"2024-05-09T02:18:25.117346+0000","last_fullsized":"2024-05-09T02:18:25.117346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545312+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:24.545312+0000","last_peered":"2024-05-09T02:18:24.545312+0000","last_clean":"2024-05-09T02:18:24.545312+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:24.545312+0000","last_undegraded":"2024-05-09T02:18:24.545312+0000","last_fullsized":"2024-05-09T02:18:24.545312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199878+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:18:24.199878+0000","last_peered":"2024-05-09T02:18:24.199878+0000","last_clean":"2024-05-09T02:18:24.199878+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:18:24.199878+0000","last_undegraded":"2024-05-09T02:18:24.199878+0000","last_fullsized":"2024-05-09T02:18:24.199878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213230+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:18:24.213230+0000","last_peered":"2024-05-09T02:18:24.213230+0000","last_clean":"2024-05-09T02:18:24.213230+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:18:24.213230+0000","last_undegraded":"2024-05-09T02:18:24.213230+0000","last_fullsized":"2024-05-09T02:18:24.213230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116725+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:25.116725+0000","last_peered":"2024-05-09T02:18:25.116725+0000","last_clean":"2024-05-09T02:18:25.116725+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:25.116725+0000","last_undegraded":"2024-05-09T02:18:25.116725+0000","last_fullsized":"2024-05-09T02:18:25.116725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117491+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:25.117491+0000","last_peered":"2024-05-09T02:18:25.117491+0000","last_clean":"2024-05-09T02:18:25.117491+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:25.117491+0000","last_undegraded":"2024-05-09T02:18:25.117491+0000","last_fullsized":"2024-05-09T02:18:25.117491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200557+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:18:24.200557+0000","last_peered":"2024-05-09T02:18:24.200557+0000","last_clean":"2024-05-09T02:18:24.200557+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:18:24.200557+0000","last_undegraded":"2024-05-09T02:18:24.200557+0000","last_fullsized":"2024-05-09T02:18:24.200557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117023+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:18:25.117023+0000","last_peered":"2024-05-09T02:18:25.117023+0000","last_clean":"2024-05-09T02:18:25.117023+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:18:25.117023+0000","last_undegraded":"2024-05-09T02:18:25.117023+0000","last_fullsized":"2024-05-09T02:18:25.117023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199802+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:24.199802+0000","last_peered":"2024-05-09T02:18:24.199802+0000","last_clean":"2024-05-09T02:18:24.199802+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:24.199802+0000","last_undegraded":"2024-05-09T02:18:24.199802+0000","last_fullsized":"2024-05-09T02:18:24.199802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212930+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:24.212930+0000","last_peered":"2024-05-09T02:18:24.212930+0000","last_clean":"2024-05-09T02:18:24.212930+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:24.212930+0000","last_undegraded":"2024-05-09T02:18:24.212930+0000","last_fullsized":"2024-05-09T02:18:24.212930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200551+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:18:24.200551+0000","last_peered":"2024-05-09T02:18:24.200551+0000","last_clean":"2024-05-09T02:18:24.200551+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:18:24.200551+0000","last_undegraded":"2024-05-09T02:18:24.200551+0000","last_fullsized":"2024-05-09T02:18:24.200551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200686+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:18:24.200686+0000","last_peered":"2024-05-09T02:18:24.200686+0000","last_clean":"2024-05-09T02:18:24.200686+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:18:24.200686+0000","last_undegraded":"2024-05-09T02:18:24.200686+0000","last_fullsized":"2024-05-09T02:18:24.200686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200229+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:24.200229+0000","last_peered":"2024-05-09T02:18:24.200229+0000","last_clean":"2024-05-09T02:18:24.200229+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:24.200229+0000","last_undegraded":"2024-05-09T02:18:24.200229+0000","last_fullsized":"2024-05-09T02:18:24.200229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212619+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:24.212619+0000","last_peered":"2024-05-09T02:18:24.212619+0000","last_clean":"2024-05-09T02:18:24.212619+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:24.212619+0000","last_undegraded":"2024-05-09T02:18:24.212619+0000","last_fullsized":"2024-05-09T02:18:24.212619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213272+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:18:24.213272+0000","last_peered":"2024-05-09T02:18:24.213272+0000","last_clean":"2024-05-09T02:18:24.213272+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:18:24.213272+0000","last_undegraded":"2024-05-09T02:18:24.213272+0000","last_fullsized":"2024-05-09T02:18:24.213272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545447+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:18:24.545447+0000","last_peered":"2024-05-09T02:18:24.545447+0000","last_clean":"2024-05-09T02:18:24.545447+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:18:24.545447+0000","last_undegraded":"2024-05-09T02:18:24.545447+0000","last_fullsized":"2024-05-09T02:18:24.545447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200114+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:24.200114+0000","last_peered":"2024-05-09T02:18:24.200114+0000","last_clean":"2024-05-09T02:18:24.200114+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:24.200114+0000","last_undegraded":"2024-05-09T02:18:24.200114+0000","last_fullsized":"2024-05-09T02:18:24.200114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117121+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:25.117121+0000","last_peered":"2024-05-09T02:18:25.117121+0000","last_clean":"2024-05-09T02:18:25.117121+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:25.117121+0000","last_undegraded":"2024-05-09T02:18:25.117121+0000","last_fullsized":"2024-05-09T02:18:25.117121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200694+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:18:24.200694+0000","last_peered":"2024-05-09T02:18:24.200694+0000","last_clean":"2024-05-09T02:18:24.200694+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:18:24.200694+0000","last_undegraded":"2024-05-09T02:18:24.200694+0000","last_fullsized":"2024-05-09T02:18:24.200694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199079+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:18:24.199079+0000","last_peered":"2024-05-09T02:18:24.199079+0000","last_clean":"2024-05-09T02:18:24.199079+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:18:24.199079+0000","last_undegraded":"2024-05-09T02:18:24.199079+0000","last_fullsized":"2024-05-09T02:18:24.199079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194623+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:24.194623+0000","last_peered":"2024-05-09T02:18:24.194623+0000","last_clean":"2024-05-09T02:18:24.194623+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:24.194623+0000","last_undegraded":"2024-05-09T02:18:24.194623+0000","last_fullsized":"2024-05-09T02:18:24.194623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118230+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:25.118230+0000","last_peered":"2024-05-09T02:18:25.118230+0000","last_clean":"2024-05-09T02:18:25.118230+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:25.118230+0000","last_undegraded":"2024-05-09T02:18:25.118230+0000","last_fullsized":"2024-05-09T02:18:25.118230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199762+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:18:24.199762+0000","last_peered":"2024-05-09T02:18:24.199762+0000","last_clean":"2024-05-09T02:18:24.199762+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:18:24.199762+0000","last_undegraded":"2024-05-09T02:18:24.199762+0000","last_fullsized":"2024-05-09T02:18:24.199762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199671+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:18:24.199671+0000","last_peered":"2024-05-09T02:18:24.199671+0000","last_clean":"2024-05-09T02:18:24.199671+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:18:24.199671+0000","last_undegraded":"2024-05-09T02:18:24.199671+0000","last_fullsized":"2024-05-09T02:18:24.199671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200278+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:24.200278+0000","last_peered":"2024-05-09T02:18:24.200278+0000","last_clean":"2024-05-09T02:18:24.200278+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:24.200278+0000","last_undegraded":"2024-05-09T02:18:24.200278+0000","last_fullsized":"2024-05-09T02:18:24.200278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213294+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:24.213294+0000","last_peered":"2024-05-09T02:18:24.213294+0000","last_clean":"2024-05-09T02:18:24.213294+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:24.213294+0000","last_undegraded":"2024-05-09T02:18:24.213294+0000","last_fullsized":"2024-05-09T02:18:24.213294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199015+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:18:24.199015+0000","last_peered":"2024-05-09T02:18:24.199015+0000","last_clean":"2024-05-09T02:18:24.199015+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:18:24.199015+0000","last_undegraded":"2024-05-09T02:18:24.199015+0000","last_fullsized":"2024-05-09T02:18:24.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116593+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:18:25.116593+0000","last_peered":"2024-05-09T02:18:25.116593+0000","last_clean":"2024-05-09T02:18:25.116593+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:18:25.116593+0000","last_undegraded":"2024-05-09T02:18:25.116593+0000","last_fullsized":"2024-05-09T02:18:25.116593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213438+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:24.213438+0000","last_peered":"2024-05-09T02:18:24.213438+0000","last_clean":"2024-05-09T02:18:24.213438+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:24.213438+0000","last_undegraded":"2024-05-09T02:18:24.213438+0000","last_fullsized":"2024-05-09T02:18:24.213438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117923+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:25.117923+0000","last_peered":"2024-05-09T02:18:25.117923+0000","last_clean":"2024-05-09T02:18:25.117923+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:25.117923+0000","last_undegraded":"2024-05-09T02:18:25.117923+0000","last_fullsized":"2024-05-09T02:18:25.117923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194343+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:18:24.194343+0000","last_peered":"2024-05-09T02:18:24.194343+0000","last_clean":"2024-05-09T02:18:24.194343+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:18:24.194343+0000","last_undegraded":"2024-05-09T02:18:24.194343+0000","last_fullsized":"2024-05-09T02:18:24.194343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194795+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:18:24.194795+0000","last_peered":"2024-05-09T02:18:24.194795+0000","last_clean":"2024-05-09T02:18:24.194795+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:18:24.194795+0000","last_undegraded":"2024-05-09T02:18:24.194795+0000","last_fullsized":"2024-05-09T02:18:24.194795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545446+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:24.545446+0000","last_peered":"2024-05-09T02:18:24.545446+0000","last_clean":"2024-05-09T02:18:24.545446+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:24.545446+0000","last_undegraded":"2024-05-09T02:18:24.545446+0000","last_fullsized":"2024-05-09T02:18:24.545446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213541+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:24.213541+0000","last_peered":"2024-05-09T02:18:24.213541+0000","last_clean":"2024-05-09T02:18:24.213541+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:24.213541+0000","last_undegraded":"2024-05-09T02:18:24.213541+0000","last_fullsized":"2024-05-09T02:18:24.213541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212698+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:18:24.212698+0000","last_peered":"2024-05-09T02:18:24.212698+0000","last_clean":"2024-05-09T02:18:24.212698+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:18:24.212698+0000","last_undegraded":"2024-05-09T02:18:24.212698+0000","last_fullsized":"2024-05-09T02:18:24.212698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194413+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:18:24.194413+0000","last_peered":"2024-05-09T02:18:24.194413+0000","last_clean":"2024-05-09T02:18:24.194413+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:18:24.194413+0000","last_undegraded":"2024-05-09T02:18:24.194413+0000","last_fullsized":"2024-05-09T02:18:24.194413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200494+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:24.200494+0000","last_peered":"2024-05-09T02:18:24.200494+0000","last_clean":"2024-05-09T02:18:24.200494+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:24.200494+0000","last_undegraded":"2024-05-09T02:18:24.200494+0000","last_fullsized":"2024-05-09T02:18:24.200494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545086+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:24.545086+0000","last_peered":"2024-05-09T02:18:24.545086+0000","last_clean":"2024-05-09T02:18:24.545086+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:24.545086+0000","last_undegraded":"2024-05-09T02:18:24.545086+0000","last_fullsized":"2024-05-09T02:18:24.545086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213293+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:18:24.213293+0000","last_peered":"2024-05-09T02:18:24.213293+0000","last_clean":"2024-05-09T02:18:24.213293+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:18:24.213293+0000","last_undegraded":"2024-05-09T02:18:24.213293+0000","last_fullsized":"2024-05-09T02:18:24.213293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117109+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:18:25.117109+0000","last_peered":"2024-05-09T02:18:25.117109+0000","last_clean":"2024-05-09T02:18:25.117109+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:18:25.117109+0000","last_undegraded":"2024-05-09T02:18:25.117109+0000","last_fullsized":"2024-05-09T02:18:25.117109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212497+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:24.212497+0000","last_peered":"2024-05-09T02:18:24.212497+0000","last_clean":"2024-05-09T02:18:24.212497+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:24.212497+0000","last_undegraded":"2024-05-09T02:18:24.212497+0000","last_fullsized":"2024-05-09T02:18:24.212497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116723+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:25.116723+0000","last_peered":"2024-05-09T02:18:25.116723+0000","last_clean":"2024-05-09T02:18:25.116723+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:25.116723+0000","last_undegraded":"2024-05-09T02:18:25.116723+0000","last_fullsized":"2024-05-09T02:18:25.116723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213274+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:18:24.213274+0000","last_peered":"2024-05-09T02:18:24.213274+0000","last_clean":"2024-05-09T02:18:24.213274+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:18:24.213274+0000","last_undegraded":"2024-05-09T02:18:24.213274+0000","last_fullsized":"2024-05-09T02:18:24.213274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545598+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:18:24.545598+0000","last_peered":"2024-05-09T02:18:24.545598+0000","last_clean":"2024-05-09T02:18:24.545598+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:18:24.545598+0000","last_undegraded":"2024-05-09T02:18:24.545598+0000","last_fullsized":"2024-05-09T02:18:24.545598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193902+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:24.193902+0000","last_peered":"2024-05-09T02:18:24.193902+0000","last_clean":"2024-05-09T02:18:24.193902+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:24.193902+0000","last_undegraded":"2024-05-09T02:18:24.193902+0000","last_fullsized":"2024-05-09T02:18:24.193902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117239+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:25.117239+0000","last_peered":"2024-05-09T02:18:25.117239+0000","last_clean":"2024-05-09T02:18:25.117239+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:25.117239+0000","last_undegraded":"2024-05-09T02:18:25.117239+0000","last_fullsized":"2024-05-09T02:18:25.117239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194546+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:18:24.194546+0000","last_peered":"2024-05-09T02:18:24.194546+0000","last_clean":"2024-05-09T02:18:24.194546+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:18:24.194546+0000","last_undegraded":"2024-05-09T02:18:24.194546+0000","last_fullsized":"2024-05-09T02:18:24.194546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117439+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:18:25.117439+0000","last_peered":"2024-05-09T02:18:25.117439+0000","last_clean":"2024-05-09T02:18:25.117439+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:18:25.117439+0000","last_undegraded":"2024-05-09T02:18:25.117439+0000","last_fullsized":"2024-05-09T02:18:25.117439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199819+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:24.199819+0000","last_peered":"2024-05-09T02:18:24.199819+0000","last_clean":"2024-05-09T02:18:24.199819+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:24.199819+0000","last_undegraded":"2024-05-09T02:18:24.199819+0000","last_fullsized":"2024-05-09T02:18:24.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544691+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:24.544691+0000","last_peered":"2024-05-09T02:18:24.544691+0000","last_clean":"2024-05-09T02:18:24.544691+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:24.544691+0000","last_undegraded":"2024-05-09T02:18:24.544691+0000","last_fullsized":"2024-05-09T02:18:24.544691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117558+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:25.117558+0000","last_peered":"2024-05-09T02:18:25.117558+0000","last_clean":"2024-05-09T02:18:25.117558+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:25.117558+0000","last_undegraded":"2024-05-09T02:18:25.117558+0000","last_fullsized":"2024-05-09T02:18:25.117558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117570+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:25.117570+0000","last_peered":"2024-05-09T02:18:25.117570+0000","last_clean":"2024-05-09T02:18:25.117570+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:25.117570+0000","last_undegraded":"2024-05-09T02:18:25.117570+0000","last_fullsized":"2024-05-09T02:18:25.117570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117008+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:25.117008+0000","last_peered":"2024-05-09T02:18:25.117008+0000","last_clean":"2024-05-09T02:18:25.117008+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:25.117008+0000","last_undegraded":"2024-05-09T02:18:25.117008+0000","last_fullsized":"2024-05-09T02:18:25.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116656+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:18:25.116656+0000","last_peered":"2024-05-09T02:18:25.116656+0000","last_clean":"2024-05-09T02:18:25.116656+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:18:25.116656+0000","last_undegraded":"2024-05-09T02:18:25.116656+0000","last_fullsized":"2024-05-09T02:18:25.116656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545429+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:24.545429+0000","last_peered":"2024-05-09T02:18:24.545429+0000","last_clean":"2024-05-09T02:18:24.545429+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:24.545429+0000","last_undegraded":"2024-05-09T02:18:24.545429+0000","last_fullsized":"2024-05-09T02:18:24.545429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213599+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:24.213599+0000","last_peered":"2024-05-09T02:18:24.213599+0000","last_clean":"2024-05-09T02:18:24.213599+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:24.213599+0000","last_undegraded":"2024-05-09T02:18:24.213599+0000","last_fullsized":"2024-05-09T02:18:24.213599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194066+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:18:24.194066+0000","last_peered":"2024-05-09T02:18:24.194066+0000","last_clean":"2024-05-09T02:18:24.194066+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:18:24.194066+0000","last_undegraded":"2024-05-09T02:18:24.194066+0000","last_fullsized":"2024-05-09T02:18:24.194066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118369+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:25.118369+0000","last_peered":"2024-05-09T02:18:25.118369+0000","last_clean":"2024-05-09T02:18:25.118369+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:25.118369+0000","last_undegraded":"2024-05-09T02:18:25.118369+0000","last_fullsized":"2024-05-09T02:18:25.118369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117107+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:25.117107+0000","last_peered":"2024-05-09T02:18:25.117107+0000","last_clean":"2024-05-09T02:18:25.117107+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:25.117107+0000","last_undegraded":"2024-05-09T02:18:25.117107+0000","last_fullsized":"2024-05-09T02:18:25.117107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544340+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:18:24.544340+0000","last_peered":"2024-05-09T02:18:24.544340+0000","last_clean":"2024-05-09T02:18:24.544340+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:18:24.544340+0000","last_undegraded":"2024-05-09T02:18:24.544340+0000","last_fullsized":"2024-05-09T02:18:24.544340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116753+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:18:25.116753+0000","last_peered":"2024-05-09T02:18:25.116753+0000","last_clean":"2024-05-09T02:18:25.116753+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:18:25.116753+0000","last_undegraded":"2024-05-09T02:18:25.116753+0000","last_fullsized":"2024-05-09T02:18:25.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117832+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:25.117832+0000","last_peered":"2024-05-09T02:18:25.117832+0000","last_clean":"2024-05-09T02:18:25.117832+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:25.117832+0000","last_undegraded":"2024-05-09T02:18:25.117832+0000","last_fullsized":"2024-05-09T02:18:25.117832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201043+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:24.201043+0000","last_peered":"2024-05-09T02:18:24.201043+0000","last_clean":"2024-05-09T02:18:24.201043+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:24.201043+0000","last_undegraded":"2024-05-09T02:18:24.201043+0000","last_fullsized":"2024-05-09T02:18:24.201043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199591+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:18:24.199591+0000","last_peered":"2024-05-09T02:18:24.199591+0000","last_clean":"2024-05-09T02:18:24.199591+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:18:24.199591+0000","last_undegraded":"2024-05-09T02:18:24.199591+0000","last_fullsized":"2024-05-09T02:18:24.199591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200090+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:18:24.200090+0000","last_peered":"2024-05-09T02:18:24.200090+0000","last_clean":"2024-05-09T02:18:24.200090+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:18:24.200090+0000","last_undegraded":"2024-05-09T02:18:24.200090+0000","last_fullsized":"2024-05-09T02:18:24.200090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116454+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:25.116454+0000","last_peered":"2024-05-09T02:18:25.116454+0000","last_clean":"2024-05-09T02:18:25.116454+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:25.116454+0000","last_undegraded":"2024-05-09T02:18:25.116454+0000","last_fullsized":"2024-05-09T02:18:25.116454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194601+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:18:24.194601+0000","last_peered":"2024-05-09T02:18:24.194601+0000","last_clean":"2024-05-09T02:18:24.194601+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:18:24.194601+0000","last_undegraded":"2024-05-09T02:18:24.194601+0000","last_fullsized":"2024-05-09T02:18:24.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545288+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:18:24.545288+0000","last_peered":"2024-05-09T02:18:24.545288+0000","last_clean":"2024-05-09T02:18:24.545288+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:18:24.545288+0000","last_undegraded":"2024-05-09T02:18:24.545288+0000","last_fullsized":"2024-05-09T02:18:24.545288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116481+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:25.116481+0000","last_peered":"2024-05-09T02:18:25.116481+0000","last_clean":"2024-05-09T02:18:25.116481+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:25.116481+0000","last_undegraded":"2024-05-09T02:18:25.116481+0000","last_fullsized":"2024-05-09T02:18:25.116481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117146+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:25.117146+0000","last_peered":"2024-05-09T02:18:25.117146+0000","last_clean":"2024-05-09T02:18:25.117146+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:25.117146+0000","last_undegraded":"2024-05-09T02:18:25.117146+0000","last_fullsized":"2024-05-09T02:18:25.117146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200150+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:18:24.200150+0000","last_peered":"2024-05-09T02:18:24.200150+0000","last_clean":"2024-05-09T02:18:24.200150+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:18:24.200150+0000","last_undegraded":"2024-05-09T02:18:24.200150+0000","last_fullsized":"2024-05-09T02:18:24.200150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544937+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:18:24.544937+0000","last_peered":"2024-05-09T02:18:24.544937+0000","last_clean":"2024-05-09T02:18:24.544937+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:18:24.544937+0000","last_undegraded":"2024-05-09T02:18:24.544937+0000","last_fullsized":"2024-05-09T02:18:24.544937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117143+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:25.117143+0000","last_peered":"2024-05-09T02:18:25.117143+0000","last_clean":"2024-05-09T02:18:25.117143+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:25.117143+0000","last_undegraded":"2024-05-09T02:18:25.117143+0000","last_fullsized":"2024-05-09T02:18:25.117143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545038+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:24.545038+0000","last_peered":"2024-05-09T02:18:24.545038+0000","last_clean":"2024-05-09T02:18:24.545038+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:24.545038+0000","last_undegraded":"2024-05-09T02:18:24.545038+0000","last_fullsized":"2024-05-09T02:18:24.545038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199798+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:18:24.199798+0000","last_peered":"2024-05-09T02:18:24.199798+0000","last_clean":"2024-05-09T02:18:24.199798+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:18:24.199798+0000","last_undegraded":"2024-05-09T02:18:24.199798+0000","last_fullsized":"2024-05-09T02:18:24.199798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200009+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:18:24.200009+0000","last_peered":"2024-05-09T02:18:24.200009+0000","last_clean":"2024-05-09T02:18:24.200009+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:18:24.200009+0000","last_undegraded":"2024-05-09T02:18:24.200009+0000","last_fullsized":"2024-05-09T02:18:24.200009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194050+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:24.194050+0000","last_peered":"2024-05-09T02:18:24.194050+0000","last_clean":"2024-05-09T02:18:24.194050+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:24.194050+0000","last_undegraded":"2024-05-09T02:18:24.194050+0000","last_fullsized":"2024-05-09T02:18:24.194050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194934+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:24.194934+0000","last_peered":"2024-05-09T02:18:24.194934+0000","last_clean":"2024-05-09T02:18:24.194934+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:24.194934+0000","last_undegraded":"2024-05-09T02:18:24.194934+0000","last_fullsized":"2024-05-09T02:18:24.194934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545295+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:18:24.545295+0000","last_peered":"2024-05-09T02:18:24.545295+0000","last_clean":"2024-05-09T02:18:24.545295+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:18:24.545295+0000","last_undegraded":"2024-05-09T02:18:24.545295+0000","last_fullsized":"2024-05-09T02:18:24.545295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199929+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:18:24.199929+0000","last_peered":"2024-05-09T02:18:24.199929+0000","last_clean":"2024-05-09T02:18:24.199929+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:18:24.199929+0000","last_undegraded":"2024-05-09T02:18:24.199929+0000","last_fullsized":"2024-05-09T02:18:24.199929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117435+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:25.117435+0000","last_peered":"2024-05-09T02:18:25.117435+0000","last_clean":"2024-05-09T02:18:25.117435+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:25.117435+0000","last_undegraded":"2024-05-09T02:18:25.117435+0000","last_fullsized":"2024-05-09T02:18:25.117435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:39.630776+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:39.630776+0000","last_peered":"2024-05-09T02:18:39.630776+0000","last_clean":"2024-05-09T02:18:39.630776+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:39.630776+0000","last_undegraded":"2024-05-09T02:18:39.630776+0000","last_fullsized":"2024-05-09T02:18:39.630776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212549+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:18:24.212549+0000","last_peered":"2024-05-09T02:18:24.212549+0000","last_clean":"2024-05-09T02:18:24.212549+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:18:24.212549+0000","last_undegraded":"2024-05-09T02:18:24.212549+0000","last_fullsized":"2024-05-09T02:18:24.212549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212872+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:18:24.212872+0000","last_peered":"2024-05-09T02:18:24.212872+0000","last_clean":"2024-05-09T02:18:24.212872+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:18:24.212872+0000","last_undegraded":"2024-05-09T02:18:24.212872+0000","last_fullsized":"2024-05-09T02:18:24.212872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201035+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:24.201035+0000","last_peered":"2024-05-09T02:18:24.201035+0000","last_clean":"2024-05-09T02:18:24.201035+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:24.201035+0000","last_undegraded":"2024-05-09T02:18:24.201035+0000","last_fullsized":"2024-05-09T02:18:24.201035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213593+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:24.213593+0000","last_peered":"2024-05-09T02:18:24.213593+0000","last_clean":"2024-05-09T02:18:24.213593+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:24.213593+0000","last_undegraded":"2024-05-09T02:18:24.213593+0000","last_fullsized":"2024-05-09T02:18:24.213593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200111+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:18:24.200111+0000","last_peered":"2024-05-09T02:18:24.200111+0000","last_clean":"2024-05-09T02:18:24.200111+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:18:24.200111+0000","last_undegraded":"2024-05-09T02:18:24.200111+0000","last_fullsized":"2024-05-09T02:18:24.200111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117015+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:18:25.117015+0000","last_peered":"2024-05-09T02:18:25.117015+0000","last_clean":"2024-05-09T02:18:25.117015+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:18:25.117015+0000","last_undegraded":"2024-05-09T02:18:25.117015+0000","last_fullsized":"2024-05-09T02:18:25.117015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194791+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:24.194791+0000","last_peered":"2024-05-09T02:18:24.194791+0000","last_clean":"2024-05-09T02:18:24.194791+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:24.194791+0000","last_undegraded":"2024-05-09T02:18:24.194791+0000","last_fullsized":"2024-05-09T02:18:24.194791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545365+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:24.545365+0000","last_peered":"2024-05-09T02:18:24.545365+0000","last_clean":"2024-05-09T02:18:24.545365+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:24.545365+0000","last_undegraded":"2024-05-09T02:18:24.545365+0000","last_fullsized":"2024-05-09T02:18:24.545365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199144+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:18:24.199144+0000","last_peered":"2024-05-09T02:18:24.199144+0000","last_clean":"2024-05-09T02:18:24.199144+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:18:24.199144+0000","last_undegraded":"2024-05-09T02:18:24.199144+0000","last_fullsized":"2024-05-09T02:18:24.199144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117861+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:18:25.117861+0000","last_peered":"2024-05-09T02:18:25.117861+0000","last_clean":"2024-05-09T02:18:25.117861+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:18:25.117861+0000","last_undegraded":"2024-05-09T02:18:25.117861+0000","last_fullsized":"2024-05-09T02:18:25.117861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545293+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:24.545293+0000","last_peered":"2024-05-09T02:18:24.545293+0000","last_clean":"2024-05-09T02:18:24.545293+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:24.545293+0000","last_undegraded":"2024-05-09T02:18:24.545293+0000","last_fullsized":"2024-05-09T02:18:24.545293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118231+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:25.118231+0000","last_peered":"2024-05-09T02:18:25.118231+0000","last_clean":"2024-05-09T02:18:25.118231+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:25.118231+0000","last_undegraded":"2024-05-09T02:18:25.118231+0000","last_fullsized":"2024-05-09T02:18:25.118231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199116+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:18:24.199116+0000","last_peered":"2024-05-09T02:18:24.199116+0000","last_clean":"2024-05-09T02:18:24.199116+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:18:24.199116+0000","last_undegraded":"2024-05-09T02:18:24.199116+0000","last_fullsized":"2024-05-09T02:18:24.199116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118154+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:18:25.118154+0000","last_peered":"2024-05-09T02:18:25.118154+0000","last_clean":"2024-05-09T02:18:25.118154+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:18:25.118154+0000","last_undegraded":"2024-05-09T02:18:25.118154+0000","last_fullsized":"2024-05-09T02:18:25.118154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194363+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:18:24.194363+0000","last_peered":"2024-05-09T02:18:24.194363+0000","last_clean":"2024-05-09T02:18:24.194363+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:18:24.194363+0000","last_undegraded":"2024-05-09T02:18:24.194363+0000","last_fullsized":"2024-05-09T02:18:24.194363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212490+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:24.212490+0000","last_peered":"2024-05-09T02:18:24.212490+0000","last_clean":"2024-05-09T02:18:24.212490+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:24.212490+0000","last_undegraded":"2024-05-09T02:18:24.212490+0000","last_fullsized":"2024-05-09T02:18:24.212490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194441+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:18:24.194441+0000","last_peered":"2024-05-09T02:18:24.194441+0000","last_clean":"2024-05-09T02:18:24.194441+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:18:24.194441+0000","last_undegraded":"2024-05-09T02:18:24.194441+0000","last_fullsized":"2024-05-09T02:18:24.194441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118101+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:18:25.118101+0000","last_peered":"2024-05-09T02:18:25.118101+0000","last_clean":"2024-05-09T02:18:25.118101+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:18:25.118101+0000","last_undegraded":"2024-05-09T02:18:25.118101+0000","last_fullsized":"2024-05-09T02:18:25.118101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199684+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:24.199684+0000","last_peered":"2024-05-09T02:18:24.199684+0000","last_clean":"2024-05-09T02:18:24.199684+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:24.199684+0000","last_undegraded":"2024-05-09T02:18:24.199684+0000","last_fullsized":"2024-05-09T02:18:24.199684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199561+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:24.199561+0000","last_peered":"2024-05-09T02:18:24.199561+0000","last_clean":"2024-05-09T02:18:24.199561+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:24.199561+0000","last_undegraded":"2024-05-09T02:18:24.199561+0000","last_fullsized":"2024-05-09T02:18:24.199561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213468+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:18:24.213468+0000","last_peered":"2024-05-09T02:18:24.213468+0000","last_clean":"2024-05-09T02:18:24.213468+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:18:24.213468+0000","last_undegraded":"2024-05-09T02:18:24.213468+0000","last_fullsized":"2024-05-09T02:18:24.213468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116796+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:25.116796+0000","last_peered":"2024-05-09T02:18:25.116796+0000","last_clean":"2024-05-09T02:18:25.116796+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:25.116796+0000","last_undegraded":"2024-05-09T02:18:25.116796+0000","last_fullsized":"2024-05-09T02:18:25.116796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194815+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:24.194815+0000","last_peered":"2024-05-09T02:18:24.194815+0000","last_clean":"2024-05-09T02:18:24.194815+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:24.194815+0000","last_undegraded":"2024-05-09T02:18:24.194815+0000","last_fullsized":"2024-05-09T02:18:24.194815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116805+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:18:25.116805+0000","last_peered":"2024-05-09T02:18:25.116805+0000","last_clean":"2024-05-09T02:18:25.116805+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:18:25.116805+0000","last_undegraded":"2024-05-09T02:18:25.116805+0000","last_fullsized":"2024-05-09T02:18:25.116805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200413+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:18:24.200413+0000","last_peered":"2024-05-09T02:18:24.200413+0000","last_clean":"2024-05-09T02:18:24.200413+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:18:24.200413+0000","last_undegraded":"2024-05-09T02:18:24.200413+0000","last_fullsized":"2024-05-09T02:18:24.200413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200002+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:24.200002+0000","last_peered":"2024-05-09T02:18:24.200002+0000","last_clean":"2024-05-09T02:18:24.200002+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:24.200002+0000","last_undegraded":"2024-05-09T02:18:24.200002+0000","last_fullsized":"2024-05-09T02:18:24.200002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200154+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:24.200154+0000","last_peered":"2024-05-09T02:18:24.200154+0000","last_clean":"2024-05-09T02:18:24.200154+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:24.200154+0000","last_undegraded":"2024-05-09T02:18:24.200154+0000","last_fullsized":"2024-05-09T02:18:24.200154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199852+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:18:24.199852+0000","last_peered":"2024-05-09T02:18:24.199852+0000","last_clean":"2024-05-09T02:18:24.199852+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:18:24.199852+0000","last_undegraded":"2024-05-09T02:18:24.199852+0000","last_fullsized":"2024-05-09T02:18:24.199852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200142+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:18:24.200142+0000","last_peered":"2024-05-09T02:18:24.200142+0000","last_clean":"2024-05-09T02:18:24.200142+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:18:24.200142+0000","last_undegraded":"2024-05-09T02:18:24.200142+0000","last_fullsized":"2024-05-09T02:18:24.200142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116363+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:25.116363+0000","last_peered":"2024-05-09T02:18:25.116363+0000","last_clean":"2024-05-09T02:18:25.116363+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:25.116363+0000","last_undegraded":"2024-05-09T02:18:25.116363+0000","last_fullsized":"2024-05-09T02:18:25.116363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213190+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:18:24.213190+0000","last_peered":"2024-05-09T02:18:24.213190+0000","last_clean":"2024-05-09T02:18:24.213190+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:18:24.213190+0000","last_undegraded":"2024-05-09T02:18:24.213190+0000","last_fullsized":"2024-05-09T02:18:24.213190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116452+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:25.116452+0000","last_peered":"2024-05-09T02:18:25.116452+0000","last_clean":"2024-05-09T02:18:25.116452+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:25.116452+0000","last_undegraded":"2024-05-09T02:18:25.116452+0000","last_fullsized":"2024-05-09T02:18:25.116452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544873+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:18:24.544873+0000","last_peered":"2024-05-09T02:18:24.544873+0000","last_clean":"2024-05-09T02:18:24.544873+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:18:24.544873+0000","last_undegraded":"2024-05-09T02:18:24.544873+0000","last_fullsized":"2024-05-09T02:18:24.544873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544891+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:24.544891+0000","last_peered":"2024-05-09T02:18:24.544891+0000","last_clean":"2024-05-09T02:18:24.544891+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:24.544891+0000","last_undegraded":"2024-05-09T02:18:24.544891+0000","last_fullsized":"2024-05-09T02:18:24.544891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213449+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:18:24.213449+0000","last_peered":"2024-05-09T02:18:24.213449+0000","last_clean":"2024-05-09T02:18:24.213449+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:18:24.213449+0000","last_undegraded":"2024-05-09T02:18:24.213449+0000","last_fullsized":"2024-05-09T02:18:24.213449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194691+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:24.194691+0000","last_peered":"2024-05-09T02:18:24.194691+0000","last_clean":"2024-05-09T02:18:24.194691+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:24.194691+0000","last_undegraded":"2024-05-09T02:18:24.194691+0000","last_fullsized":"2024-05-09T02:18:24.194691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116786+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:18:25.116786+0000","last_peered":"2024-05-09T02:18:25.116786+0000","last_clean":"2024-05-09T02:18:25.116786+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:18:25.116786+0000","last_undegraded":"2024-05-09T02:18:25.116786+0000","last_fullsized":"2024-05-09T02:18:25.116786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200069+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:24.200069+0000","last_peered":"2024-05-09T02:18:24.200069+0000","last_clean":"2024-05-09T02:18:24.200069+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:24.200069+0000","last_undegraded":"2024-05-09T02:18:24.200069+0000","last_fullsized":"2024-05-09T02:18:24.200069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199888+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:18:24.199888+0000","last_peered":"2024-05-09T02:18:24.199888+0000","last_clean":"2024-05-09T02:18:24.199888+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:18:24.199888+0000","last_undegraded":"2024-05-09T02:18:24.199888+0000","last_fullsized":"2024-05-09T02:18:24.199888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213517+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:24.213517+0000","last_peered":"2024-05-09T02:18:24.213517+0000","last_clean":"2024-05-09T02:18:24.213517+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:24.213517+0000","last_undegraded":"2024-05-09T02:18:24.213517+0000","last_fullsized":"2024-05-09T02:18:24.213517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116516+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:18:25.116516+0000","last_peered":"2024-05-09T02:18:25.116516+0000","last_clean":"2024-05-09T02:18:25.116516+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:18:25.116516+0000","last_undegraded":"2024-05-09T02:18:25.116516+0000","last_fullsized":"2024-05-09T02:18:25.116516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117856+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:25.117856+0000","last_peered":"2024-05-09T02:18:25.117856+0000","last_clean":"2024-05-09T02:18:25.117856+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:25.117856+0000","last_undegraded":"2024-05-09T02:18:25.117856+0000","last_fullsized":"2024-05-09T02:18:25.117856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116831+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:18:25.116831+0000","last_peered":"2024-05-09T02:18:25.116831+0000","last_clean":"2024-05-09T02:18:25.116831+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:18:25.116831+0000","last_undegraded":"2024-05-09T02:18:25.116831+0000","last_fullsized":"2024-05-09T02:18:25.116831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200256+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:24.200256+0000","last_peered":"2024-05-09T02:18:24.200256+0000","last_clean":"2024-05-09T02:18:24.200256+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:24.200256+0000","last_undegraded":"2024-05-09T02:18:24.200256+0000","last_fullsized":"2024-05-09T02:18:24.200256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200283+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:18:24.200283+0000","last_peered":"2024-05-09T02:18:24.200283+0000","last_clean":"2024-05-09T02:18:24.200283+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:18:24.200283+0000","last_undegraded":"2024-05-09T02:18:24.200283+0000","last_fullsized":"2024-05-09T02:18:24.200283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544524+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:24.544524+0000","last_peered":"2024-05-09T02:18:24.544524+0000","last_clean":"2024-05-09T02:18:24.544524+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:24.544524+0000","last_undegraded":"2024-05-09T02:18:24.544524+0000","last_fullsized":"2024-05-09T02:18:24.544524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118322+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:18:25.118322+0000","last_peered":"2024-05-09T02:18:25.118322+0000","last_clean":"2024-05-09T02:18:25.118322+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:18:25.118322+0000","last_undegraded":"2024-05-09T02:18:25.118322+0000","last_fullsized":"2024-05-09T02:18:25.118322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199333+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:24.199333+0000","last_peered":"2024-05-09T02:18:24.199333+0000","last_clean":"2024-05-09T02:18:24.199333+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:24.199333+0000","last_undegraded":"2024-05-09T02:18:24.199333+0000","last_fullsized":"2024-05-09T02:18:24.199333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116756+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:18:25.116756+0000","last_peered":"2024-05-09T02:18:25.116756+0000","last_clean":"2024-05-09T02:18:25.116756+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:18:25.116756+0000","last_undegraded":"2024-05-09T02:18:25.116756+0000","last_fullsized":"2024-05-09T02:18:25.116756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544741+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:24.544741+0000","last_peered":"2024-05-09T02:18:24.544741+0000","last_clean":"2024-05-09T02:18:24.544741+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:24.544741+0000","last_undegraded":"2024-05-09T02:18:24.544741+0000","last_fullsized":"2024-05-09T02:18:24.544741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199644+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:18:24.199644+0000","last_peered":"2024-05-09T02:18:24.199644+0000","last_clean":"2024-05-09T02:18:24.199644+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:18:24.199644+0000","last_undegraded":"2024-05-09T02:18:24.199644+0000","last_fullsized":"2024-05-09T02:18:24.199644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194548+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:24.194548+0000","last_peered":"2024-05-09T02:18:24.194548+0000","last_clean":"2024-05-09T02:18:24.194548+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:24.194548+0000","last_undegraded":"2024-05-09T02:18:24.194548+0000","last_fullsized":"2024-05-09T02:18:24.194548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200449+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:18:24.200449+0000","last_peered":"2024-05-09T02:18:24.200449+0000","last_clean":"2024-05-09T02:18:24.200449+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:18:24.200449+0000","last_undegraded":"2024-05-09T02:18:24.200449+0000","last_fullsized":"2024-05-09T02:18:24.200449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117511+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:25.117511+0000","last_peered":"2024-05-09T02:18:25.117511+0000","last_clean":"2024-05-09T02:18:25.117511+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:25.117511+0000","last_undegraded":"2024-05-09T02:18:25.117511+0000","last_fullsized":"2024-05-09T02:18:25.117511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199759+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:18:24.199759+0000","last_peered":"2024-05-09T02:18:24.199759+0000","last_clean":"2024-05-09T02:18:24.199759+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:18:24.199759+0000","last_undegraded":"2024-05-09T02:18:24.199759+0000","last_fullsized":"2024-05-09T02:18:24.199759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117792+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:25.117792+0000","last_peered":"2024-05-09T02:18:25.117792+0000","last_clean":"2024-05-09T02:18:25.117792+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:25.117792+0000","last_undegraded":"2024-05-09T02:18:25.117792+0000","last_fullsized":"2024-05-09T02:18:25.117792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544399+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:18:24.544399+0000","last_peered":"2024-05-09T02:18:24.544399+0000","last_clean":"2024-05-09T02:18:24.544399+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:18:24.544399+0000","last_undegraded":"2024-05-09T02:18:24.544399+0000","last_fullsized":"2024-05-09T02:18:24.544399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116838+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:25.116838+0000","last_peered":"2024-05-09T02:18:25.116838+0000","last_clean":"2024-05-09T02:18:25.116838+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:25.116838+0000","last_undegraded":"2024-05-09T02:18:25.116838+0000","last_fullsized":"2024-05-09T02:18:25.116838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193965+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:18:24.193965+0000","last_peered":"2024-05-09T02:18:24.193965+0000","last_clean":"2024-05-09T02:18:24.193965+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:18:24.193965+0000","last_undegraded":"2024-05-09T02:18:24.193965+0000","last_fullsized":"2024-05-09T02:18:24.193965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545650+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:24.545650+0000","last_peered":"2024-05-09T02:18:24.545650+0000","last_clean":"2024-05-09T02:18:24.545650+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:24.545650+0000","last_undegraded":"2024-05-09T02:18:24.545650+0000","last_fullsized":"2024-05-09T02:18:24.545650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213025+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:18:24.213025+0000","last_peered":"2024-05-09T02:18:24.213025+0000","last_clean":"2024-05-09T02:18:24.213025+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:18:24.213025+0000","last_undegraded":"2024-05-09T02:18:24.213025+0000","last_fullsized":"2024-05-09T02:18:24.213025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544509+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:24.544509+0000","last_peered":"2024-05-09T02:18:24.544509+0000","last_clean":"2024-05-09T02:18:24.544509+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:24.544509+0000","last_undegraded":"2024-05-09T02:18:24.544509+0000","last_fullsized":"2024-05-09T02:18:24.544509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200878+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:18:24.200878+0000","last_peered":"2024-05-09T02:18:24.200878+0000","last_clean":"2024-05-09T02:18:24.200878+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:18:24.200878+0000","last_undegraded":"2024-05-09T02:18:24.200878+0000","last_fullsized":"2024-05-09T02:18:24.200878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212585+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:24.212585+0000","last_peered":"2024-05-09T02:18:24.212585+0000","last_clean":"2024-05-09T02:18:24.212585+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:24.212585+0000","last_undegraded":"2024-05-09T02:18:24.212585+0000","last_fullsized":"2024-05-09T02:18:24.212585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544885+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:18:24.544885+0000","last_peered":"2024-05-09T02:18:24.544885+0000","last_clean":"2024-05-09T02:18:24.544885+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:18:24.544885+0000","last_undegraded":"2024-05-09T02:18:24.544885+0000","last_fullsized":"2024-05-09T02:18:24.544885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194082+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:24.194082+0000","last_peered":"2024-05-09T02:18:24.194082+0000","last_clean":"2024-05-09T02:18:24.194082+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:24.194082+0000","last_undegraded":"2024-05-09T02:18:24.194082+0000","last_fullsized":"2024-05-09T02:18:24.194082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118000+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:18:25.118000+0000","last_peered":"2024-05-09T02:18:25.118000+0000","last_clean":"2024-05-09T02:18:25.118000+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:18:25.118000+0000","last_undegraded":"2024-05-09T02:18:25.118000+0000","last_fullsized":"2024-05-09T02:18:25.118000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199427+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:24.199427+0000","last_peered":"2024-05-09T02:18:24.199427+0000","last_clean":"2024-05-09T02:18:24.199427+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:24.199427+0000","last_undegraded":"2024-05-09T02:18:24.199427+0000","last_fullsized":"2024-05-09T02:18:24.199427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199676+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:18:24.199676+0000","last_peered":"2024-05-09T02:18:24.199676+0000","last_clean":"2024-05-09T02:18:24.199676+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:18:24.199676+0000","last_undegraded":"2024-05-09T02:18:24.199676+0000","last_fullsized":"2024-05-09T02:18:24.199676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200953+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:24.200953+0000","last_peered":"2024-05-09T02:18:24.200953+0000","last_clean":"2024-05-09T02:18:24.200953+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:24.200953+0000","last_undegraded":"2024-05-09T02:18:24.200953+0000","last_fullsized":"2024-05-09T02:18:24.200953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116902+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:18:25.116902+0000","last_peered":"2024-05-09T02:18:25.116902+0000","last_clean":"2024-05-09T02:18:25.116902+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:18:25.116902+0000","last_undegraded":"2024-05-09T02:18:25.116902+0000","last_fullsized":"2024-05-09T02:18:25.116902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117232+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:25.117232+0000","last_peered":"2024-05-09T02:18:25.117232+0000","last_clean":"2024-05-09T02:18:25.117232+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:25.117232+0000","last_undegraded":"2024-05-09T02:18:25.117232+0000","last_fullsized":"2024-05-09T02:18:25.117232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117481+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:18:25.117481+0000","last_peered":"2024-05-09T02:18:25.117481+0000","last_clean":"2024-05-09T02:18:25.117481+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:18:25.117481+0000","last_undegraded":"2024-05-09T02:18:25.117481+0000","last_fullsized":"2024-05-09T02:18:25.117481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117736+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:25.117736+0000","last_peered":"2024-05-09T02:18:25.117736+0000","last_clean":"2024-05-09T02:18:25.117736+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:25.117736+0000","last_undegraded":"2024-05-09T02:18:25.117736+0000","last_fullsized":"2024-05-09T02:18:25.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544734+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:18:24.544734+0000","last_peered":"2024-05-09T02:18:24.544734+0000","last_clean":"2024-05-09T02:18:24.544734+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:18:24.544734+0000","last_undegraded":"2024-05-09T02:18:24.544734+0000","last_fullsized":"2024-05-09T02:18:24.544734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118260+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:25.118260+0000","last_peered":"2024-05-09T02:18:25.118260+0000","last_clean":"2024-05-09T02:18:25.118260+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:25.118260+0000","last_undegraded":"2024-05-09T02:18:25.118260+0000","last_fullsized":"2024-05-09T02:18:25.118260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199800+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:18:24.199800+0000","last_peered":"2024-05-09T02:18:24.199800+0000","last_clean":"2024-05-09T02:18:24.199800+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:18:24.199800+0000","last_undegraded":"2024-05-09T02:18:24.199800+0000","last_fullsized":"2024-05-09T02:18:24.199800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199349+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:24.199349+0000","last_peered":"2024-05-09T02:18:24.199349+0000","last_clean":"2024-05-09T02:18:24.199349+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:24.199349+0000","last_undegraded":"2024-05-09T02:18:24.199349+0000","last_fullsized":"2024-05-09T02:18:24.199349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118052+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:18:25.118052+0000","last_peered":"2024-05-09T02:18:25.118052+0000","last_clean":"2024-05-09T02:18:25.118052+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:18:25.118052+0000","last_undegraded":"2024-05-09T02:18:25.118052+0000","last_fullsized":"2024-05-09T02:18:25.118052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116863+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:25.116863+0000","last_peered":"2024-05-09T02:18:25.116863+0000","last_clean":"2024-05-09T02:18:25.116863+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:25.116863+0000","last_undegraded":"2024-05-09T02:18:25.116863+0000","last_fullsized":"2024-05-09T02:18:25.116863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213378+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:18:24.213378+0000","last_peered":"2024-05-09T02:18:24.213378+0000","last_clean":"2024-05-09T02:18:24.213378+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:18:24.213378+0000","last_undegraded":"2024-05-09T02:18:24.213378+0000","last_fullsized":"2024-05-09T02:18:24.213378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545227+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:18:24.545227+0000","last_peered":"2024-05-09T02:18:24.545227+0000","last_clean":"2024-05-09T02:18:24.545227+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:18:24.545227+0000","last_undegraded":"2024-05-09T02:18:24.545227+0000","last_fullsized":"2024-05-09T02:18:24.545227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199515+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:18:24.199515+0000","last_peered":"2024-05-09T02:18:24.199515+0000","last_clean":"2024-05-09T02:18:24.199515+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:18:24.199515+0000","last_undegraded":"2024-05-09T02:18:24.199515+0000","last_fullsized":"2024-05-09T02:18:24.199515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545003+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:24.545003+0000","last_peered":"2024-05-09T02:18:24.545003+0000","last_clean":"2024-05-09T02:18:24.545003+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:24.545003+0000","last_undegraded":"2024-05-09T02:18:24.545003+0000","last_fullsized":"2024-05-09T02:18:24.545003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116685+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:18:25.116685+0000","last_peered":"2024-05-09T02:18:25.116685+0000","last_clean":"2024-05-09T02:18:25.116685+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:18:25.116685+0000","last_undegraded":"2024-05-09T02:18:25.116685+0000","last_fullsized":"2024-05-09T02:18:25.116685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194258+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:24.194258+0000","last_peered":"2024-05-09T02:18:24.194258+0000","last_clean":"2024-05-09T02:18:24.194258+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:24.194258+0000","last_undegraded":"2024-05-09T02:18:24.194258+0000","last_fullsized":"2024-05-09T02:18:24.194258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116880+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:18:25.116880+0000","last_peered":"2024-05-09T02:18:25.116880+0000","last_clean":"2024-05-09T02:18:25.116880+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:18:25.116880+0000","last_undegraded":"2024-05-09T02:18:25.116880+0000","last_fullsized":"2024-05-09T02:18:25.116880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213092+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:24.213092+0000","last_peered":"2024-05-09T02:18:24.213092+0000","last_clean":"2024-05-09T02:18:24.213092+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:24.213092+0000","last_undegraded":"2024-05-09T02:18:24.213092+0000","last_fullsized":"2024-05-09T02:18:24.213092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116857+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:18:25.116857+0000","last_peered":"2024-05-09T02:18:25.116857+0000","last_clean":"2024-05-09T02:18:25.116857+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:18:25.116857+0000","last_undegraded":"2024-05-09T02:18:25.116857+0000","last_fullsized":"2024-05-09T02:18:25.116857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118184+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:25.118184+0000","last_peered":"2024-05-09T02:18:25.118184+0000","last_clean":"2024-05-09T02:18:25.118184+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:25.118184+0000","last_undegraded":"2024-05-09T02:18:25.118184+0000","last_fullsized":"2024-05-09T02:18:25.118184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":106601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":107619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:45.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:45.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.168+0000 7f298e6f0640 1 Processor -- start 2024-05-09T02:18:45.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.169+0000 7f298e6f0640 1 -- start start 2024-05-09T02:18:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298e6f0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29880c3ed0 0x7f298815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298e6f0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29880c42e0 con 0x7f29880c3ac0 2024-05-09T02:18:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298e6f0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298815bdf0 con 0x7f2988155190 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298e6f0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f29880c30a0 con 0x7f29880c3ed0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298cc8d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29880c3ed0 0x7f298815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298cc8d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29880c3ed0 0x7f298815b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38580/0 (socket says 172.21.15.46:38580) 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298cc8d640 1 -- 172.21.15.46:0/1720212733 learned_addr learned my addr 172.21.15.46:0/1720212733 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298cc8d640 1 -- 172.21.15.46:0/1720212733 >> v1:172.21.15.107:6789/0 conn(0x7f2988155190 legacy=0x7f29880c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298cc8d640 1 -- 172.21.15.46:0/1720212733 >> v1:172.21.15.46:6789/0 conn(0x7f29880c3ac0 legacy=0x7f298815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f2986ffd640 1 -- 172.21.15.46:0/1720212733 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561242117 0 0) 0x7f29880c42e0 con 0x7f29880c3ac0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.171+0000 7f298cc8d640 1 -- 172.21.15.46:0/1720212733 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2988074260 con 0x7f29880c3ed0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.172+0000 7f298cc8d640 1 --2- 172.21.15.46:0/1720212733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f298815b8b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2980009e50 tx=0x7f298002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846fa01fe736bafe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.172+0000 7f2986ffd640 1 -- 172.21.15.46:0/1720212733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980036070 con 0x7f29880c3ed0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.172+0000 7f2986ffd640 1 -- 172.21.15.46:0/1720212733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2980031600 con 0x7f29880c3ed0 2024-05-09T02:18:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.172+0000 7f2986ffd640 1 -- 172.21.15.46:0/1720212733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29800319d0 con 0x7f29880c3ed0 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.173+0000 7f298e6f0640 1 -- 172.21.15.46:0/1720212733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 msgr2=0x7f298815b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.173+0000 7f298e6f0640 1 --2- 172.21.15.46:0/1720212733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f298815b8b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2980009e50 tx=0x7f298002a730 comp rx=0 tx=0).stop 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.173+0000 7f298e6f0640 1 -- 172.21.15.46:0/1720212733 shutdown_connections 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.174+0000 7f298e6f0640 1 --2- 172.21.15.46:0/1720212733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f298815b8b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.174+0000 7f298e6f0640 1 -- 172.21.15.46:0/1720212733 >> 172.21.15.46:0/1720212733 conn(0x7f29880c6770 msgr2=0x7f29880c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.174+0000 7f298e6f0640 1 -- 172.21.15.46:0/1720212733 shutdown_connections 2024-05-09T02:18:45.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.174+0000 7f298e6f0640 1 -- 172.21.15.46:0/1720212733 wait complete. 2024-05-09T02:18:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.175+0000 7f298e6f0640 1 Processor -- start 2024-05-09T02:18:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.175+0000 7f298e6f0640 1 -- start start 2024-05-09T02:18:45.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298e6f0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29880c3ac0 0x7f2988156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298e6f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f29881f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298e6f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988155190 0x7f2988149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298e6f0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f29881555a0 con 0x7f29880c3ed0 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298e6f0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f29880c3660 con 0x7f2988155190 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298e6f0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2988074820 con 0x7f29880c3ac0 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f29881f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f29881f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38582/0 (socket says 172.21.15.46:38582) 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 -- 172.21.15.46:0/3927386245 learned_addr learned my addr 172.21.15.46:0/3927386245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f298cc8d640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988155190 0x7f2988149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f2987fff640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29880c3ac0 0x7f2988156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 -- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29880c3ac0 msgr2=0x7f2988156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29880c3ac0 0x7f2988156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 -- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988155190 msgr2=0x7f2988149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988155190 0x7f2988149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 -- 172.21.15.46:0/3927386245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29880ac670 con 0x7f29880c3ed0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.177+0000 7f29877fe640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f29881f0d30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c370 tx=0x7f297c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.178+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c017070 con 0x7f29880c3ed0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.178+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c0035f0 con 0x7f29880c3ed0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.178+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c0039e0 con 0x7f29880c3ed0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.178+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298814dfc0 con 0x7f29880c3ed0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.178+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2988156b50 con 0x7f29880c3ed0 2024-05-09T02:18:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.179+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298806a330 con 0x7f29880c3ed0 2024-05-09T02:18:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.180+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f297c01a070 con 0x7f29880c3ed0 2024-05-09T02:18:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.180+0000 7f2984ff9640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2974076300 0x7f2974078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.180+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f297c0972d0 con 0x7f29880c3ed0 2024-05-09T02:18:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.180+0000 7f2987fff640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2974076300 0x7f2974078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.181+0000 7f2987fff640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2974076300 0x7f2974078810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2978000f60 tx=0x7f2978009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.184+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f297c021070 con 0x7f29880c3ed0 2024-05-09T02:18:45.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.372+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2988152500 con 0x7f2974076300 2024-05-09T02:18:45.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.384+0000 7f2984ff9640 1 -- 172.21.15.46:0/3927386245 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490290 (secure 0 0 0) 0x7f2978001440 con 0x7f2974076300 2024-05-09T02:18:45.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:45.398 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:45.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2974076300 msgr2=0x7f2974078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2974076300 0x7f2974078810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2978000f60 tx=0x7f2978009040 comp rx=0 tx=0).stop 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 msgr2=0x7f29881f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f29881f0d30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c370 tx=0x7f297c00c830 comp rx=0 tx=0).stop 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 shutdown_connections 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2974076300 0x7f2974078810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988155190 0x7f2988149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29880c3ed0 0x7f29881f0d30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 --2- 172.21.15.46:0/3927386245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29880c3ac0 0x7f2988156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.388+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 >> 172.21.15.46:0/3927386245 conn(0x7f29880c6770 msgr2=0x7f29880c4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:45.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.389+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 shutdown_connections 2024-05-09T02:18:45.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.389+0000 7f298e6f0640 1 -- 172.21.15.46:0/3927386245 wait complete. 2024-05-09T02:18:45.403 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-09T02:18:44.507169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595629,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":193,"num_write_kb":1658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":3448832,"data_stored":2022714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":441,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003910"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199693+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:18:24.199693+0000","last_peered":"2024-05-09T02:18:24.199693+0000","last_clean":"2024-05-09T02:18:24.199693+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:18:24.199693+0000","last_undegraded":"2024-05-09T02:18:24.199693+0000","last_fullsized":"2024-05-09T02:18:24.199693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194809+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:24.194809+0000","last_peered":"2024-05-09T02:18:24.194809+0000","last_clean":"2024-05-09T02:18:24.194809+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:24.194809+0000","last_undegraded":"2024-05-09T02:18:24.194809+0000","last_fullsized":"2024-05-09T02:18:24.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200366+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:24.200366+0000","last_peered":"2024-05-09T02:18:24.200366+0000","last_clean":"2024-05-09T02:18:24.200366+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:24.200366+0000","last_undegraded":"2024-05-09T02:18:24.200366+0000","last_fullsized":"2024-05-09T02:18:24.200366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199237+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:18:24.199237+0000","last_peered":"2024-05-09T02:18:24.199237+0000","last_clean":"2024-05-09T02:18:24.199237+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:18:24.199237+0000","last_undegraded":"2024-05-09T02:18:24.199237+0000","last_fullsized":"2024-05-09T02:18:24.199237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212516+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:18:24.212516+0000","last_peered":"2024-05-09T02:18:24.212516+0000","last_clean":"2024-05-09T02:18:24.212516+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:18:24.212516+0000","last_undegraded":"2024-05-09T02:18:24.212516+0000","last_fullsized":"2024-05-09T02:18:24.212516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200409+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:24.200409+0000","last_peered":"2024-05-09T02:18:24.200409+0000","last_clean":"2024-05-09T02:18:24.200409+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:24.200409+0000","last_undegraded":"2024-05-09T02:18:24.200409+0000","last_fullsized":"2024-05-09T02:18:24.200409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194737+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:24.194737+0000","last_peered":"2024-05-09T02:18:24.194737+0000","last_clean":"2024-05-09T02:18:24.194737+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:24.194737+0000","last_undegraded":"2024-05-09T02:18:24.194737+0000","last_fullsized":"2024-05-09T02:18:24.194737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199565+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:18:24.199565+0000","last_peered":"2024-05-09T02:18:24.199565+0000","last_clean":"2024-05-09T02:18:24.199565+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:18:24.199565+0000","last_undegraded":"2024-05-09T02:18:24.199565+0000","last_fullsized":"2024-05-09T02:18:24.199565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117680+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:25.117680+0000","last_peered":"2024-05-09T02:18:25.117680+0000","last_clean":"2024-05-09T02:18:25.117680+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:25.117680+0000","last_undegraded":"2024-05-09T02:18:25.117680+0000","last_fullsized":"2024-05-09T02:18:25.117680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545151+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:24.545151+0000","last_peered":"2024-05-09T02:18:24.545151+0000","last_clean":"2024-05-09T02:18:24.545151+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:24.545151+0000","last_undegraded":"2024-05-09T02:18:24.545151+0000","last_fullsized":"2024-05-09T02:18:24.545151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199967+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:18:24.199967+0000","last_peered":"2024-05-09T02:18:24.199967+0000","last_clean":"2024-05-09T02:18:24.199967+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:18:24.199967+0000","last_undegraded":"2024-05-09T02:18:24.199967+0000","last_fullsized":"2024-05-09T02:18:24.199967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544707+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:18:24.544707+0000","last_peered":"2024-05-09T02:18:24.544707+0000","last_clean":"2024-05-09T02:18:24.544707+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:18:24.544707+0000","last_undegraded":"2024-05-09T02:18:24.544707+0000","last_fullsized":"2024-05-09T02:18:24.544707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117346+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:25.117346+0000","last_peered":"2024-05-09T02:18:25.117346+0000","last_clean":"2024-05-09T02:18:25.117346+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:25.117346+0000","last_undegraded":"2024-05-09T02:18:25.117346+0000","last_fullsized":"2024-05-09T02:18:25.117346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545312+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:24.545312+0000","last_peered":"2024-05-09T02:18:24.545312+0000","last_clean":"2024-05-09T02:18:24.545312+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:24.545312+0000","last_undegraded":"2024-05-09T02:18:24.545312+0000","last_fullsized":"2024-05-09T02:18:24.545312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199878+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:18:24.199878+0000","last_peered":"2024-05-09T02:18:24.199878+0000","last_clean":"2024-05-09T02:18:24.199878+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:18:24.199878+0000","last_undegraded":"2024-05-09T02:18:24.199878+0000","last_fullsized":"2024-05-09T02:18:24.199878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213230+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:18:24.213230+0000","last_peered":"2024-05-09T02:18:24.213230+0000","last_clean":"2024-05-09T02:18:24.213230+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:18:24.213230+0000","last_undegraded":"2024-05-09T02:18:24.213230+0000","last_fullsized":"2024-05-09T02:18:24.213230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116725+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:25.116725+0000","last_peered":"2024-05-09T02:18:25.116725+0000","last_clean":"2024-05-09T02:18:25.116725+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:25.116725+0000","last_undegraded":"2024-05-09T02:18:25.116725+0000","last_fullsized":"2024-05-09T02:18:25.116725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117491+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:25.117491+0000","last_peered":"2024-05-09T02:18:25.117491+0000","last_clean":"2024-05-09T02:18:25.117491+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:25.117491+0000","last_undegraded":"2024-05-09T02:18:25.117491+0000","last_fullsized":"2024-05-09T02:18:25.117491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200557+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:18:24.200557+0000","last_peered":"2024-05-09T02:18:24.200557+0000","last_clean":"2024-05-09T02:18:24.200557+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:18:24.200557+0000","last_undegraded":"2024-05-09T02:18:24.200557+0000","last_fullsized":"2024-05-09T02:18:24.200557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117023+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:18:25.117023+0000","last_peered":"2024-05-09T02:18:25.117023+0000","last_clean":"2024-05-09T02:18:25.117023+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:18:25.117023+0000","last_undegraded":"2024-05-09T02:18:25.117023+0000","last_fullsized":"2024-05-09T02:18:25.117023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199802+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:24.199802+0000","last_peered":"2024-05-09T02:18:24.199802+0000","last_clean":"2024-05-09T02:18:24.199802+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:24.199802+0000","last_undegraded":"2024-05-09T02:18:24.199802+0000","last_fullsized":"2024-05-09T02:18:24.199802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212930+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:24.212930+0000","last_peered":"2024-05-09T02:18:24.212930+0000","last_clean":"2024-05-09T02:18:24.212930+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:24.212930+0000","last_undegraded":"2024-05-09T02:18:24.212930+0000","last_fullsized":"2024-05-09T02:18:24.212930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200551+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:18:24.200551+0000","last_peered":"2024-05-09T02:18:24.200551+0000","last_clean":"2024-05-09T02:18:24.200551+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:18:24.200551+0000","last_undegraded":"2024-05-09T02:18:24.200551+0000","last_fullsized":"2024-05-09T02:18:24.200551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200686+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:18:24.200686+0000","last_peered":"2024-05-09T02:18:24.200686+0000","last_clean":"2024-05-09T02:18:24.200686+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:18:24.200686+0000","last_undegraded":"2024-05-09T02:18:24.200686+0000","last_fullsized":"2024-05-09T02:18:24.200686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200229+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:24.200229+0000","last_peered":"2024-05-09T02:18:24.200229+0000","last_clean":"2024-05-09T02:18:24.200229+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:24.200229+0000","last_undegraded":"2024-05-09T02:18:24.200229+0000","last_fullsized":"2024-05-09T02:18:24.200229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212619+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:24.212619+0000","last_peered":"2024-05-09T02:18:24.212619+0000","last_clean":"2024-05-09T02:18:24.212619+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:24.212619+0000","last_undegraded":"2024-05-09T02:18:24.212619+0000","last_fullsized":"2024-05-09T02:18:24.212619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213272+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:18:24.213272+0000","last_peered":"2024-05-09T02:18:24.213272+0000","last_clean":"2024-05-09T02:18:24.213272+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:18:24.213272+0000","last_undegraded":"2024-05-09T02:18:24.213272+0000","last_fullsized":"2024-05-09T02:18:24.213272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545447+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:18:24.545447+0000","last_peered":"2024-05-09T02:18:24.545447+0000","last_clean":"2024-05-09T02:18:24.545447+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:18:24.545447+0000","last_undegraded":"2024-05-09T02:18:24.545447+0000","last_fullsized":"2024-05-09T02:18:24.545447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200114+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:24.200114+0000","last_peered":"2024-05-09T02:18:24.200114+0000","last_clean":"2024-05-09T02:18:24.200114+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:24.200114+0000","last_undegraded":"2024-05-09T02:18:24.200114+0000","last_fullsized":"2024-05-09T02:18:24.200114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117121+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:25.117121+0000","last_peered":"2024-05-09T02:18:25.117121+0000","last_clean":"2024-05-09T02:18:25.117121+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:25.117121+0000","last_undegraded":"2024-05-09T02:18:25.117121+0000","last_fullsized":"2024-05-09T02:18:25.117121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200694+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:18:24.200694+0000","last_peered":"2024-05-09T02:18:24.200694+0000","last_clean":"2024-05-09T02:18:24.200694+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:18:24.200694+0000","last_undegraded":"2024-05-09T02:18:24.200694+0000","last_fullsized":"2024-05-09T02:18:24.200694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199079+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:18:24.199079+0000","last_peered":"2024-05-09T02:18:24.199079+0000","last_clean":"2024-05-09T02:18:24.199079+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:18:24.199079+0000","last_undegraded":"2024-05-09T02:18:24.199079+0000","last_fullsized":"2024-05-09T02:18:24.199079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194623+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:24.194623+0000","last_peered":"2024-05-09T02:18:24.194623+0000","last_clean":"2024-05-09T02:18:24.194623+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:24.194623+0000","last_undegraded":"2024-05-09T02:18:24.194623+0000","last_fullsized":"2024-05-09T02:18:24.194623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118230+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:25.118230+0000","last_peered":"2024-05-09T02:18:25.118230+0000","last_clean":"2024-05-09T02:18:25.118230+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:25.118230+0000","last_undegraded":"2024-05-09T02:18:25.118230+0000","last_fullsized":"2024-05-09T02:18:25.118230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199762+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:18:24.199762+0000","last_peered":"2024-05-09T02:18:24.199762+0000","last_clean":"2024-05-09T02:18:24.199762+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:18:24.199762+0000","last_undegraded":"2024-05-09T02:18:24.199762+0000","last_fullsized":"2024-05-09T02:18:24.199762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199671+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:18:24.199671+0000","last_peered":"2024-05-09T02:18:24.199671+0000","last_clean":"2024-05-09T02:18:24.199671+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:18:24.199671+0000","last_undegraded":"2024-05-09T02:18:24.199671+0000","last_fullsized":"2024-05-09T02:18:24.199671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200278+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:24.200278+0000","last_peered":"2024-05-09T02:18:24.200278+0000","last_clean":"2024-05-09T02:18:24.200278+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:24.200278+0000","last_undegraded":"2024-05-09T02:18:24.200278+0000","last_fullsized":"2024-05-09T02:18:24.200278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213294+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:24.213294+0000","last_peered":"2024-05-09T02:18:24.213294+0000","last_clean":"2024-05-09T02:18:24.213294+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:24.213294+0000","last_undegraded":"2024-05-09T02:18:24.213294+0000","last_fullsized":"2024-05-09T02:18:24.213294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199015+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:18:24.199015+0000","last_peered":"2024-05-09T02:18:24.199015+0000","last_clean":"2024-05-09T02:18:24.199015+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:18:24.199015+0000","last_undegraded":"2024-05-09T02:18:24.199015+0000","last_fullsized":"2024-05-09T02:18:24.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116593+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:18:25.116593+0000","last_peered":"2024-05-09T02:18:25.116593+0000","last_clean":"2024-05-09T02:18:25.116593+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:18:25.116593+0000","last_undegraded":"2024-05-09T02:18:25.116593+0000","last_fullsized":"2024-05-09T02:18:25.116593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213438+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:24.213438+0000","last_peered":"2024-05-09T02:18:24.213438+0000","last_clean":"2024-05-09T02:18:24.213438+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:24.213438+0000","last_undegraded":"2024-05-09T02:18:24.213438+0000","last_fullsized":"2024-05-09T02:18:24.213438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117923+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:25.117923+0000","last_peered":"2024-05-09T02:18:25.117923+0000","last_clean":"2024-05-09T02:18:25.117923+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:25.117923+0000","last_undegraded":"2024-05-09T02:18:25.117923+0000","last_fullsized":"2024-05-09T02:18:25.117923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194343+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:18:24.194343+0000","last_peered":"2024-05-09T02:18:24.194343+0000","last_clean":"2024-05-09T02:18:24.194343+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:18:24.194343+0000","last_undegraded":"2024-05-09T02:18:24.194343+0000","last_fullsized":"2024-05-09T02:18:24.194343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194795+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:18:24.194795+0000","last_peered":"2024-05-09T02:18:24.194795+0000","last_clean":"2024-05-09T02:18:24.194795+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:18:24.194795+0000","last_undegraded":"2024-05-09T02:18:24.194795+0000","last_fullsized":"2024-05-09T02:18:24.194795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545446+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:24.545446+0000","last_peered":"2024-05-09T02:18:24.545446+0000","last_clean":"2024-05-09T02:18:24.545446+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:24.545446+0000","last_undegraded":"2024-05-09T02:18:24.545446+0000","last_fullsized":"2024-05-09T02:18:24.545446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213541+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:24.213541+0000","last_peered":"2024-05-09T02:18:24.213541+0000","last_clean":"2024-05-09T02:18:24.213541+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:24.213541+0000","last_undegraded":"2024-05-09T02:18:24.213541+0000","last_fullsized":"2024-05-09T02:18:24.213541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212698+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:18:24.212698+0000","last_peered":"2024-05-09T02:18:24.212698+0000","last_clean":"2024-05-09T02:18:24.212698+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:18:24.212698+0000","last_undegraded":"2024-05-09T02:18:24.212698+0000","last_fullsized":"2024-05-09T02:18:24.212698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194413+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:18:24.194413+0000","last_peered":"2024-05-09T02:18:24.194413+0000","last_clean":"2024-05-09T02:18:24.194413+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:18:24.194413+0000","last_undegraded":"2024-05-09T02:18:24.194413+0000","last_fullsized":"2024-05-09T02:18:24.194413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200494+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:24.200494+0000","last_peered":"2024-05-09T02:18:24.200494+0000","last_clean":"2024-05-09T02:18:24.200494+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:24.200494+0000","last_undegraded":"2024-05-09T02:18:24.200494+0000","last_fullsized":"2024-05-09T02:18:24.200494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545086+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:24.545086+0000","last_peered":"2024-05-09T02:18:24.545086+0000","last_clean":"2024-05-09T02:18:24.545086+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:24.545086+0000","last_undegraded":"2024-05-09T02:18:24.545086+0000","last_fullsized":"2024-05-09T02:18:24.545086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213293+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:18:24.213293+0000","last_peered":"2024-05-09T02:18:24.213293+0000","last_clean":"2024-05-09T02:18:24.213293+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:18:24.213293+0000","last_undegraded":"2024-05-09T02:18:24.213293+0000","last_fullsized":"2024-05-09T02:18:24.213293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117109+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:18:25.117109+0000","last_peered":"2024-05-09T02:18:25.117109+0000","last_clean":"2024-05-09T02:18:25.117109+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:18:25.117109+0000","last_undegraded":"2024-05-09T02:18:25.117109+0000","last_fullsized":"2024-05-09T02:18:25.117109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212497+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:24.212497+0000","last_peered":"2024-05-09T02:18:24.212497+0000","last_clean":"2024-05-09T02:18:24.212497+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:24.212497+0000","last_undegraded":"2024-05-09T02:18:24.212497+0000","last_fullsized":"2024-05-09T02:18:24.212497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116723+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:25.116723+0000","last_peered":"2024-05-09T02:18:25.116723+0000","last_clean":"2024-05-09T02:18:25.116723+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:25.116723+0000","last_undegraded":"2024-05-09T02:18:25.116723+0000","last_fullsized":"2024-05-09T02:18:25.116723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213274+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:18:24.213274+0000","last_peered":"2024-05-09T02:18:24.213274+0000","last_clean":"2024-05-09T02:18:24.213274+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:18:24.213274+0000","last_undegraded":"2024-05-09T02:18:24.213274+0000","last_fullsized":"2024-05-09T02:18:24.213274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545598+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:18:24.545598+0000","last_peered":"2024-05-09T02:18:24.545598+0000","last_clean":"2024-05-09T02:18:24.545598+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:18:24.545598+0000","last_undegraded":"2024-05-09T02:18:24.545598+0000","last_fullsized":"2024-05-09T02:18:24.545598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193902+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:24.193902+0000","last_peered":"2024-05-09T02:18:24.193902+0000","last_clean":"2024-05-09T02:18:24.193902+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:24.193902+0000","last_undegraded":"2024-05-09T02:18:24.193902+0000","last_fullsized":"2024-05-09T02:18:24.193902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117239+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:25.117239+0000","last_peered":"2024-05-09T02:18:25.117239+0000","last_clean":"2024-05-09T02:18:25.117239+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:25.117239+0000","last_undegraded":"2024-05-09T02:18:25.117239+0000","last_fullsized":"2024-05-09T02:18:25.117239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194546+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:18:24.194546+0000","last_peered":"2024-05-09T02:18:24.194546+0000","last_clean":"2024-05-09T02:18:24.194546+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:18:24.194546+0000","last_undegraded":"2024-05-09T02:18:24.194546+0000","last_fullsized":"2024-05-09T02:18:24.194546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117439+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:18:25.117439+0000","last_peered":"2024-05-09T02:18:25.117439+0000","last_clean":"2024-05-09T02:18:25.117439+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:18:25.117439+0000","last_undegraded":"2024-05-09T02:18:25.117439+0000","last_fullsized":"2024-05-09T02:18:25.117439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199819+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:24.199819+0000","last_peered":"2024-05-09T02:18:24.199819+0000","last_clean":"2024-05-09T02:18:24.199819+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:24.199819+0000","last_undegraded":"2024-05-09T02:18:24.199819+0000","last_fullsized":"2024-05-09T02:18:24.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544691+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:24.544691+0000","last_peered":"2024-05-09T02:18:24.544691+0000","last_clean":"2024-05-09T02:18:24.544691+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:24.544691+0000","last_undegraded":"2024-05-09T02:18:24.544691+0000","last_fullsized":"2024-05-09T02:18:24.544691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117558+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:25.117558+0000","last_peered":"2024-05-09T02:18:25.117558+0000","last_clean":"2024-05-09T02:18:25.117558+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:25.117558+0000","last_undegraded":"2024-05-09T02:18:25.117558+0000","last_fullsized":"2024-05-09T02:18:25.117558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117570+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:25.117570+0000","last_peered":"2024-05-09T02:18:25.117570+0000","last_clean":"2024-05-09T02:18:25.117570+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:25.117570+0000","last_undegraded":"2024-05-09T02:18:25.117570+0000","last_fullsized":"2024-05-09T02:18:25.117570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117008+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:25.117008+0000","last_peered":"2024-05-09T02:18:25.117008+0000","last_clean":"2024-05-09T02:18:25.117008+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:25.117008+0000","last_undegraded":"2024-05-09T02:18:25.117008+0000","last_fullsized":"2024-05-09T02:18:25.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116656+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:18:25.116656+0000","last_peered":"2024-05-09T02:18:25.116656+0000","last_clean":"2024-05-09T02:18:25.116656+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:18:25.116656+0000","last_undegraded":"2024-05-09T02:18:25.116656+0000","last_fullsized":"2024-05-09T02:18:25.116656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545429+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:24.545429+0000","last_peered":"2024-05-09T02:18:24.545429+0000","last_clean":"2024-05-09T02:18:24.545429+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:24.545429+0000","last_undegraded":"2024-05-09T02:18:24.545429+0000","last_fullsized":"2024-05-09T02:18:24.545429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213599+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:24.213599+0000","last_peered":"2024-05-09T02:18:24.213599+0000","last_clean":"2024-05-09T02:18:24.213599+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:24.213599+0000","last_undegraded":"2024-05-09T02:18:24.213599+0000","last_fullsized":"2024-05-09T02:18:24.213599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194066+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:18:24.194066+0000","last_peered":"2024-05-09T02:18:24.194066+0000","last_clean":"2024-05-09T02:18:24.194066+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:18:24.194066+0000","last_undegraded":"2024-05-09T02:18:24.194066+0000","last_fullsized":"2024-05-09T02:18:24.194066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118369+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:25.118369+0000","last_peered":"2024-05-09T02:18:25.118369+0000","last_clean":"2024-05-09T02:18:25.118369+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:25.118369+0000","last_undegraded":"2024-05-09T02:18:25.118369+0000","last_fullsized":"2024-05-09T02:18:25.118369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117107+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:25.117107+0000","last_peered":"2024-05-09T02:18:25.117107+0000","last_clean":"2024-05-09T02:18:25.117107+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:25.117107+0000","last_undegraded":"2024-05-09T02:18:25.117107+0000","last_fullsized":"2024-05-09T02:18:25.117107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544340+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:18:24.544340+0000","last_peered":"2024-05-09T02:18:24.544340+0000","last_clean":"2024-05-09T02:18:24.544340+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:18:24.544340+0000","last_undegraded":"2024-05-09T02:18:24.544340+0000","last_fullsized":"2024-05-09T02:18:24.544340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116753+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:18:25.116753+0000","last_peered":"2024-05-09T02:18:25.116753+0000","last_clean":"2024-05-09T02:18:25.116753+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:18:25.116753+0000","last_undegraded":"2024-05-09T02:18:25.116753+0000","last_fullsized":"2024-05-09T02:18:25.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117832+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:25.117832+0000","last_peered":"2024-05-09T02:18:25.117832+0000","last_clean":"2024-05-09T02:18:25.117832+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:25.117832+0000","last_undegraded":"2024-05-09T02:18:25.117832+0000","last_fullsized":"2024-05-09T02:18:25.117832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201043+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:24.201043+0000","last_peered":"2024-05-09T02:18:24.201043+0000","last_clean":"2024-05-09T02:18:24.201043+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:24.201043+0000","last_undegraded":"2024-05-09T02:18:24.201043+0000","last_fullsized":"2024-05-09T02:18:24.201043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199591+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:18:24.199591+0000","last_peered":"2024-05-09T02:18:24.199591+0000","last_clean":"2024-05-09T02:18:24.199591+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:18:24.199591+0000","last_undegraded":"2024-05-09T02:18:24.199591+0000","last_fullsized":"2024-05-09T02:18:24.199591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200090+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:18:24.200090+0000","last_peered":"2024-05-09T02:18:24.200090+0000","last_clean":"2024-05-09T02:18:24.200090+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:18:24.200090+0000","last_undegraded":"2024-05-09T02:18:24.200090+0000","last_fullsized":"2024-05-09T02:18:24.200090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116454+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:25.116454+0000","last_peered":"2024-05-09T02:18:25.116454+0000","last_clean":"2024-05-09T02:18:25.116454+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:25.116454+0000","last_undegraded":"2024-05-09T02:18:25.116454+0000","last_fullsized":"2024-05-09T02:18:25.116454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194601+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:18:24.194601+0000","last_peered":"2024-05-09T02:18:24.194601+0000","last_clean":"2024-05-09T02:18:24.194601+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:18:24.194601+0000","last_undegraded":"2024-05-09T02:18:24.194601+0000","last_fullsized":"2024-05-09T02:18:24.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545288+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:18:24.545288+0000","last_peered":"2024-05-09T02:18:24.545288+0000","last_clean":"2024-05-09T02:18:24.545288+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:18:24.545288+0000","last_undegraded":"2024-05-09T02:18:24.545288+0000","last_fullsized":"2024-05-09T02:18:24.545288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116481+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:25.116481+0000","last_peered":"2024-05-09T02:18:25.116481+0000","last_clean":"2024-05-09T02:18:25.116481+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:25.116481+0000","last_undegraded":"2024-05-09T02:18:25.116481+0000","last_fullsized":"2024-05-09T02:18:25.116481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117146+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:25.117146+0000","last_peered":"2024-05-09T02:18:25.117146+0000","last_clean":"2024-05-09T02:18:25.117146+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:25.117146+0000","last_undegraded":"2024-05-09T02:18:25.117146+0000","last_fullsized":"2024-05-09T02:18:25.117146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200150+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:18:24.200150+0000","last_peered":"2024-05-09T02:18:24.200150+0000","last_clean":"2024-05-09T02:18:24.200150+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:18:24.200150+0000","last_undegraded":"2024-05-09T02:18:24.200150+0000","last_fullsized":"2024-05-09T02:18:24.200150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544937+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:18:24.544937+0000","last_peered":"2024-05-09T02:18:24.544937+0000","last_clean":"2024-05-09T02:18:24.544937+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:18:24.544937+0000","last_undegraded":"2024-05-09T02:18:24.544937+0000","last_fullsized":"2024-05-09T02:18:24.544937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117143+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:25.117143+0000","last_peered":"2024-05-09T02:18:25.117143+0000","last_clean":"2024-05-09T02:18:25.117143+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:25.117143+0000","last_undegraded":"2024-05-09T02:18:25.117143+0000","last_fullsized":"2024-05-09T02:18:25.117143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545038+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:24.545038+0000","last_peered":"2024-05-09T02:18:24.545038+0000","last_clean":"2024-05-09T02:18:24.545038+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:24.545038+0000","last_undegraded":"2024-05-09T02:18:24.545038+0000","last_fullsized":"2024-05-09T02:18:24.545038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199798+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:18:24.199798+0000","last_peered":"2024-05-09T02:18:24.199798+0000","last_clean":"2024-05-09T02:18:24.199798+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:18:24.199798+0000","last_undegraded":"2024-05-09T02:18:24.199798+0000","last_fullsized":"2024-05-09T02:18:24.199798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200009+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:18:24.200009+0000","last_peered":"2024-05-09T02:18:24.200009+0000","last_clean":"2024-05-09T02:18:24.200009+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:18:24.200009+0000","last_undegraded":"2024-05-09T02:18:24.200009+0000","last_fullsized":"2024-05-09T02:18:24.200009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194050+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:24.194050+0000","last_peered":"2024-05-09T02:18:24.194050+0000","last_clean":"2024-05-09T02:18:24.194050+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:24.194050+0000","last_undegraded":"2024-05-09T02:18:24.194050+0000","last_fullsized":"2024-05-09T02:18:24.194050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194934+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:24.194934+0000","last_peered":"2024-05-09T02:18:24.194934+0000","last_clean":"2024-05-09T02:18:24.194934+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:24.194934+0000","last_undegraded":"2024-05-09T02:18:24.194934+0000","last_fullsized":"2024-05-09T02:18:24.194934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545295+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:18:24.545295+0000","last_peered":"2024-05-09T02:18:24.545295+0000","last_clean":"2024-05-09T02:18:24.545295+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:18:24.545295+0000","last_undegraded":"2024-05-09T02:18:24.545295+0000","last_fullsized":"2024-05-09T02:18:24.545295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199929+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:18:24.199929+0000","last_peered":"2024-05-09T02:18:24.199929+0000","last_clean":"2024-05-09T02:18:24.199929+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:18:24.199929+0000","last_undegraded":"2024-05-09T02:18:24.199929+0000","last_fullsized":"2024-05-09T02:18:24.199929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117435+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:25.117435+0000","last_peered":"2024-05-09T02:18:25.117435+0000","last_clean":"2024-05-09T02:18:25.117435+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:25.117435+0000","last_undegraded":"2024-05-09T02:18:25.117435+0000","last_fullsized":"2024-05-09T02:18:25.117435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:39.630776+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:39.630776+0000","last_peered":"2024-05-09T02:18:39.630776+0000","last_clean":"2024-05-09T02:18:39.630776+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:39.630776+0000","last_undegraded":"2024-05-09T02:18:39.630776+0000","last_fullsized":"2024-05-09T02:18:39.630776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212549+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:18:24.212549+0000","last_peered":"2024-05-09T02:18:24.212549+0000","last_clean":"2024-05-09T02:18:24.212549+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:18:24.212549+0000","last_undegraded":"2024-05-09T02:18:24.212549+0000","last_fullsized":"2024-05-09T02:18:24.212549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212872+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:18:24.212872+0000","last_peered":"2024-05-09T02:18:24.212872+0000","last_clean":"2024-05-09T02:18:24.212872+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:18:24.212872+0000","last_undegraded":"2024-05-09T02:18:24.212872+0000","last_fullsized":"2024-05-09T02:18:24.212872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201035+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:24.201035+0000","last_peered":"2024-05-09T02:18:24.201035+0000","last_clean":"2024-05-09T02:18:24.201035+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:24.201035+0000","last_undegraded":"2024-05-09T02:18:24.201035+0000","last_fullsized":"2024-05-09T02:18:24.201035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213593+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:24.213593+0000","last_peered":"2024-05-09T02:18:24.213593+0000","last_clean":"2024-05-09T02:18:24.213593+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:24.213593+0000","last_undegraded":"2024-05-09T02:18:24.213593+0000","last_fullsized":"2024-05-09T02:18:24.213593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200111+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:18:24.200111+0000","last_peered":"2024-05-09T02:18:24.200111+0000","last_clean":"2024-05-09T02:18:24.200111+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:18:24.200111+0000","last_undegraded":"2024-05-09T02:18:24.200111+0000","last_fullsized":"2024-05-09T02:18:24.200111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117015+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:18:25.117015+0000","last_peered":"2024-05-09T02:18:25.117015+0000","last_clean":"2024-05-09T02:18:25.117015+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:18:25.117015+0000","last_undegraded":"2024-05-09T02:18:25.117015+0000","last_fullsized":"2024-05-09T02:18:25.117015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194791+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:24.194791+0000","last_peered":"2024-05-09T02:18:24.194791+0000","last_clean":"2024-05-09T02:18:24.194791+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:24.194791+0000","last_undegraded":"2024-05-09T02:18:24.194791+0000","last_fullsized":"2024-05-09T02:18:24.194791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545365+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:24.545365+0000","last_peered":"2024-05-09T02:18:24.545365+0000","last_clean":"2024-05-09T02:18:24.545365+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:24.545365+0000","last_undegraded":"2024-05-09T02:18:24.545365+0000","last_fullsized":"2024-05-09T02:18:24.545365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199144+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:18:24.199144+0000","last_peered":"2024-05-09T02:18:24.199144+0000","last_clean":"2024-05-09T02:18:24.199144+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:18:24.199144+0000","last_undegraded":"2024-05-09T02:18:24.199144+0000","last_fullsized":"2024-05-09T02:18:24.199144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117861+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:18:25.117861+0000","last_peered":"2024-05-09T02:18:25.117861+0000","last_clean":"2024-05-09T02:18:25.117861+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:18:25.117861+0000","last_undegraded":"2024-05-09T02:18:25.117861+0000","last_fullsized":"2024-05-09T02:18:25.117861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545293+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:24.545293+0000","last_peered":"2024-05-09T02:18:24.545293+0000","last_clean":"2024-05-09T02:18:24.545293+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:24.545293+0000","last_undegraded":"2024-05-09T02:18:24.545293+0000","last_fullsized":"2024-05-09T02:18:24.545293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118231+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:25.118231+0000","last_peered":"2024-05-09T02:18:25.118231+0000","last_clean":"2024-05-09T02:18:25.118231+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:25.118231+0000","last_undegraded":"2024-05-09T02:18:25.118231+0000","last_fullsized":"2024-05-09T02:18:25.118231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199116+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:18:24.199116+0000","last_peered":"2024-05-09T02:18:24.199116+0000","last_clean":"2024-05-09T02:18:24.199116+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:18:24.199116+0000","last_undegraded":"2024-05-09T02:18:24.199116+0000","last_fullsized":"2024-05-09T02:18:24.199116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118154+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:18:25.118154+0000","last_peered":"2024-05-09T02:18:25.118154+0000","last_clean":"2024-05-09T02:18:25.118154+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:18:25.118154+0000","last_undegraded":"2024-05-09T02:18:25.118154+0000","last_fullsized":"2024-05-09T02:18:25.118154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194363+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:18:24.194363+0000","last_peered":"2024-05-09T02:18:24.194363+0000","last_clean":"2024-05-09T02:18:24.194363+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:18:24.194363+0000","last_undegraded":"2024-05-09T02:18:24.194363+0000","last_fullsized":"2024-05-09T02:18:24.194363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212490+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:24.212490+0000","last_peered":"2024-05-09T02:18:24.212490+0000","last_clean":"2024-05-09T02:18:24.212490+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:24.212490+0000","last_undegraded":"2024-05-09T02:18:24.212490+0000","last_fullsized":"2024-05-09T02:18:24.212490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194441+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:18:24.194441+0000","last_peered":"2024-05-09T02:18:24.194441+0000","last_clean":"2024-05-09T02:18:24.194441+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:18:24.194441+0000","last_undegraded":"2024-05-09T02:18:24.194441+0000","last_fullsized":"2024-05-09T02:18:24.194441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118101+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:18:25.118101+0000","last_peered":"2024-05-09T02:18:25.118101+0000","last_clean":"2024-05-09T02:18:25.118101+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:18:25.118101+0000","last_undegraded":"2024-05-09T02:18:25.118101+0000","last_fullsized":"2024-05-09T02:18:25.118101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199684+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:24.199684+0000","last_peered":"2024-05-09T02:18:24.199684+0000","last_clean":"2024-05-09T02:18:24.199684+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:24.199684+0000","last_undegraded":"2024-05-09T02:18:24.199684+0000","last_fullsized":"2024-05-09T02:18:24.199684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199561+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:24.199561+0000","last_peered":"2024-05-09T02:18:24.199561+0000","last_clean":"2024-05-09T02:18:24.199561+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:24.199561+0000","last_undegraded":"2024-05-09T02:18:24.199561+0000","last_fullsized":"2024-05-09T02:18:24.199561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213468+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:18:24.213468+0000","last_peered":"2024-05-09T02:18:24.213468+0000","last_clean":"2024-05-09T02:18:24.213468+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:18:24.213468+0000","last_undegraded":"2024-05-09T02:18:24.213468+0000","last_fullsized":"2024-05-09T02:18:24.213468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116796+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:25.116796+0000","last_peered":"2024-05-09T02:18:25.116796+0000","last_clean":"2024-05-09T02:18:25.116796+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:25.116796+0000","last_undegraded":"2024-05-09T02:18:25.116796+0000","last_fullsized":"2024-05-09T02:18:25.116796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194815+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:24.194815+0000","last_peered":"2024-05-09T02:18:24.194815+0000","last_clean":"2024-05-09T02:18:24.194815+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:24.194815+0000","last_undegraded":"2024-05-09T02:18:24.194815+0000","last_fullsized":"2024-05-09T02:18:24.194815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116805+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:18:25.116805+0000","last_peered":"2024-05-09T02:18:25.116805+0000","last_clean":"2024-05-09T02:18:25.116805+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:18:25.116805+0000","last_undegraded":"2024-05-09T02:18:25.116805+0000","last_fullsized":"2024-05-09T02:18:25.116805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200413+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:18:24.200413+0000","last_peered":"2024-05-09T02:18:24.200413+0000","last_clean":"2024-05-09T02:18:24.200413+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:18:24.200413+0000","last_undegraded":"2024-05-09T02:18:24.200413+0000","last_fullsized":"2024-05-09T02:18:24.200413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200002+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:24.200002+0000","last_peered":"2024-05-09T02:18:24.200002+0000","last_clean":"2024-05-09T02:18:24.200002+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:24.200002+0000","last_undegraded":"2024-05-09T02:18:24.200002+0000","last_fullsized":"2024-05-09T02:18:24.200002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200154+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:24.200154+0000","last_peered":"2024-05-09T02:18:24.200154+0000","last_clean":"2024-05-09T02:18:24.200154+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:24.200154+0000","last_undegraded":"2024-05-09T02:18:24.200154+0000","last_fullsized":"2024-05-09T02:18:24.200154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199852+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:18:24.199852+0000","last_peered":"2024-05-09T02:18:24.199852+0000","last_clean":"2024-05-09T02:18:24.199852+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:18:24.199852+0000","last_undegraded":"2024-05-09T02:18:24.199852+0000","last_fullsized":"2024-05-09T02:18:24.199852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200142+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:18:24.200142+0000","last_peered":"2024-05-09T02:18:24.200142+0000","last_clean":"2024-05-09T02:18:24.200142+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:18:24.200142+0000","last_undegraded":"2024-05-09T02:18:24.200142+0000","last_fullsized":"2024-05-09T02:18:24.200142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116363+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:25.116363+0000","last_peered":"2024-05-09T02:18:25.116363+0000","last_clean":"2024-05-09T02:18:25.116363+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:25.116363+0000","last_undegraded":"2024-05-09T02:18:25.116363+0000","last_fullsized":"2024-05-09T02:18:25.116363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213190+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:18:24.213190+0000","last_peered":"2024-05-09T02:18:24.213190+0000","last_clean":"2024-05-09T02:18:24.213190+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:18:24.213190+0000","last_undegraded":"2024-05-09T02:18:24.213190+0000","last_fullsized":"2024-05-09T02:18:24.213190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116452+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:25.116452+0000","last_peered":"2024-05-09T02:18:25.116452+0000","last_clean":"2024-05-09T02:18:25.116452+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:25.116452+0000","last_undegraded":"2024-05-09T02:18:25.116452+0000","last_fullsized":"2024-05-09T02:18:25.116452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544873+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:18:24.544873+0000","last_peered":"2024-05-09T02:18:24.544873+0000","last_clean":"2024-05-09T02:18:24.544873+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:18:24.544873+0000","last_undegraded":"2024-05-09T02:18:24.544873+0000","last_fullsized":"2024-05-09T02:18:24.544873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544891+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:24.544891+0000","last_peered":"2024-05-09T02:18:24.544891+0000","last_clean":"2024-05-09T02:18:24.544891+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:24.544891+0000","last_undegraded":"2024-05-09T02:18:24.544891+0000","last_fullsized":"2024-05-09T02:18:24.544891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213449+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:18:24.213449+0000","last_peered":"2024-05-09T02:18:24.213449+0000","last_clean":"2024-05-09T02:18:24.213449+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:18:24.213449+0000","last_undegraded":"2024-05-09T02:18:24.213449+0000","last_fullsized":"2024-05-09T02:18:24.213449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194691+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:24.194691+0000","last_peered":"2024-05-09T02:18:24.194691+0000","last_clean":"2024-05-09T02:18:24.194691+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:24.194691+0000","last_undegraded":"2024-05-09T02:18:24.194691+0000","last_fullsized":"2024-05-09T02:18:24.194691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116786+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:18:25.116786+0000","last_peered":"2024-05-09T02:18:25.116786+0000","last_clean":"2024-05-09T02:18:25.116786+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:18:25.116786+0000","last_undegraded":"2024-05-09T02:18:25.116786+0000","last_fullsized":"2024-05-09T02:18:25.116786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200069+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:24.200069+0000","last_peered":"2024-05-09T02:18:24.200069+0000","last_clean":"2024-05-09T02:18:24.200069+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:24.200069+0000","last_undegraded":"2024-05-09T02:18:24.200069+0000","last_fullsized":"2024-05-09T02:18:24.200069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199888+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:18:24.199888+0000","last_peered":"2024-05-09T02:18:24.199888+0000","last_clean":"2024-05-09T02:18:24.199888+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:18:24.199888+0000","last_undegraded":"2024-05-09T02:18:24.199888+0000","last_fullsized":"2024-05-09T02:18:24.199888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213517+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:24.213517+0000","last_peered":"2024-05-09T02:18:24.213517+0000","last_clean":"2024-05-09T02:18:24.213517+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:24.213517+0000","last_undegraded":"2024-05-09T02:18:24.213517+0000","last_fullsized":"2024-05-09T02:18:24.213517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116516+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:18:25.116516+0000","last_peered":"2024-05-09T02:18:25.116516+0000","last_clean":"2024-05-09T02:18:25.116516+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:18:25.116516+0000","last_undegraded":"2024-05-09T02:18:25.116516+0000","last_fullsized":"2024-05-09T02:18:25.116516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117856+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:25.117856+0000","last_peered":"2024-05-09T02:18:25.117856+0000","last_clean":"2024-05-09T02:18:25.117856+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:25.117856+0000","last_undegraded":"2024-05-09T02:18:25.117856+0000","last_fullsized":"2024-05-09T02:18:25.117856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116831+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:18:25.116831+0000","last_peered":"2024-05-09T02:18:25.116831+0000","last_clean":"2024-05-09T02:18:25.116831+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:18:25.116831+0000","last_undegraded":"2024-05-09T02:18:25.116831+0000","last_fullsized":"2024-05-09T02:18:25.116831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200256+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:24.200256+0000","last_peered":"2024-05-09T02:18:24.200256+0000","last_clean":"2024-05-09T02:18:24.200256+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:24.200256+0000","last_undegraded":"2024-05-09T02:18:24.200256+0000","last_fullsized":"2024-05-09T02:18:24.200256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200283+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:18:24.200283+0000","last_peered":"2024-05-09T02:18:24.200283+0000","last_clean":"2024-05-09T02:18:24.200283+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:18:24.200283+0000","last_undegraded":"2024-05-09T02:18:24.200283+0000","last_fullsized":"2024-05-09T02:18:24.200283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544524+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:24.544524+0000","last_peered":"2024-05-09T02:18:24.544524+0000","last_clean":"2024-05-09T02:18:24.544524+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:24.544524+0000","last_undegraded":"2024-05-09T02:18:24.544524+0000","last_fullsized":"2024-05-09T02:18:24.544524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118322+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:18:25.118322+0000","last_peered":"2024-05-09T02:18:25.118322+0000","last_clean":"2024-05-09T02:18:25.118322+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:18:25.118322+0000","last_undegraded":"2024-05-09T02:18:25.118322+0000","last_fullsized":"2024-05-09T02:18:25.118322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199333+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:24.199333+0000","last_peered":"2024-05-09T02:18:24.199333+0000","last_clean":"2024-05-09T02:18:24.199333+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:24.199333+0000","last_undegraded":"2024-05-09T02:18:24.199333+0000","last_fullsized":"2024-05-09T02:18:24.199333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116756+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:18:25.116756+0000","last_peered":"2024-05-09T02:18:25.116756+0000","last_clean":"2024-05-09T02:18:25.116756+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:18:25.116756+0000","last_undegraded":"2024-05-09T02:18:25.116756+0000","last_fullsized":"2024-05-09T02:18:25.116756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544741+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:24.544741+0000","last_peered":"2024-05-09T02:18:24.544741+0000","last_clean":"2024-05-09T02:18:24.544741+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:24.544741+0000","last_undegraded":"2024-05-09T02:18:24.544741+0000","last_fullsized":"2024-05-09T02:18:24.544741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199644+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:18:24.199644+0000","last_peered":"2024-05-09T02:18:24.199644+0000","last_clean":"2024-05-09T02:18:24.199644+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:18:24.199644+0000","last_undegraded":"2024-05-09T02:18:24.199644+0000","last_fullsized":"2024-05-09T02:18:24.199644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194548+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:24.194548+0000","last_peered":"2024-05-09T02:18:24.194548+0000","last_clean":"2024-05-09T02:18:24.194548+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:24.194548+0000","last_undegraded":"2024-05-09T02:18:24.194548+0000","last_fullsized":"2024-05-09T02:18:24.194548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200449+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:18:24.200449+0000","last_peered":"2024-05-09T02:18:24.200449+0000","last_clean":"2024-05-09T02:18:24.200449+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:18:24.200449+0000","last_undegraded":"2024-05-09T02:18:24.200449+0000","last_fullsized":"2024-05-09T02:18:24.200449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117511+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:25.117511+0000","last_peered":"2024-05-09T02:18:25.117511+0000","last_clean":"2024-05-09T02:18:25.117511+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:25.117511+0000","last_undegraded":"2024-05-09T02:18:25.117511+0000","last_fullsized":"2024-05-09T02:18:25.117511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199759+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:18:24.199759+0000","last_peered":"2024-05-09T02:18:24.199759+0000","last_clean":"2024-05-09T02:18:24.199759+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:18:24.199759+0000","last_undegraded":"2024-05-09T02:18:24.199759+0000","last_fullsized":"2024-05-09T02:18:24.199759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117792+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:25.117792+0000","last_peered":"2024-05-09T02:18:25.117792+0000","last_clean":"2024-05-09T02:18:25.117792+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:25.117792+0000","last_undegraded":"2024-05-09T02:18:25.117792+0000","last_fullsized":"2024-05-09T02:18:25.117792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544399+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:18:24.544399+0000","last_peered":"2024-05-09T02:18:24.544399+0000","last_clean":"2024-05-09T02:18:24.544399+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:18:24.544399+0000","last_undegraded":"2024-05-09T02:18:24.544399+0000","last_fullsized":"2024-05-09T02:18:24.544399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116838+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:25.116838+0000","last_peered":"2024-05-09T02:18:25.116838+0000","last_clean":"2024-05-09T02:18:25.116838+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:25.116838+0000","last_undegraded":"2024-05-09T02:18:25.116838+0000","last_fullsized":"2024-05-09T02:18:25.116838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193965+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:18:24.193965+0000","last_peered":"2024-05-09T02:18:24.193965+0000","last_clean":"2024-05-09T02:18:24.193965+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:18:24.193965+0000","last_undegraded":"2024-05-09T02:18:24.193965+0000","last_fullsized":"2024-05-09T02:18:24.193965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545650+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:24.545650+0000","last_peered":"2024-05-09T02:18:24.545650+0000","last_clean":"2024-05-09T02:18:24.545650+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:24.545650+0000","last_undegraded":"2024-05-09T02:18:24.545650+0000","last_fullsized":"2024-05-09T02:18:24.545650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213025+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:18:24.213025+0000","last_peered":"2024-05-09T02:18:24.213025+0000","last_clean":"2024-05-09T02:18:24.213025+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:18:24.213025+0000","last_undegraded":"2024-05-09T02:18:24.213025+0000","last_fullsized":"2024-05-09T02:18:24.213025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544509+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:24.544509+0000","last_peered":"2024-05-09T02:18:24.544509+0000","last_clean":"2024-05-09T02:18:24.544509+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:24.544509+0000","last_undegraded":"2024-05-09T02:18:24.544509+0000","last_fullsized":"2024-05-09T02:18:24.544509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200878+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:18:24.200878+0000","last_peered":"2024-05-09T02:18:24.200878+0000","last_clean":"2024-05-09T02:18:24.200878+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:18:24.200878+0000","last_undegraded":"2024-05-09T02:18:24.200878+0000","last_fullsized":"2024-05-09T02:18:24.200878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212585+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:24.212585+0000","last_peered":"2024-05-09T02:18:24.212585+0000","last_clean":"2024-05-09T02:18:24.212585+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:24.212585+0000","last_undegraded":"2024-05-09T02:18:24.212585+0000","last_fullsized":"2024-05-09T02:18:24.212585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544885+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:18:24.544885+0000","last_peered":"2024-05-09T02:18:24.544885+0000","last_clean":"2024-05-09T02:18:24.544885+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:18:24.544885+0000","last_undegraded":"2024-05-09T02:18:24.544885+0000","last_fullsized":"2024-05-09T02:18:24.544885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194082+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:24.194082+0000","last_peered":"2024-05-09T02:18:24.194082+0000","last_clean":"2024-05-09T02:18:24.194082+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:24.194082+0000","last_undegraded":"2024-05-09T02:18:24.194082+0000","last_fullsized":"2024-05-09T02:18:24.194082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118000+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:18:25.118000+0000","last_peered":"2024-05-09T02:18:25.118000+0000","last_clean":"2024-05-09T02:18:25.118000+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:18:25.118000+0000","last_undegraded":"2024-05-09T02:18:25.118000+0000","last_fullsized":"2024-05-09T02:18:25.118000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199427+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:24.199427+0000","last_peered":"2024-05-09T02:18:24.199427+0000","last_clean":"2024-05-09T02:18:24.199427+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:24.199427+0000","last_undegraded":"2024-05-09T02:18:24.199427+0000","last_fullsized":"2024-05-09T02:18:24.199427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199676+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:18:24.199676+0000","last_peered":"2024-05-09T02:18:24.199676+0000","last_clean":"2024-05-09T02:18:24.199676+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:18:24.199676+0000","last_undegraded":"2024-05-09T02:18:24.199676+0000","last_fullsized":"2024-05-09T02:18:24.199676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200953+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:24.200953+0000","last_peered":"2024-05-09T02:18:24.200953+0000","last_clean":"2024-05-09T02:18:24.200953+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:24.200953+0000","last_undegraded":"2024-05-09T02:18:24.200953+0000","last_fullsized":"2024-05-09T02:18:24.200953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116902+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:18:25.116902+0000","last_peered":"2024-05-09T02:18:25.116902+0000","last_clean":"2024-05-09T02:18:25.116902+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:18:25.116902+0000","last_undegraded":"2024-05-09T02:18:25.116902+0000","last_fullsized":"2024-05-09T02:18:25.116902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117232+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:25.117232+0000","last_peered":"2024-05-09T02:18:25.117232+0000","last_clean":"2024-05-09T02:18:25.117232+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:25.117232+0000","last_undegraded":"2024-05-09T02:18:25.117232+0000","last_fullsized":"2024-05-09T02:18:25.117232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117481+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:18:25.117481+0000","last_peered":"2024-05-09T02:18:25.117481+0000","last_clean":"2024-05-09T02:18:25.117481+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:18:25.117481+0000","last_undegraded":"2024-05-09T02:18:25.117481+0000","last_fullsized":"2024-05-09T02:18:25.117481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117736+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:25.117736+0000","last_peered":"2024-05-09T02:18:25.117736+0000","last_clean":"2024-05-09T02:18:25.117736+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:25.117736+0000","last_undegraded":"2024-05-09T02:18:25.117736+0000","last_fullsized":"2024-05-09T02:18:25.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544734+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:18:24.544734+0000","last_peered":"2024-05-09T02:18:24.544734+0000","last_clean":"2024-05-09T02:18:24.544734+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:18:24.544734+0000","last_undegraded":"2024-05-09T02:18:24.544734+0000","last_fullsized":"2024-05-09T02:18:24.544734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118260+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:25.118260+0000","last_peered":"2024-05-09T02:18:25.118260+0000","last_clean":"2024-05-09T02:18:25.118260+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:25.118260+0000","last_undegraded":"2024-05-09T02:18:25.118260+0000","last_fullsized":"2024-05-09T02:18:25.118260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199800+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:18:24.199800+0000","last_peered":"2024-05-09T02:18:24.199800+0000","last_clean":"2024-05-09T02:18:24.199800+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:18:24.199800+0000","last_undegraded":"2024-05-09T02:18:24.199800+0000","last_fullsized":"2024-05-09T02:18:24.199800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199349+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:24.199349+0000","last_peered":"2024-05-09T02:18:24.199349+0000","last_clean":"2024-05-09T02:18:24.199349+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:24.199349+0000","last_undegraded":"2024-05-09T02:18:24.199349+0000","last_fullsized":"2024-05-09T02:18:24.199349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118052+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:18:25.118052+0000","last_peered":"2024-05-09T02:18:25.118052+0000","last_clean":"2024-05-09T02:18:25.118052+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:18:25.118052+0000","last_undegraded":"2024-05-09T02:18:25.118052+0000","last_fullsized":"2024-05-09T02:18:25.118052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116863+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:25.116863+0000","last_peered":"2024-05-09T02:18:25.116863+0000","last_clean":"2024-05-09T02:18:25.116863+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:25.116863+0000","last_undegraded":"2024-05-09T02:18:25.116863+0000","last_fullsized":"2024-05-09T02:18:25.116863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213378+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:18:24.213378+0000","last_peered":"2024-05-09T02:18:24.213378+0000","last_clean":"2024-05-09T02:18:24.213378+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:18:24.213378+0000","last_undegraded":"2024-05-09T02:18:24.213378+0000","last_fullsized":"2024-05-09T02:18:24.213378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545227+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:18:24.545227+0000","last_peered":"2024-05-09T02:18:24.545227+0000","last_clean":"2024-05-09T02:18:24.545227+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:18:24.545227+0000","last_undegraded":"2024-05-09T02:18:24.545227+0000","last_fullsized":"2024-05-09T02:18:24.545227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199515+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:18:24.199515+0000","last_peered":"2024-05-09T02:18:24.199515+0000","last_clean":"2024-05-09T02:18:24.199515+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:18:24.199515+0000","last_undegraded":"2024-05-09T02:18:24.199515+0000","last_fullsized":"2024-05-09T02:18:24.199515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545003+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:24.545003+0000","last_peered":"2024-05-09T02:18:24.545003+0000","last_clean":"2024-05-09T02:18:24.545003+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:24.545003+0000","last_undegraded":"2024-05-09T02:18:24.545003+0000","last_fullsized":"2024-05-09T02:18:24.545003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116685+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:18:25.116685+0000","last_peered":"2024-05-09T02:18:25.116685+0000","last_clean":"2024-05-09T02:18:25.116685+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:18:25.116685+0000","last_undegraded":"2024-05-09T02:18:25.116685+0000","last_fullsized":"2024-05-09T02:18:25.116685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194258+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:24.194258+0000","last_peered":"2024-05-09T02:18:24.194258+0000","last_clean":"2024-05-09T02:18:24.194258+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:24.194258+0000","last_undegraded":"2024-05-09T02:18:24.194258+0000","last_fullsized":"2024-05-09T02:18:24.194258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116880+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:18:25.116880+0000","last_peered":"2024-05-09T02:18:25.116880+0000","last_clean":"2024-05-09T02:18:25.116880+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:18:25.116880+0000","last_undegraded":"2024-05-09T02:18:25.116880+0000","last_fullsized":"2024-05-09T02:18:25.116880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213092+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:24.213092+0000","last_peered":"2024-05-09T02:18:24.213092+0000","last_clean":"2024-05-09T02:18:24.213092+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:24.213092+0000","last_undegraded":"2024-05-09T02:18:24.213092+0000","last_fullsized":"2024-05-09T02:18:24.213092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116857+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:18:25.116857+0000","last_peered":"2024-05-09T02:18:25.116857+0000","last_clean":"2024-05-09T02:18:25.116857+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:18:25.116857+0000","last_undegraded":"2024-05-09T02:18:25.116857+0000","last_fullsized":"2024-05-09T02:18:25.116857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118184+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:25.118184+0000","last_peered":"2024-05-09T02:18:25.118184+0000","last_clean":"2024-05-09T02:18:25.118184+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:25.118184+0000","last_undegraded":"2024-05-09T02:18:25.118184+0000","last_fullsized":"2024-05-09T02:18:25.118184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":106601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":107619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:45.410 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-05-09T02:18:45.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:18:45.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.558+0000 7feabaf00640 1 Processor -- start 2024-05-09T02:18:45.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.558+0000 7feabaf00640 1 -- start start 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feabaf00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feab40c6150 0x7feab40aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feabaf00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4155260 0x7feab4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feabaf00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab4071510 con 0x7feab4070fb0 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feabaf00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7feab40ac900 con 0x7feab40c6150 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feabaf00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feab4155670 con 0x7feab4155260 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feab8c9c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feab40c6150 0x7feab40aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feab8c9c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feab40c6150 0x7feab40aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38596/0 (socket says 172.21.15.46:38596) 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.559+0000 7feab8c9c640 1 -- 172.21.15.46:0/741333075 learned_addr learned my addr 172.21.15.46:0/741333075 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab3fff640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4155260 0x7feab4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab8c9c640 1 -- 172.21.15.46:0/741333075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4155260 msgr2=0x7feab4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab8c9c640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4155260 0x7feab4070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab8c9c640 1 -- 172.21.15.46:0/741333075 >> v1:172.21.15.107:6789/0 conn(0x7feab4070fb0 legacy=0x7feab41580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab8c9c640 1 -- 172.21.15.46:0/741333075 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab40abfd0 con 0x7feab40c6150 2024-05-09T02:18:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab3fff640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4155260 0x7feab4070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.560+0000 7feab8c9c640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab40c6150 0x7feab40aa410 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009870 tx=0x7fea9c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5321b27a46156e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feab37fe640 1 -- 172.21.15.46:0/741333075 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c037070 con 0x7feab40c6150 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feab37fe640 1 -- 172.21.15.46:0/741333075 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c032440 con 0x7feab40c6150 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feab37fe640 1 -- 172.21.15.46:0/741333075 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c032810 con 0x7feab40c6150 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feabaf00640 1 -- 172.21.15.46:0/741333075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab40c6150 msgr2=0x7feab40aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feabaf00640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab40c6150 0x7feab40aa410 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009870 tx=0x7fea9c02a1c0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feabaf00640 1 -- 172.21.15.46:0/741333075 shutdown_connections 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.561+0000 7feabaf00640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4155260 0x7feab4070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.562+0000 7feabaf00640 1 --2- 172.21.15.46:0/741333075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab40c6150 0x7feab40aa410 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.562+0000 7feabaf00640 1 -- 172.21.15.46:0/741333075 >> 172.21.15.46:0/741333075 conn(0x7feab40c6770 msgr2=0x7feab40c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:45.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.562+0000 7feabaf00640 1 -- 172.21.15.46:0/741333075 shutdown_connections 2024-05-09T02:18:45.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.562+0000 7feabaf00640 1 -- 172.21.15.46:0/741333075 wait complete. 2024-05-09T02:18:45.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.563+0000 7feabaf00640 1 Processor -- start 2024-05-09T02:18:45.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.563+0000 7feabaf00640 1 -- start start 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feabaf00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4070fb0 0x7feab40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feabaf00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feab40c6150 0x7feab40c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feabaf00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 0x7feab41f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feabaf00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feab40abca0 con 0x7feab4155260 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feabaf00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feab40ac590 con 0x7feab40c6150 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feabaf00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7feab41587c0 con 0x7feab4070fb0 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 0x7feab41f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 0x7feab41f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38604/0 (socket says 172.21.15.46:38604) 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 -- 172.21.15.46:0/2552846601 learned_addr learned my addr 172.21.15.46:0/2552846601 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab8c9c640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4070fb0 0x7feab40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab3fff640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feab40c6150 0x7feab40c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 -- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4070fb0 msgr2=0x7feab40af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4070fb0 0x7feab40af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 -- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feab40c6150 msgr2=0x7feab40c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feab40c6150 0x7feab40c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.565+0000 7feab949d640 1 -- 172.21.15.46:0/2552846601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab41ee000 con 0x7feab4155260 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.566+0000 7feab949d640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 0x7feab41f0bd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feaac00b440 tx=0x7feaac00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.566+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac011830 con 0x7feab4155260 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.566+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac016070 con 0x7feab4155260 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.566+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab41ee2e0 con 0x7feab4155260 2024-05-09T02:18:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.566+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac011c10 con 0x7feab4155260 2024-05-09T02:18:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.566+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab414f8e0 con 0x7feab4155260 2024-05-09T02:18:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.567+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab406a330 con 0x7feab4155260 2024-05-09T02:18:45.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.568+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feaac01b460 con 0x7feab4155260 2024-05-09T02:18:45.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.568+0000 7feab17fa640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fea940762d0 0x7fea940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.568+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7feaac0971d0 con 0x7feab4155260 2024-05-09T02:18:45.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.569+0000 7feab8c9c640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fea940762d0 0x7fea940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.569+0000 7feab8c9c640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fea940762d0 0x7fea940787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fea9c034000 tx=0x7fea9c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.573+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feaac020020 con 0x7feab4155260 2024-05-09T02:18:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.761+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feab4151d20 con 0x7fea940762d0 2024-05-09T02:18:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.773+0000 7feab17fa640 1 -- 172.21.15.46:0/2552846601 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490290 (secure 0 0 0) 0x7fea9c0b9b50 con 0x7fea940762d0 2024-05-09T02:18:45.781 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:18:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fea940762d0 msgr2=0x7fea940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fea940762d0 0x7fea940787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fea9c034000 tx=0x7fea9c02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 msgr2=0x7feab41f0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 0x7feab41f0bd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feaac00b440 tx=0x7feaac00b900 comp rx=0 tx=0).stop 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 shutdown_connections 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fea940762d0 0x7fea940787e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feab4155260 0x7feab41f0bd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feab40c6150 0x7feab40c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 --2- 172.21.15.46:0/2552846601 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feab4070fb0 0x7feab40af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 >> 172.21.15.46:0/2552846601 conn(0x7feab40c6770 msgr2=0x7feab414cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 shutdown_connections 2024-05-09T02:18:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.777+0000 7feabaf00640 1 -- 172.21.15.46:0/2552846601 wait complete. 2024-05-09T02:18:45.792 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-09T02:18:44.507169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595629,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":193,"num_write_kb":1658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":3448832,"data_stored":2022714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":441,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003910"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199693+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:18:24.199693+0000","last_peered":"2024-05-09T02:18:24.199693+0000","last_clean":"2024-05-09T02:18:24.199693+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:18:24.199693+0000","last_undegraded":"2024-05-09T02:18:24.199693+0000","last_fullsized":"2024-05-09T02:18:24.199693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194809+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:18:24.194809+0000","last_peered":"2024-05-09T02:18:24.194809+0000","last_clean":"2024-05-09T02:18:24.194809+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:18:24.194809+0000","last_undegraded":"2024-05-09T02:18:24.194809+0000","last_fullsized":"2024-05-09T02:18:24.194809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200366+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:18:24.200366+0000","last_peered":"2024-05-09T02:18:24.200366+0000","last_clean":"2024-05-09T02:18:24.200366+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:18:24.200366+0000","last_undegraded":"2024-05-09T02:18:24.200366+0000","last_fullsized":"2024-05-09T02:18:24.200366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199237+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:18:24.199237+0000","last_peered":"2024-05-09T02:18:24.199237+0000","last_clean":"2024-05-09T02:18:24.199237+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:18:24.199237+0000","last_undegraded":"2024-05-09T02:18:24.199237+0000","last_fullsized":"2024-05-09T02:18:24.199237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212516+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:18:24.212516+0000","last_peered":"2024-05-09T02:18:24.212516+0000","last_clean":"2024-05-09T02:18:24.212516+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:18:24.212516+0000","last_undegraded":"2024-05-09T02:18:24.212516+0000","last_fullsized":"2024-05-09T02:18:24.212516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200409+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:18:24.200409+0000","last_peered":"2024-05-09T02:18:24.200409+0000","last_clean":"2024-05-09T02:18:24.200409+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:18:24.200409+0000","last_undegraded":"2024-05-09T02:18:24.200409+0000","last_fullsized":"2024-05-09T02:18:24.200409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194737+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:18:24.194737+0000","last_peered":"2024-05-09T02:18:24.194737+0000","last_clean":"2024-05-09T02:18:24.194737+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:18:24.194737+0000","last_undegraded":"2024-05-09T02:18:24.194737+0000","last_fullsized":"2024-05-09T02:18:24.194737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199565+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:18:24.199565+0000","last_peered":"2024-05-09T02:18:24.199565+0000","last_clean":"2024-05-09T02:18:24.199565+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:18:24.199565+0000","last_undegraded":"2024-05-09T02:18:24.199565+0000","last_fullsized":"2024-05-09T02:18:24.199565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117680+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:18:25.117680+0000","last_peered":"2024-05-09T02:18:25.117680+0000","last_clean":"2024-05-09T02:18:25.117680+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:18:25.117680+0000","last_undegraded":"2024-05-09T02:18:25.117680+0000","last_fullsized":"2024-05-09T02:18:25.117680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545151+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:18:24.545151+0000","last_peered":"2024-05-09T02:18:24.545151+0000","last_clean":"2024-05-09T02:18:24.545151+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:18:24.545151+0000","last_undegraded":"2024-05-09T02:18:24.545151+0000","last_fullsized":"2024-05-09T02:18:24.545151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199967+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:18:24.199967+0000","last_peered":"2024-05-09T02:18:24.199967+0000","last_clean":"2024-05-09T02:18:24.199967+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:18:24.199967+0000","last_undegraded":"2024-05-09T02:18:24.199967+0000","last_fullsized":"2024-05-09T02:18:24.199967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544707+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:18:24.544707+0000","last_peered":"2024-05-09T02:18:24.544707+0000","last_clean":"2024-05-09T02:18:24.544707+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:18:24.544707+0000","last_undegraded":"2024-05-09T02:18:24.544707+0000","last_fullsized":"2024-05-09T02:18:24.544707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117346+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:18:25.117346+0000","last_peered":"2024-05-09T02:18:25.117346+0000","last_clean":"2024-05-09T02:18:25.117346+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:18:25.117346+0000","last_undegraded":"2024-05-09T02:18:25.117346+0000","last_fullsized":"2024-05-09T02:18:25.117346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545312+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:18:24.545312+0000","last_peered":"2024-05-09T02:18:24.545312+0000","last_clean":"2024-05-09T02:18:24.545312+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:18:24.545312+0000","last_undegraded":"2024-05-09T02:18:24.545312+0000","last_fullsized":"2024-05-09T02:18:24.545312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199878+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:18:24.199878+0000","last_peered":"2024-05-09T02:18:24.199878+0000","last_clean":"2024-05-09T02:18:24.199878+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:18:24.199878+0000","last_undegraded":"2024-05-09T02:18:24.199878+0000","last_fullsized":"2024-05-09T02:18:24.199878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213230+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:18:24.213230+0000","last_peered":"2024-05-09T02:18:24.213230+0000","last_clean":"2024-05-09T02:18:24.213230+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:18:24.213230+0000","last_undegraded":"2024-05-09T02:18:24.213230+0000","last_fullsized":"2024-05-09T02:18:24.213230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116725+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:18:25.116725+0000","last_peered":"2024-05-09T02:18:25.116725+0000","last_clean":"2024-05-09T02:18:25.116725+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:18:25.116725+0000","last_undegraded":"2024-05-09T02:18:25.116725+0000","last_fullsized":"2024-05-09T02:18:25.116725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117491+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:18:25.117491+0000","last_peered":"2024-05-09T02:18:25.117491+0000","last_clean":"2024-05-09T02:18:25.117491+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:18:25.117491+0000","last_undegraded":"2024-05-09T02:18:25.117491+0000","last_fullsized":"2024-05-09T02:18:25.117491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200557+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:18:24.200557+0000","last_peered":"2024-05-09T02:18:24.200557+0000","last_clean":"2024-05-09T02:18:24.200557+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:18:24.200557+0000","last_undegraded":"2024-05-09T02:18:24.200557+0000","last_fullsized":"2024-05-09T02:18:24.200557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117023+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:18:25.117023+0000","last_peered":"2024-05-09T02:18:25.117023+0000","last_clean":"2024-05-09T02:18:25.117023+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:18:25.117023+0000","last_undegraded":"2024-05-09T02:18:25.117023+0000","last_fullsized":"2024-05-09T02:18:25.117023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199802+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:18:24.199802+0000","last_peered":"2024-05-09T02:18:24.199802+0000","last_clean":"2024-05-09T02:18:24.199802+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:18:24.199802+0000","last_undegraded":"2024-05-09T02:18:24.199802+0000","last_fullsized":"2024-05-09T02:18:24.199802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212930+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:18:24.212930+0000","last_peered":"2024-05-09T02:18:24.212930+0000","last_clean":"2024-05-09T02:18:24.212930+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:18:24.212930+0000","last_undegraded":"2024-05-09T02:18:24.212930+0000","last_fullsized":"2024-05-09T02:18:24.212930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200551+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:18:24.200551+0000","last_peered":"2024-05-09T02:18:24.200551+0000","last_clean":"2024-05-09T02:18:24.200551+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:18:24.200551+0000","last_undegraded":"2024-05-09T02:18:24.200551+0000","last_fullsized":"2024-05-09T02:18:24.200551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200686+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:18:24.200686+0000","last_peered":"2024-05-09T02:18:24.200686+0000","last_clean":"2024-05-09T02:18:24.200686+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:18:24.200686+0000","last_undegraded":"2024-05-09T02:18:24.200686+0000","last_fullsized":"2024-05-09T02:18:24.200686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200229+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:18:24.200229+0000","last_peered":"2024-05-09T02:18:24.200229+0000","last_clean":"2024-05-09T02:18:24.200229+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:18:24.200229+0000","last_undegraded":"2024-05-09T02:18:24.200229+0000","last_fullsized":"2024-05-09T02:18:24.200229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212619+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:18:24.212619+0000","last_peered":"2024-05-09T02:18:24.212619+0000","last_clean":"2024-05-09T02:18:24.212619+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:18:24.212619+0000","last_undegraded":"2024-05-09T02:18:24.212619+0000","last_fullsized":"2024-05-09T02:18:24.212619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213272+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:18:24.213272+0000","last_peered":"2024-05-09T02:18:24.213272+0000","last_clean":"2024-05-09T02:18:24.213272+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:18:24.213272+0000","last_undegraded":"2024-05-09T02:18:24.213272+0000","last_fullsized":"2024-05-09T02:18:24.213272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545447+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:18:24.545447+0000","last_peered":"2024-05-09T02:18:24.545447+0000","last_clean":"2024-05-09T02:18:24.545447+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:18:24.545447+0000","last_undegraded":"2024-05-09T02:18:24.545447+0000","last_fullsized":"2024-05-09T02:18:24.545447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200114+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:18:24.200114+0000","last_peered":"2024-05-09T02:18:24.200114+0000","last_clean":"2024-05-09T02:18:24.200114+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:18:24.200114+0000","last_undegraded":"2024-05-09T02:18:24.200114+0000","last_fullsized":"2024-05-09T02:18:24.200114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117121+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:18:25.117121+0000","last_peered":"2024-05-09T02:18:25.117121+0000","last_clean":"2024-05-09T02:18:25.117121+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:18:25.117121+0000","last_undegraded":"2024-05-09T02:18:25.117121+0000","last_fullsized":"2024-05-09T02:18:25.117121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200694+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:18:24.200694+0000","last_peered":"2024-05-09T02:18:24.200694+0000","last_clean":"2024-05-09T02:18:24.200694+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:18:24.200694+0000","last_undegraded":"2024-05-09T02:18:24.200694+0000","last_fullsized":"2024-05-09T02:18:24.200694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199079+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:18:24.199079+0000","last_peered":"2024-05-09T02:18:24.199079+0000","last_clean":"2024-05-09T02:18:24.199079+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:18:24.199079+0000","last_undegraded":"2024-05-09T02:18:24.199079+0000","last_fullsized":"2024-05-09T02:18:24.199079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194623+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:18:24.194623+0000","last_peered":"2024-05-09T02:18:24.194623+0000","last_clean":"2024-05-09T02:18:24.194623+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:18:24.194623+0000","last_undegraded":"2024-05-09T02:18:24.194623+0000","last_fullsized":"2024-05-09T02:18:24.194623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118230+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:18:25.118230+0000","last_peered":"2024-05-09T02:18:25.118230+0000","last_clean":"2024-05-09T02:18:25.118230+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:18:25.118230+0000","last_undegraded":"2024-05-09T02:18:25.118230+0000","last_fullsized":"2024-05-09T02:18:25.118230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199762+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:18:24.199762+0000","last_peered":"2024-05-09T02:18:24.199762+0000","last_clean":"2024-05-09T02:18:24.199762+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:18:24.199762+0000","last_undegraded":"2024-05-09T02:18:24.199762+0000","last_fullsized":"2024-05-09T02:18:24.199762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199671+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:18:24.199671+0000","last_peered":"2024-05-09T02:18:24.199671+0000","last_clean":"2024-05-09T02:18:24.199671+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:18:24.199671+0000","last_undegraded":"2024-05-09T02:18:24.199671+0000","last_fullsized":"2024-05-09T02:18:24.199671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200278+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:18:24.200278+0000","last_peered":"2024-05-09T02:18:24.200278+0000","last_clean":"2024-05-09T02:18:24.200278+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:18:24.200278+0000","last_undegraded":"2024-05-09T02:18:24.200278+0000","last_fullsized":"2024-05-09T02:18:24.200278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213294+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:18:24.213294+0000","last_peered":"2024-05-09T02:18:24.213294+0000","last_clean":"2024-05-09T02:18:24.213294+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:18:24.213294+0000","last_undegraded":"2024-05-09T02:18:24.213294+0000","last_fullsized":"2024-05-09T02:18:24.213294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199015+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:18:24.199015+0000","last_peered":"2024-05-09T02:18:24.199015+0000","last_clean":"2024-05-09T02:18:24.199015+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:18:24.199015+0000","last_undegraded":"2024-05-09T02:18:24.199015+0000","last_fullsized":"2024-05-09T02:18:24.199015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116593+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:18:25.116593+0000","last_peered":"2024-05-09T02:18:25.116593+0000","last_clean":"2024-05-09T02:18:25.116593+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:18:25.116593+0000","last_undegraded":"2024-05-09T02:18:25.116593+0000","last_fullsized":"2024-05-09T02:18:25.116593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213438+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:18:24.213438+0000","last_peered":"2024-05-09T02:18:24.213438+0000","last_clean":"2024-05-09T02:18:24.213438+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:18:24.213438+0000","last_undegraded":"2024-05-09T02:18:24.213438+0000","last_fullsized":"2024-05-09T02:18:24.213438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117923+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:18:25.117923+0000","last_peered":"2024-05-09T02:18:25.117923+0000","last_clean":"2024-05-09T02:18:25.117923+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:18:25.117923+0000","last_undegraded":"2024-05-09T02:18:25.117923+0000","last_fullsized":"2024-05-09T02:18:25.117923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194343+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:18:24.194343+0000","last_peered":"2024-05-09T02:18:24.194343+0000","last_clean":"2024-05-09T02:18:24.194343+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:18:24.194343+0000","last_undegraded":"2024-05-09T02:18:24.194343+0000","last_fullsized":"2024-05-09T02:18:24.194343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194795+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:18:24.194795+0000","last_peered":"2024-05-09T02:18:24.194795+0000","last_clean":"2024-05-09T02:18:24.194795+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:18:24.194795+0000","last_undegraded":"2024-05-09T02:18:24.194795+0000","last_fullsized":"2024-05-09T02:18:24.194795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545446+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:18:24.545446+0000","last_peered":"2024-05-09T02:18:24.545446+0000","last_clean":"2024-05-09T02:18:24.545446+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:18:24.545446+0000","last_undegraded":"2024-05-09T02:18:24.545446+0000","last_fullsized":"2024-05-09T02:18:24.545446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213541+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:18:24.213541+0000","last_peered":"2024-05-09T02:18:24.213541+0000","last_clean":"2024-05-09T02:18:24.213541+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:18:24.213541+0000","last_undegraded":"2024-05-09T02:18:24.213541+0000","last_fullsized":"2024-05-09T02:18:24.213541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212698+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:18:24.212698+0000","last_peered":"2024-05-09T02:18:24.212698+0000","last_clean":"2024-05-09T02:18:24.212698+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:18:24.212698+0000","last_undegraded":"2024-05-09T02:18:24.212698+0000","last_fullsized":"2024-05-09T02:18:24.212698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194413+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:18:24.194413+0000","last_peered":"2024-05-09T02:18:24.194413+0000","last_clean":"2024-05-09T02:18:24.194413+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:18:24.194413+0000","last_undegraded":"2024-05-09T02:18:24.194413+0000","last_fullsized":"2024-05-09T02:18:24.194413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200494+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:18:24.200494+0000","last_peered":"2024-05-09T02:18:24.200494+0000","last_clean":"2024-05-09T02:18:24.200494+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:18:24.200494+0000","last_undegraded":"2024-05-09T02:18:24.200494+0000","last_fullsized":"2024-05-09T02:18:24.200494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545086+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:18:24.545086+0000","last_peered":"2024-05-09T02:18:24.545086+0000","last_clean":"2024-05-09T02:18:24.545086+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:18:24.545086+0000","last_undegraded":"2024-05-09T02:18:24.545086+0000","last_fullsized":"2024-05-09T02:18:24.545086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213293+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:18:24.213293+0000","last_peered":"2024-05-09T02:18:24.213293+0000","last_clean":"2024-05-09T02:18:24.213293+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:18:24.213293+0000","last_undegraded":"2024-05-09T02:18:24.213293+0000","last_fullsized":"2024-05-09T02:18:24.213293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117109+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:18:25.117109+0000","last_peered":"2024-05-09T02:18:25.117109+0000","last_clean":"2024-05-09T02:18:25.117109+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:18:25.117109+0000","last_undegraded":"2024-05-09T02:18:25.117109+0000","last_fullsized":"2024-05-09T02:18:25.117109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212497+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:18:24.212497+0000","last_peered":"2024-05-09T02:18:24.212497+0000","last_clean":"2024-05-09T02:18:24.212497+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:18:24.212497+0000","last_undegraded":"2024-05-09T02:18:24.212497+0000","last_fullsized":"2024-05-09T02:18:24.212497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116723+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:18:25.116723+0000","last_peered":"2024-05-09T02:18:25.116723+0000","last_clean":"2024-05-09T02:18:25.116723+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:18:25.116723+0000","last_undegraded":"2024-05-09T02:18:25.116723+0000","last_fullsized":"2024-05-09T02:18:25.116723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213274+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:18:24.213274+0000","last_peered":"2024-05-09T02:18:24.213274+0000","last_clean":"2024-05-09T02:18:24.213274+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:18:24.213274+0000","last_undegraded":"2024-05-09T02:18:24.213274+0000","last_fullsized":"2024-05-09T02:18:24.213274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545598+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:18:24.545598+0000","last_peered":"2024-05-09T02:18:24.545598+0000","last_clean":"2024-05-09T02:18:24.545598+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:18:24.545598+0000","last_undegraded":"2024-05-09T02:18:24.545598+0000","last_fullsized":"2024-05-09T02:18:24.545598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193902+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:18:24.193902+0000","last_peered":"2024-05-09T02:18:24.193902+0000","last_clean":"2024-05-09T02:18:24.193902+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:18:24.193902+0000","last_undegraded":"2024-05-09T02:18:24.193902+0000","last_fullsized":"2024-05-09T02:18:24.193902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117239+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:18:25.117239+0000","last_peered":"2024-05-09T02:18:25.117239+0000","last_clean":"2024-05-09T02:18:25.117239+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:18:25.117239+0000","last_undegraded":"2024-05-09T02:18:25.117239+0000","last_fullsized":"2024-05-09T02:18:25.117239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194546+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:18:24.194546+0000","last_peered":"2024-05-09T02:18:24.194546+0000","last_clean":"2024-05-09T02:18:24.194546+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:18:24.194546+0000","last_undegraded":"2024-05-09T02:18:24.194546+0000","last_fullsized":"2024-05-09T02:18:24.194546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117439+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:18:25.117439+0000","last_peered":"2024-05-09T02:18:25.117439+0000","last_clean":"2024-05-09T02:18:25.117439+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:18:25.117439+0000","last_undegraded":"2024-05-09T02:18:25.117439+0000","last_fullsized":"2024-05-09T02:18:25.117439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199819+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:18:24.199819+0000","last_peered":"2024-05-09T02:18:24.199819+0000","last_clean":"2024-05-09T02:18:24.199819+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:18:24.199819+0000","last_undegraded":"2024-05-09T02:18:24.199819+0000","last_fullsized":"2024-05-09T02:18:24.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544691+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:18:24.544691+0000","last_peered":"2024-05-09T02:18:24.544691+0000","last_clean":"2024-05-09T02:18:24.544691+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:18:24.544691+0000","last_undegraded":"2024-05-09T02:18:24.544691+0000","last_fullsized":"2024-05-09T02:18:24.544691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117558+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:18:25.117558+0000","last_peered":"2024-05-09T02:18:25.117558+0000","last_clean":"2024-05-09T02:18:25.117558+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:18:25.117558+0000","last_undegraded":"2024-05-09T02:18:25.117558+0000","last_fullsized":"2024-05-09T02:18:25.117558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117026+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:18:25.117026+0000","last_peered":"2024-05-09T02:18:25.117026+0000","last_clean":"2024-05-09T02:18:25.117026+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:18:25.117026+0000","last_undegraded":"2024-05-09T02:18:25.117026+0000","last_fullsized":"2024-05-09T02:18:25.117026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117570+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:18:25.117570+0000","last_peered":"2024-05-09T02:18:25.117570+0000","last_clean":"2024-05-09T02:18:25.117570+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:18:25.117570+0000","last_undegraded":"2024-05-09T02:18:25.117570+0000","last_fullsized":"2024-05-09T02:18:25.117570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117008+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:18:25.117008+0000","last_peered":"2024-05-09T02:18:25.117008+0000","last_clean":"2024-05-09T02:18:25.117008+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:18:25.117008+0000","last_undegraded":"2024-05-09T02:18:25.117008+0000","last_fullsized":"2024-05-09T02:18:25.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116656+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:18:25.116656+0000","last_peered":"2024-05-09T02:18:25.116656+0000","last_clean":"2024-05-09T02:18:25.116656+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:18:25.116656+0000","last_undegraded":"2024-05-09T02:18:25.116656+0000","last_fullsized":"2024-05-09T02:18:25.116656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545429+0000","last_change":"2024-05-09T02:18:14.161833+0000","last_active":"2024-05-09T02:18:24.545429+0000","last_peered":"2024-05-09T02:18:24.545429+0000","last_clean":"2024-05-09T02:18:24.545429+0000","last_became_active":"2024-05-09T02:18:14.161518+0000","last_became_peered":"2024-05-09T02:18:14.161518+0000","last_unstale":"2024-05-09T02:18:24.545429+0000","last_undegraded":"2024-05-09T02:18:24.545429+0000","last_fullsized":"2024-05-09T02:18:24.545429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213599+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:18:24.213599+0000","last_peered":"2024-05-09T02:18:24.213599+0000","last_clean":"2024-05-09T02:18:24.213599+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:18:24.213599+0000","last_undegraded":"2024-05-09T02:18:24.213599+0000","last_fullsized":"2024-05-09T02:18:24.213599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194066+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:18:24.194066+0000","last_peered":"2024-05-09T02:18:24.194066+0000","last_clean":"2024-05-09T02:18:24.194066+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:18:24.194066+0000","last_undegraded":"2024-05-09T02:18:24.194066+0000","last_fullsized":"2024-05-09T02:18:24.194066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116582+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:18:25.116582+0000","last_peered":"2024-05-09T02:18:25.116582+0000","last_clean":"2024-05-09T02:18:25.116582+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:18:25.116582+0000","last_undegraded":"2024-05-09T02:18:25.116582+0000","last_fullsized":"2024-05-09T02:18:25.116582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118369+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:18:25.118369+0000","last_peered":"2024-05-09T02:18:25.118369+0000","last_clean":"2024-05-09T02:18:25.118369+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:18:25.118369+0000","last_undegraded":"2024-05-09T02:18:25.118369+0000","last_fullsized":"2024-05-09T02:18:25.118369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117107+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:18:25.117107+0000","last_peered":"2024-05-09T02:18:25.117107+0000","last_clean":"2024-05-09T02:18:25.117107+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:18:25.117107+0000","last_undegraded":"2024-05-09T02:18:25.117107+0000","last_fullsized":"2024-05-09T02:18:25.117107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544340+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:18:24.544340+0000","last_peered":"2024-05-09T02:18:24.544340+0000","last_clean":"2024-05-09T02:18:24.544340+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:18:24.544340+0000","last_undegraded":"2024-05-09T02:18:24.544340+0000","last_fullsized":"2024-05-09T02:18:24.544340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116753+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:18:25.116753+0000","last_peered":"2024-05-09T02:18:25.116753+0000","last_clean":"2024-05-09T02:18:25.116753+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:18:25.116753+0000","last_undegraded":"2024-05-09T02:18:25.116753+0000","last_fullsized":"2024-05-09T02:18:25.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117832+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:18:25.117832+0000","last_peered":"2024-05-09T02:18:25.117832+0000","last_clean":"2024-05-09T02:18:25.117832+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:18:25.117832+0000","last_undegraded":"2024-05-09T02:18:25.117832+0000","last_fullsized":"2024-05-09T02:18:25.117832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201043+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:18:24.201043+0000","last_peered":"2024-05-09T02:18:24.201043+0000","last_clean":"2024-05-09T02:18:24.201043+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:18:24.201043+0000","last_undegraded":"2024-05-09T02:18:24.201043+0000","last_fullsized":"2024-05-09T02:18:24.201043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199591+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:18:24.199591+0000","last_peered":"2024-05-09T02:18:24.199591+0000","last_clean":"2024-05-09T02:18:24.199591+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:18:24.199591+0000","last_undegraded":"2024-05-09T02:18:24.199591+0000","last_fullsized":"2024-05-09T02:18:24.199591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200090+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:18:24.200090+0000","last_peered":"2024-05-09T02:18:24.200090+0000","last_clean":"2024-05-09T02:18:24.200090+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:18:24.200090+0000","last_undegraded":"2024-05-09T02:18:24.200090+0000","last_fullsized":"2024-05-09T02:18:24.200090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116454+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:18:25.116454+0000","last_peered":"2024-05-09T02:18:25.116454+0000","last_clean":"2024-05-09T02:18:25.116454+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:18:25.116454+0000","last_undegraded":"2024-05-09T02:18:25.116454+0000","last_fullsized":"2024-05-09T02:18:25.116454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194601+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:18:24.194601+0000","last_peered":"2024-05-09T02:18:24.194601+0000","last_clean":"2024-05-09T02:18:24.194601+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:18:24.194601+0000","last_undegraded":"2024-05-09T02:18:24.194601+0000","last_fullsized":"2024-05-09T02:18:24.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545288+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:18:24.545288+0000","last_peered":"2024-05-09T02:18:24.545288+0000","last_clean":"2024-05-09T02:18:24.545288+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:18:24.545288+0000","last_undegraded":"2024-05-09T02:18:24.545288+0000","last_fullsized":"2024-05-09T02:18:24.545288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116481+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:18:25.116481+0000","last_peered":"2024-05-09T02:18:25.116481+0000","last_clean":"2024-05-09T02:18:25.116481+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:18:25.116481+0000","last_undegraded":"2024-05-09T02:18:25.116481+0000","last_fullsized":"2024-05-09T02:18:25.116481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117146+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:18:25.117146+0000","last_peered":"2024-05-09T02:18:25.117146+0000","last_clean":"2024-05-09T02:18:25.117146+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:18:25.117146+0000","last_undegraded":"2024-05-09T02:18:25.117146+0000","last_fullsized":"2024-05-09T02:18:25.117146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200150+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:18:24.200150+0000","last_peered":"2024-05-09T02:18:24.200150+0000","last_clean":"2024-05-09T02:18:24.200150+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:18:24.200150+0000","last_undegraded":"2024-05-09T02:18:24.200150+0000","last_fullsized":"2024-05-09T02:18:24.200150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544937+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:18:24.544937+0000","last_peered":"2024-05-09T02:18:24.544937+0000","last_clean":"2024-05-09T02:18:24.544937+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:18:24.544937+0000","last_undegraded":"2024-05-09T02:18:24.544937+0000","last_fullsized":"2024-05-09T02:18:24.544937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117143+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:18:25.117143+0000","last_peered":"2024-05-09T02:18:25.117143+0000","last_clean":"2024-05-09T02:18:25.117143+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:18:25.117143+0000","last_undegraded":"2024-05-09T02:18:25.117143+0000","last_fullsized":"2024-05-09T02:18:25.117143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545038+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:18:24.545038+0000","last_peered":"2024-05-09T02:18:24.545038+0000","last_clean":"2024-05-09T02:18:24.545038+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:18:24.545038+0000","last_undegraded":"2024-05-09T02:18:24.545038+0000","last_fullsized":"2024-05-09T02:18:24.545038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199798+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:18:24.199798+0000","last_peered":"2024-05-09T02:18:24.199798+0000","last_clean":"2024-05-09T02:18:24.199798+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:18:24.199798+0000","last_undegraded":"2024-05-09T02:18:24.199798+0000","last_fullsized":"2024-05-09T02:18:24.199798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200009+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:18:24.200009+0000","last_peered":"2024-05-09T02:18:24.200009+0000","last_clean":"2024-05-09T02:18:24.200009+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:18:24.200009+0000","last_undegraded":"2024-05-09T02:18:24.200009+0000","last_fullsized":"2024-05-09T02:18:24.200009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194050+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:18:24.194050+0000","last_peered":"2024-05-09T02:18:24.194050+0000","last_clean":"2024-05-09T02:18:24.194050+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:18:24.194050+0000","last_undegraded":"2024-05-09T02:18:24.194050+0000","last_fullsized":"2024-05-09T02:18:24.194050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194934+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:18:24.194934+0000","last_peered":"2024-05-09T02:18:24.194934+0000","last_clean":"2024-05-09T02:18:24.194934+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:18:24.194934+0000","last_undegraded":"2024-05-09T02:18:24.194934+0000","last_fullsized":"2024-05-09T02:18:24.194934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545295+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:18:24.545295+0000","last_peered":"2024-05-09T02:18:24.545295+0000","last_clean":"2024-05-09T02:18:24.545295+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:18:24.545295+0000","last_undegraded":"2024-05-09T02:18:24.545295+0000","last_fullsized":"2024-05-09T02:18:24.545295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199929+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:18:24.199929+0000","last_peered":"2024-05-09T02:18:24.199929+0000","last_clean":"2024-05-09T02:18:24.199929+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:18:24.199929+0000","last_undegraded":"2024-05-09T02:18:24.199929+0000","last_fullsized":"2024-05-09T02:18:24.199929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117435+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:18:25.117435+0000","last_peered":"2024-05-09T02:18:25.117435+0000","last_clean":"2024-05-09T02:18:25.117435+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:18:25.117435+0000","last_undegraded":"2024-05-09T02:18:25.117435+0000","last_fullsized":"2024-05-09T02:18:25.117435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:39.630776+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:18:39.630776+0000","last_peered":"2024-05-09T02:18:39.630776+0000","last_clean":"2024-05-09T02:18:39.630776+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:18:39.630776+0000","last_undegraded":"2024-05-09T02:18:39.630776+0000","last_fullsized":"2024-05-09T02:18:39.630776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212549+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:18:24.212549+0000","last_peered":"2024-05-09T02:18:24.212549+0000","last_clean":"2024-05-09T02:18:24.212549+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:18:24.212549+0000","last_undegraded":"2024-05-09T02:18:24.212549+0000","last_fullsized":"2024-05-09T02:18:24.212549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212872+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:18:24.212872+0000","last_peered":"2024-05-09T02:18:24.212872+0000","last_clean":"2024-05-09T02:18:24.212872+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:18:24.212872+0000","last_undegraded":"2024-05-09T02:18:24.212872+0000","last_fullsized":"2024-05-09T02:18:24.212872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.201035+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:18:24.201035+0000","last_peered":"2024-05-09T02:18:24.201035+0000","last_clean":"2024-05-09T02:18:24.201035+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:18:24.201035+0000","last_undegraded":"2024-05-09T02:18:24.201035+0000","last_fullsized":"2024-05-09T02:18:24.201035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213593+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:18:24.213593+0000","last_peered":"2024-05-09T02:18:24.213593+0000","last_clean":"2024-05-09T02:18:24.213593+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:18:24.213593+0000","last_undegraded":"2024-05-09T02:18:24.213593+0000","last_fullsized":"2024-05-09T02:18:24.213593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200111+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:18:24.200111+0000","last_peered":"2024-05-09T02:18:24.200111+0000","last_clean":"2024-05-09T02:18:24.200111+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:18:24.200111+0000","last_undegraded":"2024-05-09T02:18:24.200111+0000","last_fullsized":"2024-05-09T02:18:24.200111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117015+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:18:25.117015+0000","last_peered":"2024-05-09T02:18:25.117015+0000","last_clean":"2024-05-09T02:18:25.117015+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:18:25.117015+0000","last_undegraded":"2024-05-09T02:18:25.117015+0000","last_fullsized":"2024-05-09T02:18:25.117015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194791+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:18:24.194791+0000","last_peered":"2024-05-09T02:18:24.194791+0000","last_clean":"2024-05-09T02:18:24.194791+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:18:24.194791+0000","last_undegraded":"2024-05-09T02:18:24.194791+0000","last_fullsized":"2024-05-09T02:18:24.194791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545365+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:18:24.545365+0000","last_peered":"2024-05-09T02:18:24.545365+0000","last_clean":"2024-05-09T02:18:24.545365+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:18:24.545365+0000","last_undegraded":"2024-05-09T02:18:24.545365+0000","last_fullsized":"2024-05-09T02:18:24.545365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199144+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:18:24.199144+0000","last_peered":"2024-05-09T02:18:24.199144+0000","last_clean":"2024-05-09T02:18:24.199144+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:18:24.199144+0000","last_undegraded":"2024-05-09T02:18:24.199144+0000","last_fullsized":"2024-05-09T02:18:24.199144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117861+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:18:25.117861+0000","last_peered":"2024-05-09T02:18:25.117861+0000","last_clean":"2024-05-09T02:18:25.117861+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:18:25.117861+0000","last_undegraded":"2024-05-09T02:18:25.117861+0000","last_fullsized":"2024-05-09T02:18:25.117861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545293+0000","last_change":"2024-05-09T02:18:14.158139+0000","last_active":"2024-05-09T02:18:24.545293+0000","last_peered":"2024-05-09T02:18:24.545293+0000","last_clean":"2024-05-09T02:18:24.545293+0000","last_became_active":"2024-05-09T02:18:14.157810+0000","last_became_peered":"2024-05-09T02:18:14.157810+0000","last_unstale":"2024-05-09T02:18:24.545293+0000","last_undegraded":"2024-05-09T02:18:24.545293+0000","last_fullsized":"2024-05-09T02:18:24.545293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118231+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:18:25.118231+0000","last_peered":"2024-05-09T02:18:25.118231+0000","last_clean":"2024-05-09T02:18:25.118231+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:18:25.118231+0000","last_undegraded":"2024-05-09T02:18:25.118231+0000","last_fullsized":"2024-05-09T02:18:25.118231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199116+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:18:24.199116+0000","last_peered":"2024-05-09T02:18:24.199116+0000","last_clean":"2024-05-09T02:18:24.199116+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:18:24.199116+0000","last_undegraded":"2024-05-09T02:18:24.199116+0000","last_fullsized":"2024-05-09T02:18:24.199116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118154+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:18:25.118154+0000","last_peered":"2024-05-09T02:18:25.118154+0000","last_clean":"2024-05-09T02:18:25.118154+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:18:25.118154+0000","last_undegraded":"2024-05-09T02:18:25.118154+0000","last_fullsized":"2024-05-09T02:18:25.118154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194363+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:18:24.194363+0000","last_peered":"2024-05-09T02:18:24.194363+0000","last_clean":"2024-05-09T02:18:24.194363+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:18:24.194363+0000","last_undegraded":"2024-05-09T02:18:24.194363+0000","last_fullsized":"2024-05-09T02:18:24.194363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212490+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:18:24.212490+0000","last_peered":"2024-05-09T02:18:24.212490+0000","last_clean":"2024-05-09T02:18:24.212490+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:18:24.212490+0000","last_undegraded":"2024-05-09T02:18:24.212490+0000","last_fullsized":"2024-05-09T02:18:24.212490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194441+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:18:24.194441+0000","last_peered":"2024-05-09T02:18:24.194441+0000","last_clean":"2024-05-09T02:18:24.194441+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:18:24.194441+0000","last_undegraded":"2024-05-09T02:18:24.194441+0000","last_fullsized":"2024-05-09T02:18:24.194441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118101+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:18:25.118101+0000","last_peered":"2024-05-09T02:18:25.118101+0000","last_clean":"2024-05-09T02:18:25.118101+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:18:25.118101+0000","last_undegraded":"2024-05-09T02:18:25.118101+0000","last_fullsized":"2024-05-09T02:18:25.118101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199684+0000","last_change":"2024-05-09T02:18:14.144032+0000","last_active":"2024-05-09T02:18:24.199684+0000","last_peered":"2024-05-09T02:18:24.199684+0000","last_clean":"2024-05-09T02:18:24.199684+0000","last_became_active":"2024-05-09T02:18:14.143572+0000","last_became_peered":"2024-05-09T02:18:14.143572+0000","last_unstale":"2024-05-09T02:18:24.199684+0000","last_undegraded":"2024-05-09T02:18:24.199684+0000","last_fullsized":"2024-05-09T02:18:24.199684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199561+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:18:24.199561+0000","last_peered":"2024-05-09T02:18:24.199561+0000","last_clean":"2024-05-09T02:18:24.199561+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:18:24.199561+0000","last_undegraded":"2024-05-09T02:18:24.199561+0000","last_fullsized":"2024-05-09T02:18:24.199561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213468+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:18:24.213468+0000","last_peered":"2024-05-09T02:18:24.213468+0000","last_clean":"2024-05-09T02:18:24.213468+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:18:24.213468+0000","last_undegraded":"2024-05-09T02:18:24.213468+0000","last_fullsized":"2024-05-09T02:18:24.213468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116796+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:18:25.116796+0000","last_peered":"2024-05-09T02:18:25.116796+0000","last_clean":"2024-05-09T02:18:25.116796+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:18:25.116796+0000","last_undegraded":"2024-05-09T02:18:25.116796+0000","last_fullsized":"2024-05-09T02:18:25.116796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194815+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:18:24.194815+0000","last_peered":"2024-05-09T02:18:24.194815+0000","last_clean":"2024-05-09T02:18:24.194815+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:18:24.194815+0000","last_undegraded":"2024-05-09T02:18:24.194815+0000","last_fullsized":"2024-05-09T02:18:24.194815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116805+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:18:25.116805+0000","last_peered":"2024-05-09T02:18:25.116805+0000","last_clean":"2024-05-09T02:18:25.116805+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:18:25.116805+0000","last_undegraded":"2024-05-09T02:18:25.116805+0000","last_fullsized":"2024-05-09T02:18:25.116805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200413+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:18:24.200413+0000","last_peered":"2024-05-09T02:18:24.200413+0000","last_clean":"2024-05-09T02:18:24.200413+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:18:24.200413+0000","last_undegraded":"2024-05-09T02:18:24.200413+0000","last_fullsized":"2024-05-09T02:18:24.200413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200002+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:18:24.200002+0000","last_peered":"2024-05-09T02:18:24.200002+0000","last_clean":"2024-05-09T02:18:24.200002+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:18:24.200002+0000","last_undegraded":"2024-05-09T02:18:24.200002+0000","last_fullsized":"2024-05-09T02:18:24.200002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200154+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:18:24.200154+0000","last_peered":"2024-05-09T02:18:24.200154+0000","last_clean":"2024-05-09T02:18:24.200154+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:18:24.200154+0000","last_undegraded":"2024-05-09T02:18:24.200154+0000","last_fullsized":"2024-05-09T02:18:24.200154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199852+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:18:24.199852+0000","last_peered":"2024-05-09T02:18:24.199852+0000","last_clean":"2024-05-09T02:18:24.199852+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:18:24.199852+0000","last_undegraded":"2024-05-09T02:18:24.199852+0000","last_fullsized":"2024-05-09T02:18:24.199852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200142+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:18:24.200142+0000","last_peered":"2024-05-09T02:18:24.200142+0000","last_clean":"2024-05-09T02:18:24.200142+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:18:24.200142+0000","last_undegraded":"2024-05-09T02:18:24.200142+0000","last_fullsized":"2024-05-09T02:18:24.200142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116363+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:18:25.116363+0000","last_peered":"2024-05-09T02:18:25.116363+0000","last_clean":"2024-05-09T02:18:25.116363+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:18:25.116363+0000","last_undegraded":"2024-05-09T02:18:25.116363+0000","last_fullsized":"2024-05-09T02:18:25.116363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213190+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:18:24.213190+0000","last_peered":"2024-05-09T02:18:24.213190+0000","last_clean":"2024-05-09T02:18:24.213190+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:18:24.213190+0000","last_undegraded":"2024-05-09T02:18:24.213190+0000","last_fullsized":"2024-05-09T02:18:24.213190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116452+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:18:25.116452+0000","last_peered":"2024-05-09T02:18:25.116452+0000","last_clean":"2024-05-09T02:18:25.116452+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:18:25.116452+0000","last_undegraded":"2024-05-09T02:18:25.116452+0000","last_fullsized":"2024-05-09T02:18:25.116452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544873+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:18:24.544873+0000","last_peered":"2024-05-09T02:18:24.544873+0000","last_clean":"2024-05-09T02:18:24.544873+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:18:24.544873+0000","last_undegraded":"2024-05-09T02:18:24.544873+0000","last_fullsized":"2024-05-09T02:18:24.544873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544891+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:18:24.544891+0000","last_peered":"2024-05-09T02:18:24.544891+0000","last_clean":"2024-05-09T02:18:24.544891+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:18:24.544891+0000","last_undegraded":"2024-05-09T02:18:24.544891+0000","last_fullsized":"2024-05-09T02:18:24.544891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213449+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:18:24.213449+0000","last_peered":"2024-05-09T02:18:24.213449+0000","last_clean":"2024-05-09T02:18:24.213449+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:18:24.213449+0000","last_undegraded":"2024-05-09T02:18:24.213449+0000","last_fullsized":"2024-05-09T02:18:24.213449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194691+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:18:24.194691+0000","last_peered":"2024-05-09T02:18:24.194691+0000","last_clean":"2024-05-09T02:18:24.194691+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:18:24.194691+0000","last_undegraded":"2024-05-09T02:18:24.194691+0000","last_fullsized":"2024-05-09T02:18:24.194691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116786+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:18:25.116786+0000","last_peered":"2024-05-09T02:18:25.116786+0000","last_clean":"2024-05-09T02:18:25.116786+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:18:25.116786+0000","last_undegraded":"2024-05-09T02:18:25.116786+0000","last_fullsized":"2024-05-09T02:18:25.116786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200069+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:18:24.200069+0000","last_peered":"2024-05-09T02:18:24.200069+0000","last_clean":"2024-05-09T02:18:24.200069+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:18:24.200069+0000","last_undegraded":"2024-05-09T02:18:24.200069+0000","last_fullsized":"2024-05-09T02:18:24.200069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199888+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:18:24.199888+0000","last_peered":"2024-05-09T02:18:24.199888+0000","last_clean":"2024-05-09T02:18:24.199888+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:18:24.199888+0000","last_undegraded":"2024-05-09T02:18:24.199888+0000","last_fullsized":"2024-05-09T02:18:24.199888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213517+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:18:24.213517+0000","last_peered":"2024-05-09T02:18:24.213517+0000","last_clean":"2024-05-09T02:18:24.213517+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:18:24.213517+0000","last_undegraded":"2024-05-09T02:18:24.213517+0000","last_fullsized":"2024-05-09T02:18:24.213517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116516+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:18:25.116516+0000","last_peered":"2024-05-09T02:18:25.116516+0000","last_clean":"2024-05-09T02:18:25.116516+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:18:25.116516+0000","last_undegraded":"2024-05-09T02:18:25.116516+0000","last_fullsized":"2024-05-09T02:18:25.116516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117856+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:18:25.117856+0000","last_peered":"2024-05-09T02:18:25.117856+0000","last_clean":"2024-05-09T02:18:25.117856+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:18:25.117856+0000","last_undegraded":"2024-05-09T02:18:25.117856+0000","last_fullsized":"2024-05-09T02:18:25.117856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116831+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:18:25.116831+0000","last_peered":"2024-05-09T02:18:25.116831+0000","last_clean":"2024-05-09T02:18:25.116831+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:18:25.116831+0000","last_undegraded":"2024-05-09T02:18:25.116831+0000","last_fullsized":"2024-05-09T02:18:25.116831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200256+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:18:24.200256+0000","last_peered":"2024-05-09T02:18:24.200256+0000","last_clean":"2024-05-09T02:18:24.200256+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:18:24.200256+0000","last_undegraded":"2024-05-09T02:18:24.200256+0000","last_fullsized":"2024-05-09T02:18:24.200256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200283+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:18:24.200283+0000","last_peered":"2024-05-09T02:18:24.200283+0000","last_clean":"2024-05-09T02:18:24.200283+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:18:24.200283+0000","last_undegraded":"2024-05-09T02:18:24.200283+0000","last_fullsized":"2024-05-09T02:18:24.200283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544524+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:18:24.544524+0000","last_peered":"2024-05-09T02:18:24.544524+0000","last_clean":"2024-05-09T02:18:24.544524+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:18:24.544524+0000","last_undegraded":"2024-05-09T02:18:24.544524+0000","last_fullsized":"2024-05-09T02:18:24.544524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118322+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:18:25.118322+0000","last_peered":"2024-05-09T02:18:25.118322+0000","last_clean":"2024-05-09T02:18:25.118322+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:18:25.118322+0000","last_undegraded":"2024-05-09T02:18:25.118322+0000","last_fullsized":"2024-05-09T02:18:25.118322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199333+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:18:24.199333+0000","last_peered":"2024-05-09T02:18:24.199333+0000","last_clean":"2024-05-09T02:18:24.199333+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:18:24.199333+0000","last_undegraded":"2024-05-09T02:18:24.199333+0000","last_fullsized":"2024-05-09T02:18:24.199333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116756+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:18:25.116756+0000","last_peered":"2024-05-09T02:18:25.116756+0000","last_clean":"2024-05-09T02:18:25.116756+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:18:25.116756+0000","last_undegraded":"2024-05-09T02:18:25.116756+0000","last_fullsized":"2024-05-09T02:18:25.116756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544741+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:18:24.544741+0000","last_peered":"2024-05-09T02:18:24.544741+0000","last_clean":"2024-05-09T02:18:24.544741+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:18:24.544741+0000","last_undegraded":"2024-05-09T02:18:24.544741+0000","last_fullsized":"2024-05-09T02:18:24.544741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199644+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:18:24.199644+0000","last_peered":"2024-05-09T02:18:24.199644+0000","last_clean":"2024-05-09T02:18:24.199644+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:18:24.199644+0000","last_undegraded":"2024-05-09T02:18:24.199644+0000","last_fullsized":"2024-05-09T02:18:24.199644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194548+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:18:24.194548+0000","last_peered":"2024-05-09T02:18:24.194548+0000","last_clean":"2024-05-09T02:18:24.194548+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:18:24.194548+0000","last_undegraded":"2024-05-09T02:18:24.194548+0000","last_fullsized":"2024-05-09T02:18:24.194548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200449+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:18:24.200449+0000","last_peered":"2024-05-09T02:18:24.200449+0000","last_clean":"2024-05-09T02:18:24.200449+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:18:24.200449+0000","last_undegraded":"2024-05-09T02:18:24.200449+0000","last_fullsized":"2024-05-09T02:18:24.200449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117511+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:18:25.117511+0000","last_peered":"2024-05-09T02:18:25.117511+0000","last_clean":"2024-05-09T02:18:25.117511+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:18:25.117511+0000","last_undegraded":"2024-05-09T02:18:25.117511+0000","last_fullsized":"2024-05-09T02:18:25.117511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199759+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:18:24.199759+0000","last_peered":"2024-05-09T02:18:24.199759+0000","last_clean":"2024-05-09T02:18:24.199759+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:18:24.199759+0000","last_undegraded":"2024-05-09T02:18:24.199759+0000","last_fullsized":"2024-05-09T02:18:24.199759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117792+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:18:25.117792+0000","last_peered":"2024-05-09T02:18:25.117792+0000","last_clean":"2024-05-09T02:18:25.117792+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:18:25.117792+0000","last_undegraded":"2024-05-09T02:18:25.117792+0000","last_fullsized":"2024-05-09T02:18:25.117792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544399+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:18:24.544399+0000","last_peered":"2024-05-09T02:18:24.544399+0000","last_clean":"2024-05-09T02:18:24.544399+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:18:24.544399+0000","last_undegraded":"2024-05-09T02:18:24.544399+0000","last_fullsized":"2024-05-09T02:18:24.544399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116838+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:18:25.116838+0000","last_peered":"2024-05-09T02:18:25.116838+0000","last_clean":"2024-05-09T02:18:25.116838+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:18:25.116838+0000","last_undegraded":"2024-05-09T02:18:25.116838+0000","last_fullsized":"2024-05-09T02:18:25.116838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.193965+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:18:24.193965+0000","last_peered":"2024-05-09T02:18:24.193965+0000","last_clean":"2024-05-09T02:18:24.193965+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:18:24.193965+0000","last_undegraded":"2024-05-09T02:18:24.193965+0000","last_fullsized":"2024-05-09T02:18:24.193965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545650+0000","last_change":"2024-05-09T02:18:14.158752+0000","last_active":"2024-05-09T02:18:24.545650+0000","last_peered":"2024-05-09T02:18:24.545650+0000","last_clean":"2024-05-09T02:18:24.545650+0000","last_became_active":"2024-05-09T02:18:14.158424+0000","last_became_peered":"2024-05-09T02:18:14.158424+0000","last_unstale":"2024-05-09T02:18:24.545650+0000","last_undegraded":"2024-05-09T02:18:24.545650+0000","last_fullsized":"2024-05-09T02:18:24.545650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213025+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:18:24.213025+0000","last_peered":"2024-05-09T02:18:24.213025+0000","last_clean":"2024-05-09T02:18:24.213025+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:18:24.213025+0000","last_undegraded":"2024-05-09T02:18:24.213025+0000","last_fullsized":"2024-05-09T02:18:24.213025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544509+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:18:24.544509+0000","last_peered":"2024-05-09T02:18:24.544509+0000","last_clean":"2024-05-09T02:18:24.544509+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:18:24.544509+0000","last_undegraded":"2024-05-09T02:18:24.544509+0000","last_fullsized":"2024-05-09T02:18:24.544509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200878+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:18:24.200878+0000","last_peered":"2024-05-09T02:18:24.200878+0000","last_clean":"2024-05-09T02:18:24.200878+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:18:24.200878+0000","last_undegraded":"2024-05-09T02:18:24.200878+0000","last_fullsized":"2024-05-09T02:18:24.200878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.212585+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:18:24.212585+0000","last_peered":"2024-05-09T02:18:24.212585+0000","last_clean":"2024-05-09T02:18:24.212585+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:18:24.212585+0000","last_undegraded":"2024-05-09T02:18:24.212585+0000","last_fullsized":"2024-05-09T02:18:24.212585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544885+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:18:24.544885+0000","last_peered":"2024-05-09T02:18:24.544885+0000","last_clean":"2024-05-09T02:18:24.544885+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:18:24.544885+0000","last_undegraded":"2024-05-09T02:18:24.544885+0000","last_fullsized":"2024-05-09T02:18:24.544885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194082+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:18:24.194082+0000","last_peered":"2024-05-09T02:18:24.194082+0000","last_clean":"2024-05-09T02:18:24.194082+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:18:24.194082+0000","last_undegraded":"2024-05-09T02:18:24.194082+0000","last_fullsized":"2024-05-09T02:18:24.194082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118000+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:18:25.118000+0000","last_peered":"2024-05-09T02:18:25.118000+0000","last_clean":"2024-05-09T02:18:25.118000+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:18:25.118000+0000","last_undegraded":"2024-05-09T02:18:25.118000+0000","last_fullsized":"2024-05-09T02:18:25.118000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199427+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:18:24.199427+0000","last_peered":"2024-05-09T02:18:24.199427+0000","last_clean":"2024-05-09T02:18:24.199427+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:18:24.199427+0000","last_undegraded":"2024-05-09T02:18:24.199427+0000","last_fullsized":"2024-05-09T02:18:24.199427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199676+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:18:24.199676+0000","last_peered":"2024-05-09T02:18:24.199676+0000","last_clean":"2024-05-09T02:18:24.199676+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:18:24.199676+0000","last_undegraded":"2024-05-09T02:18:24.199676+0000","last_fullsized":"2024-05-09T02:18:24.199676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.200953+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:18:24.200953+0000","last_peered":"2024-05-09T02:18:24.200953+0000","last_clean":"2024-05-09T02:18:24.200953+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:18:24.200953+0000","last_undegraded":"2024-05-09T02:18:24.200953+0000","last_fullsized":"2024-05-09T02:18:24.200953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116902+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:18:25.116902+0000","last_peered":"2024-05-09T02:18:25.116902+0000","last_clean":"2024-05-09T02:18:25.116902+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:18:25.116902+0000","last_undegraded":"2024-05-09T02:18:25.116902+0000","last_fullsized":"2024-05-09T02:18:25.116902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117232+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:18:25.117232+0000","last_peered":"2024-05-09T02:18:25.117232+0000","last_clean":"2024-05-09T02:18:25.117232+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:18:25.117232+0000","last_undegraded":"2024-05-09T02:18:25.117232+0000","last_fullsized":"2024-05-09T02:18:25.117232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117481+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:18:25.117481+0000","last_peered":"2024-05-09T02:18:25.117481+0000","last_clean":"2024-05-09T02:18:25.117481+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:18:25.117481+0000","last_undegraded":"2024-05-09T02:18:25.117481+0000","last_fullsized":"2024-05-09T02:18:25.117481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117736+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:18:25.117736+0000","last_peered":"2024-05-09T02:18:25.117736+0000","last_clean":"2024-05-09T02:18:25.117736+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:18:25.117736+0000","last_undegraded":"2024-05-09T02:18:25.117736+0000","last_fullsized":"2024-05-09T02:18:25.117736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544734+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:18:24.544734+0000","last_peered":"2024-05-09T02:18:24.544734+0000","last_clean":"2024-05-09T02:18:24.544734+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:18:24.544734+0000","last_undegraded":"2024-05-09T02:18:24.544734+0000","last_fullsized":"2024-05-09T02:18:24.544734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118260+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:18:25.118260+0000","last_peered":"2024-05-09T02:18:25.118260+0000","last_clean":"2024-05-09T02:18:25.118260+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:18:25.118260+0000","last_undegraded":"2024-05-09T02:18:25.118260+0000","last_fullsized":"2024-05-09T02:18:25.118260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199800+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:18:24.199800+0000","last_peered":"2024-05-09T02:18:24.199800+0000","last_clean":"2024-05-09T02:18:24.199800+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:18:24.199800+0000","last_undegraded":"2024-05-09T02:18:24.199800+0000","last_fullsized":"2024-05-09T02:18:24.199800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199349+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:18:24.199349+0000","last_peered":"2024-05-09T02:18:24.199349+0000","last_clean":"2024-05-09T02:18:24.199349+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:18:24.199349+0000","last_undegraded":"2024-05-09T02:18:24.199349+0000","last_fullsized":"2024-05-09T02:18:24.199349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118052+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:18:25.118052+0000","last_peered":"2024-05-09T02:18:25.118052+0000","last_clean":"2024-05-09T02:18:25.118052+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:18:25.118052+0000","last_undegraded":"2024-05-09T02:18:25.118052+0000","last_fullsized":"2024-05-09T02:18:25.118052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116863+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:18:25.116863+0000","last_peered":"2024-05-09T02:18:25.116863+0000","last_clean":"2024-05-09T02:18:25.116863+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:18:25.116863+0000","last_undegraded":"2024-05-09T02:18:25.116863+0000","last_fullsized":"2024-05-09T02:18:25.116863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213378+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:18:24.213378+0000","last_peered":"2024-05-09T02:18:24.213378+0000","last_clean":"2024-05-09T02:18:24.213378+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:18:24.213378+0000","last_undegraded":"2024-05-09T02:18:24.213378+0000","last_fullsized":"2024-05-09T02:18:24.213378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.544667+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:18:24.544667+0000","last_peered":"2024-05-09T02:18:24.544667+0000","last_clean":"2024-05-09T02:18:24.544667+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:18:24.544667+0000","last_undegraded":"2024-05-09T02:18:24.544667+0000","last_fullsized":"2024-05-09T02:18:24.544667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545227+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:18:24.545227+0000","last_peered":"2024-05-09T02:18:24.545227+0000","last_clean":"2024-05-09T02:18:24.545227+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:18:24.545227+0000","last_undegraded":"2024-05-09T02:18:24.545227+0000","last_fullsized":"2024-05-09T02:18:24.545227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.117035+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:18:25.117035+0000","last_peered":"2024-05-09T02:18:25.117035+0000","last_clean":"2024-05-09T02:18:25.117035+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:18:25.117035+0000","last_undegraded":"2024-05-09T02:18:25.117035+0000","last_fullsized":"2024-05-09T02:18:25.117035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.199515+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:18:24.199515+0000","last_peered":"2024-05-09T02:18:24.199515+0000","last_clean":"2024-05-09T02:18:24.199515+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:18:24.199515+0000","last_undegraded":"2024-05-09T02:18:24.199515+0000","last_fullsized":"2024-05-09T02:18:24.199515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.545003+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:18:24.545003+0000","last_peered":"2024-05-09T02:18:24.545003+0000","last_clean":"2024-05-09T02:18:24.545003+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:18:24.545003+0000","last_undegraded":"2024-05-09T02:18:24.545003+0000","last_fullsized":"2024-05-09T02:18:24.545003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116685+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:18:25.116685+0000","last_peered":"2024-05-09T02:18:25.116685+0000","last_clean":"2024-05-09T02:18:25.116685+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:18:25.116685+0000","last_undegraded":"2024-05-09T02:18:25.116685+0000","last_fullsized":"2024-05-09T02:18:25.116685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.194258+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:18:24.194258+0000","last_peered":"2024-05-09T02:18:24.194258+0000","last_clean":"2024-05-09T02:18:24.194258+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:18:24.194258+0000","last_undegraded":"2024-05-09T02:18:24.194258+0000","last_fullsized":"2024-05-09T02:18:24.194258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116880+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:18:25.116880+0000","last_peered":"2024-05-09T02:18:25.116880+0000","last_clean":"2024-05-09T02:18:25.116880+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:18:25.116880+0000","last_undegraded":"2024-05-09T02:18:25.116880+0000","last_fullsized":"2024-05-09T02:18:25.116880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:24.213092+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:18:24.213092+0000","last_peered":"2024-05-09T02:18:24.213092+0000","last_clean":"2024-05-09T02:18:24.213092+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:18:24.213092+0000","last_undegraded":"2024-05-09T02:18:24.213092+0000","last_fullsized":"2024-05-09T02:18:24.213092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.116857+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:18:25.116857+0000","last_peered":"2024-05-09T02:18:25.116857+0000","last_clean":"2024-05-09T02:18:25.116857+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:18:25.116857+0000","last_undegraded":"2024-05-09T02:18:25.116857+0000","last_fullsized":"2024-05-09T02:18:25.116857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T02:18:25.118184+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:18:25.118184+0000","last_peered":"2024-05-09T02:18:25.118184+0000","last_clean":"2024-05-09T02:18:25.118184+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:18:25.118184+0000","last_undegraded":"2024-05-09T02:18:25.118184+0000","last_fullsized":"2024-05-09T02:18:25.118184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":106601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":107619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:18:45.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.945+0000 7fb6de053640 1 Processor -- start 2024-05-09T02:18:45.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.945+0000 7fb6de053640 1 -- start start 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6de053640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6d80c3f60 0x7fb6d8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6de053640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806c6c0 0x7fb6d806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6de053640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d81566b0 con 0x7fb6d8074800 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6de053640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d80c95b0 con 0x7fb6d80c3f60 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6de053640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d80c9890 con 0x7fb6d806c6c0 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6d6ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6d80c3f60 0x7fb6d8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6d7fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806c6c0 0x7fb6d806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6d6ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6d80c3f60 0x7fb6d8152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:41494/0 (socket says 172.21.15.46:41494) 2024-05-09T02:18:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6d6ffd640 1 -- 172.21.15.46:0/3107327435 learned_addr learned my addr 172.21.15.46:0/3107327435 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.946+0000 7fb6d77fe640 1 --1- 172.21.15.46:0/3107327435 >> v1:172.21.15.107:6789/0 conn(0x7fb6d8074800 0x7fb6d80c7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:52878/0 (socket says 172.21.15.46:52878) 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.947+0000 7fb6d6ffd640 1 -- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806c6c0 msgr2=0x7fb6d806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.947+0000 7fb6d6ffd640 1 --2- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806c6c0 0x7fb6d806cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.947+0000 7fb6d6ffd640 1 -- 172.21.15.46:0/3107327435 >> v1:172.21.15.107:6789/0 conn(0x7fb6d8074800 legacy=0x7fb6d80c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.947+0000 7fb6d6ffd640 1 -- 172.21.15.46:0/3107327435 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d8156380 con 0x7fb6d80c3f60 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.947+0000 7fb6d7fff640 1 --2- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806c6c0 0x7fb6d806cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.948+0000 7fb6d6ffd640 1 --2- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d8152f70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009870 tx=0x7fb6cc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb843d353f8f9409 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.948+0000 7fb6d67fc640 1 -- 172.21.15.46:0/3107327435 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc037070 con 0x7fb6d80c3f60 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.948+0000 7fb6d67fc640 1 -- 172.21.15.46:0/3107327435 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc032440 con 0x7fb6d80c3f60 2024-05-09T02:18:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.948+0000 7fb6d67fc640 1 -- 172.21.15.46:0/3107327435 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc032810 con 0x7fb6d80c3f60 2024-05-09T02:18:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 -- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 msgr2=0x7fb6d8152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 --2- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d8152f70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009870 tx=0x7fb6cc02a130 comp rx=0 tx=0).stop 2024-05-09T02:18:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 -- 172.21.15.46:0/3107327435 shutdown_connections 2024-05-09T02:18:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 --2- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d806c6c0 0x7fb6d806cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 --2- 172.21.15.46:0/3107327435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d8152f70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 -- 172.21.15.46:0/3107327435 >> 172.21.15.46:0/3107327435 conn(0x7fb6d806d7d0 msgr2=0x7fb6d806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 -- 172.21.15.46:0/3107327435 shutdown_connections 2024-05-09T02:18:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.949+0000 7fb6de053640 1 -- 172.21.15.46:0/3107327435 wait complete. 2024-05-09T02:18:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.950+0000 7fb6de053640 1 Processor -- start 2024-05-09T02:18:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.950+0000 7fb6de053640 1 -- start start 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6de053640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 0x7fb6d8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6de053640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6de053640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d81df920 0x7fb6d8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6de053640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d806d190 con 0x7fb6d806c6c0 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6de053640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d806d010 con 0x7fb6d80c3f60 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6de053640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d806d310 con 0x7fb6d81df920 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 0x7fb6d8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 0x7fb6d8159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38618/0 (socket says 172.21.15.46:38618) 2024-05-09T02:18:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 -- 172.21.15.46:0/1334397600 learned_addr learned my addr 172.21.15.46:0/1334397600 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d7fff640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d81df920 0x7fb6d8157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d6ffd640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 -- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d81df920 msgr2=0x7fb6d8157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d81df920 0x7fb6d8157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 -- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 msgr2=0x7fb6d814dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d814dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 -- 172.21.15.46:0/1334397600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d81df100 con 0x7fb6d806c6c0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6d77fe640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 0x7fb6d8159910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c400 tx=0x7fb6c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.952+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80074e0 con 0x7fb6d806c6c0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.953+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c8007680 con 0x7fb6d806c6c0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.953+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80049e0 con 0x7fb6d806c6c0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.953+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d81df3e0 con 0x7fb6d806c6c0 2024-05-09T02:18:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.953+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d814e1a0 con 0x7fb6d806c6c0 2024-05-09T02:18:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.954+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d806a330 con 0x7fb6d806c6c0 2024-05-09T02:18:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.954+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6c801a020 con 0x7fb6d806c6c0 2024-05-09T02:18:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.955+0000 7fb6bffff640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6c40762d0 0x7fb6c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:45.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.955+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb6c80970f0 con 0x7fb6d806c6c0 2024-05-09T02:18:45.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.955+0000 7fb6d6ffd640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6c40762d0 0x7fb6c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:45.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.956+0000 7fb6d6ffd640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6c40762d0 0x7fb6c40787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc034000 tx=0x7fb6cc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:45.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:45.959+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6c8060720 con 0x7fb6d806c6c0 2024-05-09T02:18:46.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.198+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6d8074100 con 0x7fb6d806c6c0 2024-05-09T02:18:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.198+0000 7fb6bffff640 1 -- 172.21.15.46:0/1334397600 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7fb6c8060020 con 0x7fb6d806c6c0 2024-05-09T02:18:46.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:46.202 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6c40762d0 msgr2=0x7fb6c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6c40762d0 0x7fb6c40787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc034000 tx=0x7fb6cc02e000 comp rx=0 tx=0).stop 2024-05-09T02:18:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 msgr2=0x7fb6d8159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 0x7fb6d8159910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c400 tx=0x7fb6c800c8c0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 shutdown_connections 2024-05-09T02:18:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb6c40762d0 0x7fb6c40787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6d81df920 0x7fb6d8157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6d80c3f60 0x7fb6d814dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 --2- 172.21.15.46:0/1334397600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d806c6c0 0x7fb6d8159910 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 >> 172.21.15.46:0/1334397600 conn(0x7fb6d806d7d0 msgr2=0x7fb6d8152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 shutdown_connections 2024-05-09T02:18:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.201+0000 7fb6de053640 1 -- 172.21.15.46:0/1334397600 wait complete. 2024-05-09T02:18:46.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:18:46.210 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:18:46.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.406+0000 7f2f6feee640 1 Processor -- start 2024-05-09T02:18:46.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.407+0000 7f2f6feee640 1 -- start start 2024-05-09T02:18:46.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6feee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 0x7f2f68153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6feee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f680c2ee0 0x7f2f68155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6feee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f680aa900 con 0x7f2f680c51a0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6feee640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2f68153560 con 0x7f2f680c2ee0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6feee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f680c3e50 con 0x7f2f680c42e0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6dc8a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2f680c51a0 0x7f2f6806f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35086/0 (socket says 172.21.15.46:35086) 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3136509397 learned_addr learned my addr 172.21.15.46:0/3136509397 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529187899 0 0) 0x7f2f680aa900 con 0x7f2f680c51a0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f50003520 con 0x7f2f680c51a0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6d489640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 0x7f2f68153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.408+0000 7f2f6e48b640 1 --2- 172.21.15.46:0/3136509397 >> v2:172.21.15.107:3300/0 conn(0x7f2f680c2ee0 0x7f2f68155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2970601606 0 0) 0x7f2f50003520 con 0x7f2f680c51a0 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 msgr2=0x7f2f68153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 0x7f2f68153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 >> v2:172.21.15.107:3300/0 conn(0x7f2f680c2ee0 msgr2=0x7f2f68155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 --2- 172.21.15.46:0/3136509397 >> v2:172.21.15.107:3300/0 conn(0x7f2f680c2ee0 0x7f2f68155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f680aa620 con 0x7f2f680c51a0 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f2f58001a70 con 0x7f2f680c51a0 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 >> v1:172.21.15.46:6789/0 conn(0x7f2f680c51a0 legacy=0x7f2f6806f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f50003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f50004800 0x7f2f50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 0x7f2f50005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2f680c3e50 con 0x7f2f50003a50 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5000bad0 con 0x7f2f50004800 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5000bcd0 con 0x7f2f680c42e0 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f50003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6d489640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f50004800 0x7f2f50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6e48b640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 0x7f2f50005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 msgr2=0x7f2f50005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f680c42e0 0x7f2f50005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f50004800 msgr2=0x7f2f50004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f50004800 0x7f2f50004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.409+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3136509397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f50003520 con 0x7f2f50003a50 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.410+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f50003ec0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800a870 tx=0x7f2f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb89b5aa8dc88686 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.410+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800a4c0 con 0x7f2f50003a50 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.410+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5802f070 con 0x7f2f50003a50 2024-05-09T02:18:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.410+0000 7f2f6cc88640 1 -- 172.21.15.46:0/3136509397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5802bc30 con 0x7f2f50003a50 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6feee640 1 -- 172.21.15.46:0/3136509397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 msgr2=0x7f2f50003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3136509397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f50003ec0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800a870 tx=0x7f2f50005830 comp rx=0 tx=0).stop 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6e48b640 1 -- 172.21.15.46:0/3136509397 reap_dead start 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6feee640 1 -- 172.21.15.46:0/3136509397 shutdown_connections 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6feee640 1 -- 172.21.15.46:0/3136509397 >> 172.21.15.46:0/3136509397 conn(0x7f2f680c5940 msgr2=0x7f2f680c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6feee640 1 -- 172.21.15.46:0/3136509397 shutdown_connections 2024-05-09T02:18:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.411+0000 7f2f6feee640 1 -- 172.21.15.46:0/3136509397 wait complete. 2024-05-09T02:18:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.413+0000 7f2f6feee640 1 Processor -- start 2024-05-09T02:18:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.413+0000 7f2f6feee640 1 -- start start 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6feee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f68073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6feee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f68073810 0x7f2f680c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6feee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f681f0b10 0x7f2f681f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6feee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2f680aa2b0 con 0x7f2f50003a50 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6feee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2f680c3ae0 con 0x7f2f68073810 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6feee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2f680700c0 con 0x7f2f681f0b10 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f68073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f68073170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59660/0 (socket says 172.21.15.46:59660) 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3050866706 learned_addr learned my addr 172.21.15.46:0/3050866706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6e48b640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f681f0b10 0x7f2f681f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6d489640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f68073810 0x7f2f680c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f681f0b10 msgr2=0x7f2f681f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f681f0b10 0x7f2f681f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f68073810 msgr2=0x7f2f680c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f68073810 0x7f2f680c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 -- 172.21.15.46:0/3050866706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f680744b0 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.414+0000 7f2f6dc8a640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f68073170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f80 tx=0x7f2f58001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.415+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58002030 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.415+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f58004d80 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.415+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f68074790 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.415+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f580346b0 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.415+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f680a7990 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.415+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6806a330 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.416+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f58034850 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.417+0000 7f2f667fc640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2f540762d0 0x7f2f540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.417+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2f580b85c0 con 0x7f2f50003a50 2024-05-09T02:18:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.417+0000 7f2f6d489640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2f540762d0 0x7f2f540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.418+0000 7f2f6d489640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2f540762d0 0x7f2f540787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f680c2b40 tx=0x7f2f5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.421+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2f58081bd0 con 0x7f2f50003a50 2024-05-09T02:18:46.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.612+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f680c7f10 con 0x7f2f50003a50 2024-05-09T02:18:46.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.614+0000 7f2f667fc640 1 -- 172.21.15.46:0/3050866706 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7f2f580814d0 con 0x7f2f50003a50 2024-05-09T02:18:46.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:46.617 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2f540762d0 msgr2=0x7f2f540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2f540762d0 0x7f2f540787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f680c2b40 tx=0x7f2f5c008040 comp rx=0 tx=0).stop 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 msgr2=0x7f2f68073170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f68073170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f80 tx=0x7f2f58001db0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 shutdown_connections 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2f540762d0 0x7f2f540787e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f681f0b10 0x7f2f681f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f68073810 0x7f2f680c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 --2- 172.21.15.46:0/3050866706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f50003a50 0x7f2f68073170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 >> 172.21.15.46:0/3050866706 conn(0x7f2f680c5940 msgr2=0x7f2f68152240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 shutdown_connections 2024-05-09T02:18:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.616+0000 7f2f6feee640 1 -- 172.21.15.46:0/3050866706 wait complete. 2024-05-09T02:18:46.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:46.630 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2024-05-09T02:18:46.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.745+0000 7fdd6035e640 1 Processor -- start 2024-05-09T02:18:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.745+0000 7fdd6035e640 1 -- start start 2024-05-09T02:18:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.745+0000 7ff66f186640 1 Processor -- start 2024-05-09T02:18:46.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.745+0000 7ff66f186640 1 -- start start 2024-05-09T02:18:46.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7fdd6035e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd580c4e80 0x7fdd58155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7ff66f186640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff6680c96c0 0x7ff6680c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7ff66f186640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff66815b3a0 0x7ff66815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7ff66f186640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff668158ae0 con 0x7ff668155160 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7ff66f186640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff668155570 con 0x7ff6680c96c0 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7ff66f186640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff668157ed0 con 0x7ff66815b3a0 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7fdd6035e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd580c83b0 con 0x7fdd58070b30 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7fdd6035e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd58155740 con 0x7fdd58152ea0 2024-05-09T02:18:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7fdd6035e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fdd58159d00 con 0x7fdd580c4e80 2024-05-09T02:18:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7ff667fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff6680c96c0 0x7ff6680c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff667fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff6680c96c0 0x7ff6680c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59678/0 (socket says 172.21.15.46:59678) 2024-05-09T02:18:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.746+0000 7fdd5d8f9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd580c4e80 0x7fdd58155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7fdd5e0fa640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdd58070b30 0x7fdd580722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35102/0 (socket says 172.21.15.46:35102) 2024-05-09T02:18:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7fdd5e0fa640 1 -- 172.21.15.46:0/571135001 learned_addr learned my addr 172.21.15.46:0/571135001 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:46.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff667fff640 1 -- 172.21.15.46:0/4109387170 learned_addr learned my addr 172.21.15.46:0/4109387170 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:46.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff66d723640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff66815b3a0 0x7ff66815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff667fff640 1 -- 172.21.15.46:0/4109387170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff66815b3a0 msgr2=0x7ff66815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:46.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff667fff640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff66815b3a0 0x7ff66815b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff667fff640 1 -- 172.21.15.46:0/4109387170 >> v1:172.21.15.107:6789/0 conn(0x7ff668155160 legacy=0x7ff6680c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff667fff640 1 -- 172.21.15.46:0/4109387170 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6681581b0 con 0x7ff6680c96c0 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7ff66d723640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff66815b3a0 0x7ff66815b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/571135001 >> v1:172.21.15.107:6789/0 conn(0x7fdd58152ea0 legacy=0x7fdd58156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7fdd5d0f8640 1 -- 172.21.15.46:0/571135001 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2225542219 0 0) 0x7fdd50001490 con 0x7fdd58152ea0 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/571135001 >> v1:172.21.15.46:6789/0 conn(0x7fdd58070b30 legacy=0x7fdd580722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.747+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/571135001 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd580ca600 con 0x7fdd580c4e80 2024-05-09T02:18:46.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7ff667fff640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6680c96c0 0x7ff6680c9ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff654009870 tx=0x7ff65402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255338dce027eed2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7fdd5d8f9640 1 --2- 172.21.15.46:0/571135001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd58155c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097a0 tx=0x7fdd4802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfc7f569627ba21 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7ff6677fe640 1 -- 172.21.15.46:0/4109387170 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654037070 con 0x7ff6680c96c0 2024-05-09T02:18:46.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7ff6677fe640 1 -- 172.21.15.46:0/4109387170 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff654032440 con 0x7ff6680c96c0 2024-05-09T02:18:46.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7ff6677fe640 1 -- 172.21.15.46:0/4109387170 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654032810 con 0x7ff6680c96c0 2024-05-09T02:18:46.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7fdd5d0f8640 1 -- 172.21.15.46:0/571135001 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48037070 con 0x7fdd580c4e80 2024-05-09T02:18:46.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7fdd5d0f8640 1 -- 172.21.15.46:0/571135001 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4802ad30 con 0x7fdd580c4e80 2024-05-09T02:18:46.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.748+0000 7fdd5d0f8640 1 -- 172.21.15.46:0/571135001 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48032660 con 0x7fdd580c4e80 2024-05-09T02:18:46.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 -- 172.21.15.46:0/571135001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 msgr2=0x7fdd58155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 -- 172.21.15.46:0/4109387170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6680c96c0 msgr2=0x7ff6680c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 --2- 172.21.15.46:0/571135001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd58155c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097a0 tx=0x7fdd4802a0a0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6680c96c0 0x7ff6680c9ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff654009870 tx=0x7ff65402a130 comp rx=0 tx=0).stop 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 -- 172.21.15.46:0/4109387170 shutdown_connections 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff66815b3a0 0x7ff66815b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 --2- 172.21.15.46:0/4109387170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6680c96c0 0x7ff6680c9ad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 -- 172.21.15.46:0/4109387170 >> 172.21.15.46:0/4109387170 conn(0x7ff6680aebe0 msgr2=0x7ff6680aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 -- 172.21.15.46:0/571135001 shutdown_connections 2024-05-09T02:18:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 --2- 172.21.15.46:0/571135001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd58155c00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 -- 172.21.15.46:0/571135001 >> 172.21.15.46:0/571135001 conn(0x7fdd58069040 msgr2=0x7fdd580ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:46.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 -- 172.21.15.46:0/4109387170 shutdown_connections 2024-05-09T02:18:46.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7ff66f186640 1 -- 172.21.15.46:0/4109387170 wait complete. 2024-05-09T02:18:46.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 -- 172.21.15.46:0/571135001 shutdown_connections 2024-05-09T02:18:46.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.749+0000 7fdd6035e640 1 -- 172.21.15.46:0/571135001 wait complete. 2024-05-09T02:18:46.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.751+0000 7ff66f186640 1 Processor -- start 2024-05-09T02:18:46.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.751+0000 7fdd6035e640 1 Processor -- start 2024-05-09T02:18:46.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.751+0000 7fdd6035e640 1 -- start start 2024-05-09T02:18:46.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.751+0000 7ff66f186640 1 -- start start 2024-05-09T02:18:46.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd6035e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd58070b30 0x7fdd580c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd6035e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd581edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd6035e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd58152ea0 0x7fdd58151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd6035e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58159a20 con 0x7fdd580c4e80 2024-05-09T02:18:46.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd6035e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580ca8a0 con 0x7fdd58070b30 2024-05-09T02:18:46.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd6035e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd580729d0 con 0x7fdd58152ea0 2024-05-09T02:18:46.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66f186640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6680c96c0 0x7ff6681f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd5d8f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd581edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66f186640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 0x7ff668158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66f186640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff66815b3a0 0x7ff6681436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd5d8f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd581edd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59694/0 (socket says 172.21.15.46:59694) 2024-05-09T02:18:46.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/3585092989 learned_addr learned my addr 172.21.15.46:0/3585092989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:46.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66f186640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680c8670 con 0x7ff668155160 2024-05-09T02:18:46.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66f186640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff668158770 con 0x7ff66815b3a0 2024-05-09T02:18:46.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66f186640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff668157b30 con 0x7ff6680c96c0 2024-05-09T02:18:46.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd5e0fa640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd58070b30 0x7fdd580c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff667fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 0x7ff668158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff667fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 0x7ff668158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59710/0 (socket says 172.21.15.46:59710) 2024-05-09T02:18:46.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff667fff640 1 -- 172.21.15.46:0/1253516299 learned_addr learned my addr 172.21.15.46:0/1253516299 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:46.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7fdd5e8fb640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd58152ea0 0x7fdd58151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66cf22640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6680c96c0 0x7ff6681f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.752+0000 7ff66d723640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff66815b3a0 0x7ff6681436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd58152ea0 msgr2=0x7fdd58151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd5d8f9640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd58152ea0 0x7fdd58151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd58070b30 msgr2=0x7fdd580c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd5d8f9640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd58070b30 0x7fdd580c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd5d8f9640 1 -- 172.21.15.46:0/3585092989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd580b0010 con 0x7fdd580c4e80 2024-05-09T02:18:46.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff667fff640 1 -- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6680c96c0 msgr2=0x7ff6681f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff667fff640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6680c96c0 0x7ff6681f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff667fff640 1 -- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff66815b3a0 msgr2=0x7ff6681436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff667fff640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff66815b3a0 0x7ff6681436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd5d8f9640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd581edd20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097a0 tx=0x7fdd480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff667fff640 1 -- 172.21.15.46:0/1253516299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66814e3a0 con 0x7ff668155160 2024-05-09T02:18:46.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48037040 con 0x7fdd580c4e80 2024-05-09T02:18:46.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48032e30 con 0x7fdd580c4e80 2024-05-09T02:18:46.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff667fff640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 0x7ff668158cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff654009870 tx=0x7ff6540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581f1330 con 0x7fdd580c4e80 2024-05-09T02:18:46.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004230 con 0x7fdd580c4e80 2024-05-09T02:18:46.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581f18f0 con 0x7fdd580c4e80 2024-05-09T02:18:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654041020 con 0x7ff668155160 2024-05-09T02:18:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6540306c0 con 0x7ff668155160 2024-05-09T02:18:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6681f1fb0 con 0x7ff668155160 2024-05-09T02:18:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.753+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654037040 con 0x7ff668155160 2024-05-09T02:18:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.754+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66814d870 con 0x7ff668155160 2024-05-09T02:18:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.754+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5806a330 con 0x7fdd580c4e80 2024-05-09T02:18:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.755+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66806a330 con 0x7ff668155160 2024-05-09T02:18:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.755+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd4803a070 con 0x7fdd580c4e80 2024-05-09T02:18:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.755+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff654044020 con 0x7ff668155160 2024-05-09T02:18:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.756+0000 7ff6657fa640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff64c0762d0 0x7ff64c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.756+0000 7fdd4effd640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd3c076300 0x7fdd3c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:46.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.756+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff6540b7f50 con 0x7ff668155160 2024-05-09T02:18:46.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.756+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fdd480b7ac0 con 0x7fdd580c4e80 2024-05-09T02:18:46.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.756+0000 7fdd5e0fa640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd3c076300 0x7fdd3c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.756+0000 7ff66cf22640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff64c0762d0 0x7ff64c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:46.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.757+0000 7fdd5e0fa640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd3c076300 0x7fdd3c078810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000f60 tx=0x7fdd54007e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.757+0000 7ff66cf22640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff64c0762d0 0x7ff64c0787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff65c000f60 tx=0x7ff65c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:46.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.761+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd48041020 con 0x7fdd580c4e80 2024-05-09T02:18:46.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.766+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff65404b030 con 0x7ff668155160 2024-05-09T02:18:46.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.991+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd580ca240 con 0x7fdd580c4e80 2024-05-09T02:18:46.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.992+0000 7fdd4effd640 1 -- 172.21.15.46:0/3585092989 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7fdd480890e0 con 0x7fdd580c4e80 2024-05-09T02:18:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:46.995 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:46.995 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.993+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd3c076300 msgr2=0x7fdd3c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.993+0000 7fdd6035e640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd3c076300 0x7fdd3c078810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000f60 tx=0x7fdd54007e20 comp rx=0 tx=0).stop 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.993+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 msgr2=0x7fdd581edd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.993+0000 7fdd6035e640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd581edd20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097a0 tx=0x7fdd480046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 shutdown_connections 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdd3c076300 0x7fdd3c078810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd58152ea0 0x7fdd58151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd580c4e80 0x7fdd581edd20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 --2- 172.21.15.46:0/3585092989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd58070b30 0x7fdd580c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 >> 172.21.15.46:0/3585092989 conn(0x7fdd58069040 msgr2=0x7fdd580ab0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 shutdown_connections 2024-05-09T02:18:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.994+0000 7fdd6035e640 1 -- 172.21.15.46:0/3585092989 wait complete. 2024-05-09T02:18:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.995+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6680c27f0 con 0x7ff668155160 2024-05-09T02:18:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.995+0000 7ff6657fa640 1 -- 172.21.15.46:0/1253516299 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7ff654080f30 con 0x7ff668155160 2024-05-09T02:18:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:46.998 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff64c0762d0 msgr2=0x7ff64c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff64c0762d0 0x7ff64c0787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff65c000f60 tx=0x7ff65c009040 comp rx=0 tx=0).stop 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 msgr2=0x7ff668158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 0x7ff668158cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff654009870 tx=0x7ff6540046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 shutdown_connections 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff64c0762d0 0x7ff64c0787e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff66815b3a0 0x7ff6681436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff668155160 0x7ff668158cd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 --2- 172.21.15.46:0/1253516299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6680c96c0 0x7ff6681f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 >> 172.21.15.46:0/1253516299 conn(0x7ff6680aebe0 msgr2=0x7ff6680c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 shutdown_connections 2024-05-09T02:18:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:46.998+0000 7ff66f186640 1 -- 172.21.15.46:0/1253516299 wait complete. 2024-05-09T02:18:47.008 INFO:tasks.mds_thrash.fs.[a]:kill mds.b (rank=0) 2024-05-09T02:18:47.009 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T02:18:47.009 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:18:47.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:18:47.022 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T02:18:47.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:47.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.166+0000 7fce2f2f0640 1 Processor -- start 2024-05-09T02:18:47.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.167+0000 7f1d4aa0c640 1 Processor -- start 2024-05-09T02:18:47.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.167+0000 7fce2f2f0640 1 -- start start 2024-05-09T02:18:47.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.167+0000 7f1d4aa0c640 1 -- start start 2024-05-09T02:18:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d4aa0c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d440c46e0 0x7f1d440c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d4aa0c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1d4414f7b0 0x7f1d44073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2f2f0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c8410 0x7fce281584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d4aa0c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d44074020 0x7f1d44155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2f2f0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fce280c1e20 0x7fce280c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d4aa0c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f1d440c7be0 con 0x7f1d440c46e0 2024-05-09T02:18:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d4aa0c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1d440a9860 con 0x7f1d4414f7b0 2024-05-09T02:18:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d4aa0c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1d44071120 con 0x7f1d44074020 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2f2f0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce2806ed30 con 0x7fce28140d40 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2f2f0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fce280c8820 con 0x7fce280c1e20 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2f2f0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce2806f010 con 0x7fce280c8410 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2d88d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fce280c1e20 0x7fce280c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d43fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d440c46e0 0x7f1d440c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d43fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d440c46e0 0x7f1d440c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59722/0 (socket says 172.21.15.46:59722) 2024-05-09T02:18:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d43fff640 1 -- 172.21.15.46:0/2377787534 learned_addr learned my addr 172.21.15.46:0/2377787534 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2d88d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fce280c1e20 0x7fce280c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59726/0 (socket says 172.21.15.46:59726) 2024-05-09T02:18:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7fce2d88d640 1 -- 172.21.15.46:0/2625001299 learned_addr learned my addr 172.21.15.46:0/2625001299 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d437fe640 1 --2- 172.21.15.46:0/2377787534 >> v2:172.21.15.107:3300/0 conn(0x7f1d4414f7b0 0x7f1d44073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.169+0000 7f1d48fa9640 1 --2- 172.21.15.46:0/2377787534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d44074020 0x7f1d44155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7fce2c88b640 1 --2- 172.21.15.46:0/2625001299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c8410 0x7fce281584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d43fff640 1 -- 172.21.15.46:0/2377787534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d44074020 msgr2=0x7f1d44155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:47.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d43fff640 1 --2- 172.21.15.46:0/2377787534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d44074020 0x7f1d44155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d43fff640 1 -- 172.21.15.46:0/2377787534 >> v2:172.21.15.107:3300/0 conn(0x7f1d4414f7b0 msgr2=0x7f1d44073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:47.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d43fff640 1 --2- 172.21.15.46:0/2377787534 >> v2:172.21.15.107:3300/0 conn(0x7f1d4414f7b0 0x7f1d44073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d43fff640 1 -- 172.21.15.46:0/2377787534 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d440713c0 con 0x7f1d440c46e0 2024-05-09T02:18:47.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d437fe640 1 --2- 172.21.15.46:0/2377787534 >> v2:172.21.15.107:3300/0 conn(0x7f1d4414f7b0 0x7f1d44073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:18:47.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7fce2d88d640 1 -- 172.21.15.46:0/2625001299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c8410 msgr2=0x7fce281584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:47.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7fce2d88d640 1 --2- 172.21.15.46:0/2625001299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c8410 0x7fce281584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7fce2d88d640 1 -- 172.21.15.46:0/2625001299 >> v1:172.21.15.107:6789/0 conn(0x7fce28140d40 legacy=0x7fce2806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7fce2d88d640 1 -- 172.21.15.46:0/2625001299 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce280c7930 con 0x7fce280c1e20 2024-05-09T02:18:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.170+0000 7f1d43fff640 1 --2- 172.21.15.46:0/2377787534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d440c46e0 0x7f1d440c3f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1d440ace60 tx=0x7f1d3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d42e2ce8f6797a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7fce2d88d640 1 --2- 172.21.15.46:0/2625001299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c1e20 0x7fce280c8be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce20009e80 tx=0x7fce2002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5998d9cb9da3bb79 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7f1d42ffd640 1 -- 172.21.15.46:0/2377787534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34037070 con 0x7f1d440c46e0 2024-05-09T02:18:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7f1d42ffd640 1 -- 172.21.15.46:0/2377787534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34032440 con 0x7f1d440c46e0 2024-05-09T02:18:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7f1d42ffd640 1 -- 172.21.15.46:0/2377787534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34032810 con 0x7f1d440c46e0 2024-05-09T02:18:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7fce1ffff640 1 -- 172.21.15.46:0/2625001299 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20036070 con 0x7fce280c1e20 2024-05-09T02:18:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7fce1ffff640 1 -- 172.21.15.46:0/2625001299 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce20031600 con 0x7fce280c1e20 2024-05-09T02:18:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7fce1ffff640 1 -- 172.21.15.46:0/2625001299 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce200319d0 con 0x7fce280c1e20 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/2377787534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d440c46e0 msgr2=0x7f1d440c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.171+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/2377787534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d440c46e0 0x7f1d440c3f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1d440ace60 tx=0x7f1d3402a140 comp rx=0 tx=0).stop 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/2377787534 shutdown_connections 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/2377787534 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d44074020 0x7f1d44155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/2377787534 >> v2:172.21.15.107:3300/0 conn(0x7f1d4414f7b0 0x7f1d44073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/2377787534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d440c46e0 0x7f1d440c3f60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/2377787534 >> 172.21.15.46:0/2377787534 conn(0x7f1d440aba90 msgr2=0x7f1d440abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2625001299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c1e20 msgr2=0x7fce280c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2625001299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c1e20 0x7fce280c8be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce20009e80 tx=0x7fce2002a6c0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/2377787534 shutdown_connections 2024-05-09T02:18:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2625001299 shutdown_connections 2024-05-09T02:18:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2625001299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c1e20 0x7fce280c8be0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2625001299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c8410 0x7fce281584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/2377787534 wait complete. 2024-05-09T02:18:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2625001299 >> 172.21.15.46:0/2625001299 conn(0x7fce28068e00 msgr2=0x7fce280c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2625001299 shutdown_connections 2024-05-09T02:18:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.172+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2625001299 wait complete. 2024-05-09T02:18:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.173+0000 7f1d4aa0c640 1 Processor -- start 2024-05-09T02:18:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.173+0000 7fce2f2f0640 1 Processor -- start 2024-05-09T02:18:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.174+0000 7fce2f2f0640 1 -- start start 2024-05-09T02:18:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.174+0000 7f1d4aa0c640 1 -- start start 2024-05-09T02:18:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2f2f0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c1e20 0x7fce2813aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2f2f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 0x7fce281f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d4aa0c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 0x7f1d4414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2f2f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce28140d40 0x7fce280c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2f2f0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce280c9120 con 0x7fce280c8410 2024-05-09T02:18:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d4aa0c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d440c46e0 0x7f1d441536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d4aa0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d4414f7b0 0x7f1d44147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2f2f0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fce280c7ef0 con 0x7fce28140d40 2024-05-09T02:18:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2f2f0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce280c92a0 con 0x7fce280c1e20 2024-05-09T02:18:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d4aa0c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4414fbc0 con 0x7f1d44074020 2024-05-09T02:18:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d4aa0c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d44071980 con 0x7f1d4414f7b0 2024-05-09T02:18:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d4aa0c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1d44156130 con 0x7f1d440c46e0 2024-05-09T02:18:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 0x7fce281f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 0x7fce281f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59738/0 (socket says 172.21.15.46:59738) 2024-05-09T02:18:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 -- 172.21.15.46:0/2156156260 learned_addr learned my addr 172.21.15.46:0/2156156260 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 0x7f1d4414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d440c46e0 0x7f1d441536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 0x7f1d4414e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59744/0 (socket says 172.21.15.46:59744) 2024-05-09T02:18:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 -- 172.21.15.46:0/1014874062 learned_addr learned my addr 172.21.15.46:0/1014874062 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2d08c640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c1e20 0x7fce2813aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2d88d640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce28140d40 0x7fce280c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d48fa9640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d4414f7b0 0x7f1d44147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 -- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c1e20 msgr2=0x7fce2813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c1e20 0x7fce2813aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 -- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce28140d40 msgr2=0x7fce280c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce28140d40 0x7fce280c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7fce2c88b640 1 -- 172.21.15.46:0/2156156260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce281e1090 con 0x7fce280c8410 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 -- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d440c46e0 msgr2=0x7f1d441536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d440c46e0 0x7f1d441536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 -- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d4414f7b0 msgr2=0x7f1d44147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d4414f7b0 0x7f1d44147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.175+0000 7f1d43fff640 1 -- 172.21.15.46:0/1014874062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d441ec2f0 con 0x7f1d44074020 2024-05-09T02:18:47.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7fce2c88b640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 0x7fce281f1670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce1800e870 tx=0x7fce1800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:47.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7f1d43fff640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 0x7f1d4414e290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d34000c00 tx=0x7f1d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18017070 con 0x7fce280c8410 2024-05-09T02:18:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1800c940 con 0x7fce280c8410 2024-05-09T02:18:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1800cd30 con 0x7fce280c8410 2024-05-09T02:18:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce280c5200 con 0x7fce280c8410 2024-05-09T02:18:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34037040 con 0x7f1d44074020 2024-05-09T02:18:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3403ba00 con 0x7f1d44074020 2024-05-09T02:18:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d441ec5d0 con 0x7f1d44074020 2024-05-09T02:18:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d44154ea0 con 0x7f1d44074020 2024-05-09T02:18:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce280c4f20 con 0x7fce280c8410 2024-05-09T02:18:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.176+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3403bdf0 con 0x7f1d44074020 2024-05-09T02:18:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.177+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce281e3240 con 0x7fce280c8410 2024-05-09T02:18:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.177+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4406a330 con 0x7f1d44074020 2024-05-09T02:18:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.179+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce1801a070 con 0x7fce280c8410 2024-05-09T02:18:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.179+0000 7fce1dffb640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fce0c076300 0x7fce0c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.179+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d340304c0 con 0x7f1d44074020 2024-05-09T02:18:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.179+0000 7f1d40ff9640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1d30076350 0x7f1d30078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.179+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fce18097f80 con 0x7fce280c8410 2024-05-09T02:18:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.179+0000 7fce2d08c640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fce0c076300 0x7fce0c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.180+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1d340bc0f0 con 0x7f1d44074020 2024-05-09T02:18:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.180+0000 7f1d437fe640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1d30076350 0x7f1d30078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.180+0000 7fce2d08c640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fce0c076300 0x7fce0c078810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce280b25f0 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.180+0000 7f1d437fe640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1d30076350 0x7f1d30078860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d441534e0 tx=0x7f1d38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.183+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce18060f40 con 0x7fce280c8410 2024-05-09T02:18:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.188+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1d34085240 con 0x7f1d44074020 2024-05-09T02:18:47.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.385+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d440c90b0 con 0x7f1d44074020 2024-05-09T02:18:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.387+0000 7f1d40ff9640 1 -- 172.21.15.46:0/1014874062 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20307 (secure 0 0 0) 0x7f1d34089540 con 0x7f1d44074020 2024-05-09T02:18:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:47.390 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:18:24.190390+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1d30076350 msgr2=0x7f1d30078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1d30076350 0x7f1d30078860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d441534e0 tx=0x7f1d38008040 comp rx=0 tx=0).stop 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 msgr2=0x7f1d4414e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 0x7f1d4414e290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d34000c00 tx=0x7f1d340046c0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 shutdown_connections 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1d30076350 0x7f1d30078860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d4414f7b0 0x7f1d44147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1d440c46e0 0x7f1d441536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 --2- 172.21.15.46:0/1014874062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d44074020 0x7f1d4414e290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 >> 172.21.15.46:0/1014874062 conn(0x7f1d440aba90 msgr2=0x7f1d440c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 shutdown_connections 2024-05-09T02:18:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.389+0000 7f1d4aa0c640 1 -- 172.21.15.46:0/1014874062 wait complete. 2024-05-09T02:18:47.403 DEBUG:tasks.mds_thrash:Yielding 2024-05-09T02:18:47.403 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T02:18:47.416 INFO:tasks.workunit:Pulling workunits from ref c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:18:47.417 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T02:18:47.417 INFO:tasks.workunit:timeout=3h 2024-05-09T02:18:47.417 INFO:tasks.workunit:cleanup=True 2024-05-09T02:18:47.417 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T02:18:47.417 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2024-05-09T02:18:47.417 INFO:tasks.mds_thrash.fs.[b]:waiting for 52 secs before thrashing 2024-05-09T02:18:47.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.420+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce2806a330 con 0x7fce280c8410 2024-05-09T02:18:47.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.420+0000 7fce1dffb640 1 -- 172.21.15.46:0/2156156260 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7fce18065240 con 0x7fce280c8410 2024-05-09T02:18:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:47.423 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:47.423 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:47.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.422+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fce0c076300 msgr2=0x7fce0c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.422+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fce0c076300 0x7fce0c078810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce280b25f0 tx=0x7fce24009040 comp rx=0 tx=0).stop 2024-05-09T02:18:47.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.422+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 msgr2=0x7fce281f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.422+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 0x7fce281f1670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce1800e870 tx=0x7fce1800ed30 comp rx=0 tx=0).stop 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.422+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 shutdown_connections 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fce0c076300 0x7fce0c078810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce28140d40 0x7fce280c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce280c8410 0x7fce281f1670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 --2- 172.21.15.46:0/2156156260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce280c1e20 0x7fce2813aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 >> 172.21.15.46:0/2156156260 conn(0x7fce28068e00 msgr2=0x7fce28156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 shutdown_connections 2024-05-09T02:18:47.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:47.423+0000 7fce2f2f0640 1 -- 172.21.15.46:0/2156156260 wait complete. 2024-05-09T02:18:47.436 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:18:49.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:49.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.564+0000 7fd7d173f640 1 Processor -- start 2024-05-09T02:18:49.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.564+0000 7fd7d173f640 1 -- start start 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7d173f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7cc154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7d173f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7cc0c92f0 0x7fd7cc0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7d173f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc158580 con 0x7fd7cc0c9c40 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7d173f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc0c2690 con 0x7fd7cc0c92f0 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7d173f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc158860 con 0x7fd7cc0c6d70 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7cb7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd7cc0c9c40 0x7fd7cc0c7810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35108/0 (socket says 172.21.15.46:35108) 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7cb7fe640 1 -- 172.21.15.46:0/1842749204 learned_addr learned my addr 172.21.15.46:0/1842749204 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7ca7fc640 1 --2- 172.21.15.46:0/1842749204 >> v2:172.21.15.107:3300/0 conn(0x7fd7cc0c92f0 0x7fd7cc0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7caffd640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7cc154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21016576 0 0) 0x7fd7cc158580 con 0x7fd7cc0c9c40 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b4003520 con 0x7fd7cc0c9c40 2024-05-09T02:18:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.566+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4022089388 0 0) 0x7fd7b4003520 con 0x7fd7cc0c9c40 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 msgr2=0x7fd7cc154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7cc154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 >> v2:172.21.15.107:3300/0 conn(0x7fd7cc0c92f0 msgr2=0x7fd7cc0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 --2- 172.21.15.46:0/1842749204 >> v2:172.21.15.107:3300/0 conn(0x7fd7cc0c92f0 0x7fd7cc0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0c2040 con 0x7fd7cc0c9c40 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7fd7c4001a70 con 0x7fd7cc0c9c40 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 >> v1:172.21.15.46:6789/0 conn(0x7fd7cc0c9c40 legacy=0x7fd7cc0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7b4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7b4003fd0 0x7fd7b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7b4004d40 0x7fd7b4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0c2690 con 0x7fd7b4003fd0 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc158860 con 0x7fd7b4004d40 2024-05-09T02:18:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b400bc00 con 0x7fd7cc0c6d70 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7ca7fc640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7b4003fd0 0x7fd7b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7caffd640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7b4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7cb7fe640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7b4004d40 0x7fd7b4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7ca7fc640 1 -- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 msgr2=0x7fd7b4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7ca7fc640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7b4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7ca7fc640 1 -- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7b4004d40 msgr2=0x7fd7b4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7ca7fc640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7b4004d40 0x7fd7b4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7ca7fc640 1 -- 172.21.15.46:0/1842749204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b4003520 con 0x7fd7b4003fd0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.567+0000 7fd7caffd640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7cc0c6d70 0x7fd7b4003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.568+0000 7fd7ca7fc640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7b4003fd0 0x7fd7b4004800 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009a90 tx=0x7fd7b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b024a795ac70729 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.568+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0036070 con 0x7fd7b4003fd0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.568+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c0031400 con 0x7fd7b4003fd0 2024-05-09T02:18:49.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.568+0000 7fd7c9ffb640 1 -- 172.21.15.46:0/1842749204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0009690 con 0x7fd7b4003fd0 2024-05-09T02:18:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7d173f640 1 -- 172.21.15.46:0/1842749204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7b4003fd0 msgr2=0x7fd7b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:49.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7d173f640 1 --2- 172.21.15.46:0/1842749204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7b4003fd0 0x7fd7b4004800 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009a90 tx=0x7fd7b4005830 comp rx=0 tx=0).stop 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7cb7fe640 1 -- 172.21.15.46:0/1842749204 reap_dead start 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7d173f640 1 -- 172.21.15.46:0/1842749204 shutdown_connections 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7d173f640 1 -- 172.21.15.46:0/1842749204 >> 172.21.15.46:0/1842749204 conn(0x7fd7cc06e8f0 msgr2=0x7fd7cc06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7d173f640 1 -- 172.21.15.46:0/1842749204 shutdown_connections 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.569+0000 7fd7d173f640 1 -- 172.21.15.46:0/1842749204 wait complete. 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.571+0000 7fd7d173f640 1 Processor -- start 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.571+0000 7fd7d173f640 1 -- start start 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7d173f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7b4003fd0 0x7fd7cc1e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7d173f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7cc14a610 0x7fd7cc0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7d173f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 0x7fd7cc147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7d173f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc155150 con 0x7fd7cc1477d0 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7d173f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc154fd0 con 0x7fd7cc14a610 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7d173f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc1552d0 con 0x7fd7b4003fd0 2024-05-09T02:18:49.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 0x7fd7cc147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 0x7fd7cc147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59764/0 (socket says 172.21.15.46:59764) 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 -- 172.21.15.46:0/3080751063 learned_addr learned my addr 172.21.15.46:0/3080751063 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7ca7fc640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7cc14a610 0x7fd7cc0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7caffd640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7b4003fd0 0x7fd7cc1e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 -- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7b4003fd0 msgr2=0x7fd7cc1e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7b4003fd0 0x7fd7cc1e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 -- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7cc14a610 msgr2=0x7fd7cc0caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7cc14a610 0x7fd7cc0caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.572+0000 7fd7cb7fe640 1 -- 172.21.15.46:0/3080751063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0cb9c0 con 0x7fd7cc1477d0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.573+0000 7fd7cb7fe640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 0x7fd7cc147be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0c4490 tx=0x7fd7c40079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.573+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4017020 con 0x7fd7cc1477d0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.573+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c400aa60 con 0x7fd7cc1477d0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.573+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc148ef0 con 0x7fd7cc1477d0 2024-05-09T02:18:49.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.573+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc009690 con 0x7fd7cc1477d0 2024-05-09T02:18:49.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.573+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc1494b0 con 0x7fd7cc1477d0 2024-05-09T02:18:49.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.574+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc06a330 con 0x7fd7cc1477d0 2024-05-09T02:18:49.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.575+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7c401a020 con 0x7fd7cc1477d0 2024-05-09T02:18:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.575+0000 7fd7b37fe640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd7b8076300 0x7fd7b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.575+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd7c4097cd0 con 0x7fd7cc1477d0 2024-05-09T02:18:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.575+0000 7fd7caffd640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd7b8076300 0x7fd7b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.576+0000 7fd7caffd640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd7b8076300 0x7fd7b8078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0c5520 tx=0x7fd7bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:49.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.580+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7c4021020 con 0x7fd7cc1477d0 2024-05-09T02:18:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.812+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7cc1485d0 con 0x7fd7cc1477d0 2024-05-09T02:18:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.813+0000 7fd7b37fe640 1 -- 172.21.15.46:0/3080751063 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7fd7c4061390 con 0x7fd7cc1477d0 2024-05-09T02:18:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:49.815 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd7b8076300 msgr2=0x7fd7b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd7b8076300 0x7fd7b8078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0c5520 tx=0x7fd7bc009190 comp rx=0 tx=0).stop 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 msgr2=0x7fd7cc147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 0x7fd7cc147be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0c4490 tx=0x7fd7c40079d0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 shutdown_connections 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd7b8076300 0x7fd7b8078810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7cc1477d0 0x7fd7cc147be0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7cc14a610 0x7fd7cc0caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 --2- 172.21.15.46:0/3080751063 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7b4003fd0 0x7fd7cc1e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 >> 172.21.15.46:0/3080751063 conn(0x7fd7cc06e8f0 msgr2=0x7fd7cc0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 shutdown_connections 2024-05-09T02:18:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:49.815+0000 7fd7d173f640 1 -- 172.21.15.46:0/3080751063 wait complete. 2024-05-09T02:18:49.829 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:18:51.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:51.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.956+0000 7fd84f0c6640 1 Processor -- start 2024-05-09T02:18:51.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.956+0000 7fd84f0c6640 1 -- start start 2024-05-09T02:18:51.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd84f0c6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd84815bc50 0x7fd848154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd84f0c6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8480c44f0 0x7fd8480cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd84f0c6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8480cb0b0 0x7fd8480c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd84f0c6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd848158990 con 0x7fd8480c44f0 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd84f0c6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd8481586b0 con 0x7fd84815bc50 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd84f0c6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd84815b170 con 0x7fd8480cb0b0 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd83ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8480c44f0 0x7fd8480cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd83ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8480c44f0 0x7fd8480cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59774/0 (socket says 172.21.15.46:59774) 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.957+0000 7fd83ffff640 1 -- 172.21.15.46:0/4154491879 learned_addr learned my addr 172.21.15.46:0/4154491879 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd84d663640 1 --2- 172.21.15.46:0/4154491879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8480cb0b0 0x7fd8480c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd84ce62640 1 --2- 172.21.15.46:0/4154491879 >> v2:172.21.15.107:3300/0 conn(0x7fd84815bc50 0x7fd848154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd83ffff640 1 -- 172.21.15.46:0/4154491879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8480cb0b0 msgr2=0x7fd8480c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd83ffff640 1 --2- 172.21.15.46:0/4154491879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8480cb0b0 0x7fd8480c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd83ffff640 1 -- 172.21.15.46:0/4154491879 >> v2:172.21.15.107:3300/0 conn(0x7fd84815bc50 msgr2=0x7fd848154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd83ffff640 1 --2- 172.21.15.46:0/4154491879 >> v2:172.21.15.107:3300/0 conn(0x7fd84815bc50 0x7fd848154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.958+0000 7fd83ffff640 1 -- 172.21.15.46:0/4154491879 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84815b450 con 0x7fd8480c44f0 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.959+0000 7fd83ffff640 1 --2- 172.21.15.46:0/4154491879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8480cab70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8481588c0 tx=0x7fd83802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f611ebe0cce62095 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.959+0000 7fd83f7fe640 1 -- 172.21.15.46:0/4154491879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838037070 con 0x7fd8480c44f0 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.959+0000 7fd83f7fe640 1 -- 172.21.15.46:0/4154491879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd838032440 con 0x7fd8480c44f0 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.959+0000 7fd83f7fe640 1 -- 172.21.15.46:0/4154491879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838032810 con 0x7fd8480c44f0 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 -- 172.21.15.46:0/4154491879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 msgr2=0x7fd8480cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/4154491879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8480cab70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8481588c0 tx=0x7fd83802a1c0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 -- 172.21.15.46:0/4154491879 shutdown_connections 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/4154491879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd8480cb0b0 0x7fd8480c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/4154491879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8480cab70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/4154491879 >> v2:172.21.15.107:3300/0 conn(0x7fd84815bc50 0x7fd848154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 -- 172.21.15.46:0/4154491879 >> 172.21.15.46:0/4154491879 conn(0x7fd8480aca30 msgr2=0x7fd8480ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:51.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 -- 172.21.15.46:0/4154491879 shutdown_connections 2024-05-09T02:18:51.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.960+0000 7fd84f0c6640 1 -- 172.21.15.46:0/4154491879 wait complete. 2024-05-09T02:18:51.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.961+0000 7fd84f0c6640 1 Processor -- start 2024-05-09T02:18:51.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.961+0000 7fd84f0c6640 1 -- start start 2024-05-09T02:18:51.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84f0c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8481ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84f0c6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8480cb0b0 0x7fd84815a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84f0c6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd84815bc50 0x7fd848146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84f0c6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd848158360 con 0x7fd8480c44f0 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84f0c6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd8480aa6f0 con 0x7fd8480cb0b0 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84f0c6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd8480c5130 con 0x7fd84815bc50 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8481ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8481ee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59778/0 (socket says 172.21.15.46:59778) 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 -- 172.21.15.46:0/975739626 learned_addr learned my addr 172.21.15.46:0/975739626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84d663640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd84815bc50 0x7fd848146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd83ffff640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8480cb0b0 0x7fd84815a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 -- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd84815bc50 msgr2=0x7fd848146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd84815bc50 0x7fd848146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 -- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8480cb0b0 msgr2=0x7fd84815a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:51.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8480cb0b0 0x7fd84815a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 -- 172.21.15.46:0/975739626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84814a780 con 0x7fd8480c44f0 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd83ffff640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8480cb0b0 0x7fd84815a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.963+0000 7fd84ce62640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8481ee2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd84400efc0 tx=0x7fd84400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.964+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844018020 con 0x7fd8480c44f0 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.964+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd844014480 con 0x7fd8480c44f0 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.964+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84814dce0 con 0x7fd8480c44f0 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.964+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844014850 con 0x7fd8480c44f0 2024-05-09T02:18:51.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.964+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd848150170 con 0x7fd8480c44f0 2024-05-09T02:18:51.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.965+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd84814ff60 con 0x7fd8480c44f0 2024-05-09T02:18:51.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.966+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd844005d10 con 0x7fd8480c44f0 2024-05-09T02:18:51.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.966+0000 7fd83d7fa640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd8340762d0 0x7fd8340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:51.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.966+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd844098da0 con 0x7fd8480c44f0 2024-05-09T02:18:51.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.966+0000 7fd83ffff640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd8340762d0 0x7fd8340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:51.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.967+0000 7fd83ffff640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd8340762d0 0x7fd8340787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd838034000 tx=0x7fd83802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:51.970+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd844022030 con 0x7fd8480c44f0 2024-05-09T02:18:52.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.198+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd84806a330 con 0x7fd8480c44f0 2024-05-09T02:18:52.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.199+0000 7fd83d7fa640 1 -- 172.21.15.46:0/975739626 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7fd844010040 con 0x7fd8480c44f0 2024-05-09T02:18:52.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:52.202 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:52.202 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd8340762d0 msgr2=0x7fd8340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd8340762d0 0x7fd8340787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd838034000 tx=0x7fd83802e000 comp rx=0 tx=0).stop 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 msgr2=0x7fd8481ee2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8481ee2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd84400efc0 tx=0x7fd84400c490 comp rx=0 tx=0).stop 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 shutdown_connections 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd8340762d0 0x7fd8340787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:52.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd84815bc50 0x7fd848146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:52.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8480cb0b0 0x7fd84815a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:52.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 --2- 172.21.15.46:0/975739626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c44f0 0x7fd8481ee2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:52.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 >> 172.21.15.46:0/975739626 conn(0x7fd8480aca30 msgr2=0x7fd848157150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:52.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 shutdown_connections 2024-05-09T02:18:52.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:52.201+0000 7fd84f0c6640 1 -- 172.21.15.46:0/975739626 wait complete. 2024-05-09T02:18:52.215 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:18:54.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:54.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.343+0000 7f801173f640 1 Processor -- start 2024-05-09T02:18:54.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.343+0000 7f801173f640 1 -- start start 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f801173f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 0x7f800c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f801173f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f800c157c20 0x7f800c073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f801173f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c158030 con 0x7f800c071580 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f801173f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f800c15b190 con 0x7f800c157c20 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f801173f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f800c15b470 con 0x7f800c071030 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f80027fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f800c071580 0x7f800c15b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35114/0 (socket says 172.21.15.46:35114) 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f80027fc640 1 -- 172.21.15.46:0/3502818918 learned_addr learned my addr 172.21.15.46:0/3502818918 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:18:54.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f800b7fe640 1 --2- 172.21.15.46:0/3502818918 >> v2:172.21.15.107:3300/0 conn(0x7f800c157c20 0x7f800c073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f800affd640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 0x7f800c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.344+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472875016 0 0) 0x7f7ff4001110 con 0x7f800c071580 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff8003520 con 0x7f800c071580 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 727578029 0 0) 0x7f7ff8003520 con 0x7f800c071580 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 msgr2=0x7f800c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 0x7f800c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 >> v2:172.21.15.107:3300/0 conn(0x7f800c157c20 msgr2=0x7f800c073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 --2- 172.21.15.46:0/3502818918 >> v2:172.21.15.107:3300/0 conn(0x7f800c157c20 0x7f800c073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c070e00 con 0x7f800c071580 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f7ff40018c0 con 0x7f800c071580 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 >> v1:172.21.15.46:6789/0 conn(0x7f800c071580 legacy=0x7f800c15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 0x7f7ff8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff8003fd0 0x7f7ff8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ff8004d40 0x7f7ff8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f800c15b190 con 0x7f7ff8003fd0 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f800c15b470 con 0x7f7ff8004d40 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff800bc00 con 0x7f800c071030 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f80027fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff8003fd0 0x7f7ff8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800affd640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 0x7f7ff8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f800b7fe640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ff8004d40 0x7f7ff8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f80027fc640 1 -- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 msgr2=0x7f7ff8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f80027fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f800c071030 0x7f7ff8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f80027fc640 1 -- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ff8004d40 msgr2=0x7f7ff8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f80027fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ff8004d40 0x7f7ff8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.345+0000 7f80027fc640 1 -- 172.21.15.46:0/3502818918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff8003520 con 0x7f7ff8003fd0 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.346+0000 7f80027fc640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff8003fd0 0x7f7ff8004800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c3b0 tx=0x7f7ff8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1676d2e04c422f17 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.346+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400c0e0 con 0x7f7ff8003fd0 2024-05-09T02:18:54.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.346+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff402c040 con 0x7f7ff8003fd0 2024-05-09T02:18:54.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.346+0000 7f800a7fc640 1 -- 172.21.15.46:0/3502818918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4005d30 con 0x7f7ff8003fd0 2024-05-09T02:18:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f801173f640 1 -- 172.21.15.46:0/3502818918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff8003fd0 msgr2=0x7f7ff8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f801173f640 1 --2- 172.21.15.46:0/3502818918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff8003fd0 0x7f7ff8004800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c3b0 tx=0x7f7ff8005830 comp rx=0 tx=0).stop 2024-05-09T02:18:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f800b7fe640 1 -- 172.21.15.46:0/3502818918 reap_dead start 2024-05-09T02:18:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f801173f640 1 -- 172.21.15.46:0/3502818918 shutdown_connections 2024-05-09T02:18:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f801173f640 1 -- 172.21.15.46:0/3502818918 >> 172.21.15.46:0/3502818918 conn(0x7f800c0aba90 msgr2=0x7f800c0abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f801173f640 1 -- 172.21.15.46:0/3502818918 shutdown_connections 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.347+0000 7f801173f640 1 -- 172.21.15.46:0/3502818918 wait complete. 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.349+0000 7f801173f640 1 Processor -- start 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.349+0000 7f801173f640 1 -- start start 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f801173f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ff8003fd0 0x7f800c152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f801173f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f800c1e3ec0 0x7f800c1e2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f801173f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 0x7f800c1f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f801173f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f800c0c53e0 con 0x7f800c1e2d40 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f801173f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f800c0c5100 con 0x7f800c1e3ec0 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f801173f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f800c070a90 con 0x7f7ff8003fd0 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 0x7f800c1f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 0x7f800c1f0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59798/0 (socket says 172.21.15.46:59798) 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f800b7fe640 1 -- 172.21.15.46:0/2322299763 learned_addr learned my addr 172.21.15.46:0/2322299763 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f800affd640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ff8003fd0 0x7f800c152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.350+0000 7f80027fc640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f800c1e3ec0 0x7f800c1e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f800b7fe640 1 -- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ff8003fd0 msgr2=0x7f800c152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f800b7fe640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ff8003fd0 0x7f800c152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f800b7fe640 1 -- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f800c1e3ec0 msgr2=0x7f800c1e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f800b7fe640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f800c1e3ec0 0x7f800c1e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f800b7fe640 1 -- 172.21.15.46:0/2322299763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c152df0 con 0x7f800c1e2d40 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f800b7fe640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 0x7f800c1f0e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f800c0c42b0 tx=0x7f800400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004003e60 con 0x7f800c1e2d40 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800401c070 con 0x7f800c1e2d40 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c0acb80 con 0x7f800c1e2d40 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800400fb10 con 0x7f800c1e2d40 2024-05-09T02:18:54.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.351+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c154200 con 0x7f800c1e2d40 2024-05-09T02:18:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.352+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c06a330 con 0x7f800c1e2d40 2024-05-09T02:18:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.353+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f800400fcb0 con 0x7f800c1e2d40 2024-05-09T02:18:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.354+0000 7f8003fff640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fec076300 0x7f7fec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.354+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8004098160 con 0x7f800c1e2d40 2024-05-09T02:18:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.354+0000 7f800affd640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fec076300 0x7f7fec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:54.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.354+0000 7f800affd640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fec076300 0x7f7fec078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f800c0cad40 tx=0x7f7ffc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:54.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.358+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8004010040 con 0x7f800c1e2d40 2024-05-09T02:18:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.586+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f800c06fb80 con 0x7f800c1e2d40 2024-05-09T02:18:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.586+0000 7f8003fff640 1 -- 172.21.15.46:0/2322299763 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f8004061710 con 0x7f800c1e2d40 2024-05-09T02:18:54.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:54.589 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fec076300 msgr2=0x7f7fec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:54.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fec076300 0x7f7fec078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f800c0cad40 tx=0x7f7ffc009190 comp rx=0 tx=0).stop 2024-05-09T02:18:54.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 msgr2=0x7f800c1f0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:54.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 0x7f800c1f0e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f800c0c42b0 tx=0x7f800400f1b0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 shutdown_connections 2024-05-09T02:18:54.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7fec076300 0x7f7fec078810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f800c1e2d40 0x7f800c1f0e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f800c1e3ec0 0x7f800c1e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 --2- 172.21.15.46:0/2322299763 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ff8003fd0 0x7f800c152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 >> 172.21.15.46:0/2322299763 conn(0x7f800c0aba90 msgr2=0x7f800c0c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.588+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 shutdown_connections 2024-05-09T02:18:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:54.589+0000 7f801173f640 1 -- 172.21.15.46:0/2322299763 wait complete. 2024-05-09T02:18:54.602 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:18:56.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.728+0000 7facdd868640 1 Processor -- start 2024-05-09T02:18:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.728+0000 7facdd868640 1 -- start start 2024-05-09T02:18:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facdd868640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7facd80b17d0 0x7facd8154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facdd868640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7facd8157990 0x7facd8157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facdd868640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd80b1e60 con 0x7facd80c4800 2024-05-09T02:18:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facdd868640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7facd815b950 con 0x7facd8157990 2024-05-09T02:18:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facdd868640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7facd815bde0 con 0x7facd80b17d0 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7facd8157990 0x7facd8157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7facd8157990 0x7facd8157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39268/0 (socket says 172.21.15.46:39268) 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 -- 172.21.15.46:0/1215524613 learned_addr learned my addr 172.21.15.46:0/1215524613 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd67fc640 1 --2- 172.21.15.46:0/1215524613 >> v2:172.21.15.107:3300/0 conn(0x7facd80b17d0 0x7facd8154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 -- 172.21.15.46:0/1215524613 >> v2:172.21.15.107:3300/0 conn(0x7facd80b17d0 msgr2=0x7facd8154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 --2- 172.21.15.46:0/1215524613 >> v2:172.21.15.107:3300/0 conn(0x7facd80b17d0 0x7facd8154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 -- 172.21.15.46:0/1215524613 >> v1:172.21.15.107:6789/0 conn(0x7facd80c4800 legacy=0x7facd80c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.730+0000 7facd77fe640 1 -- 172.21.15.46:0/1215524613 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd815b020 con 0x7facd8157990 2024-05-09T02:18:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.731+0000 7facd77fe640 1 --2- 172.21.15.46:0/1215524613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd8157990 0x7facd8157da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facd80b24b0 tx=0x7facd002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0708f751a315c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.731+0000 7facd5ffb640 1 -- 172.21.15.46:0/1215524613 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0037070 con 0x7facd8157990 2024-05-09T02:18:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.731+0000 7facd5ffb640 1 -- 172.21.15.46:0/1215524613 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd0032440 con 0x7facd8157990 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.731+0000 7facd5ffb640 1 -- 172.21.15.46:0/1215524613 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0032810 con 0x7facd8157990 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 -- 172.21.15.46:0/1215524613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd8157990 msgr2=0x7facd8157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 --2- 172.21.15.46:0/1215524613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd8157990 0x7facd8157da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facd80b24b0 tx=0x7facd002a150 comp rx=0 tx=0).stop 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 -- 172.21.15.46:0/1215524613 shutdown_connections 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 --2- 172.21.15.46:0/1215524613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd8157990 0x7facd8157da0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 --2- 172.21.15.46:0/1215524613 >> v2:172.21.15.107:3300/0 conn(0x7facd80b17d0 0x7facd8154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 -- 172.21.15.46:0/1215524613 >> 172.21.15.46:0/1215524613 conn(0x7facd8068ec0 msgr2=0x7facd80cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 -- 172.21.15.46:0/1215524613 shutdown_connections 2024-05-09T02:18:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.732+0000 7facdd868640 1 -- 172.21.15.46:0/1215524613 wait complete. 2024-05-09T02:18:56.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.734+0000 7facdd868640 1 Processor -- start 2024-05-09T02:18:56.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.734+0000 7facdd868640 1 -- start start 2024-05-09T02:18:56.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facdd868640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 0x7facd8159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:56.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facdd868640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facd80c4800 0x7facd81f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:56.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facdd868640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facd8157990 0x7facd8149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:56.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facdd868640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7facd806ee40 con 0x7facd80b17d0 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facdd868640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7facd815b5e0 con 0x7facd80c4800 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facdd868640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7facd80b2120 con 0x7facd8157990 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facd6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 0x7facd8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facd6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 0x7facd8159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39274/0 (socket says 172.21.15.46:39274) 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.735+0000 7facd6ffd640 1 -- 172.21.15.46:0/3382377183 learned_addr learned my addr 172.21.15.46:0/3382377183 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd67fc640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facd80c4800 0x7facd81f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd77fe640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facd8157990 0x7facd8149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd6ffd640 1 -- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facd8157990 msgr2=0x7facd8149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd6ffd640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facd8157990 0x7facd8149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd6ffd640 1 -- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facd80c4800 msgr2=0x7facd81f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd6ffd640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facd80c4800 0x7facd81f13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd6ffd640 1 -- 172.21.15.46:0/3382377183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd80cb490 con 0x7facd80b17d0 2024-05-09T02:18:56.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facd6ffd640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 0x7facd8159860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7facc800c6f0 tx=0x7facc800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:56.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8003970 con 0x7facd80b17d0 2024-05-09T02:18:56.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc8003b10 con 0x7facd80b17d0 2024-05-09T02:18:56.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd815aad0 con 0x7facd80b17d0 2024-05-09T02:18:56.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc800a850 con 0x7facd80b17d0 2024-05-09T02:18:56.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.736+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81f2030 con 0x7facd80b17d0 2024-05-09T02:18:56.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.737+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd80c7690 con 0x7facd80b17d0 2024-05-09T02:18:56.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.738+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7facc800a9f0 con 0x7facd80b17d0 2024-05-09T02:18:56.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.739+0000 7faccffff640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7facb80762d0 0x7facb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:56.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.739+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7facc80976c0 con 0x7facd80b17d0 2024-05-09T02:18:56.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.739+0000 7facd67fc640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7facb80762d0 0x7facb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:56.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.739+0000 7facd67fc640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7facb80762d0 0x7facb80787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facd81e50e0 tx=0x7facc0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:56.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.743+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7facc8060630 con 0x7facd80b17d0 2024-05-09T02:18:56.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.972+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facd806a330 con 0x7facd80b17d0 2024-05-09T02:18:56.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.972+0000 7faccffff640 1 -- 172.21.15.46:0/3382377183 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7facc8064930 con 0x7facd80b17d0 2024-05-09T02:18:56.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:56.975 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:56.976 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7facb80762d0 msgr2=0x7facb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7facb80762d0 0x7facb80787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facd81e50e0 tx=0x7facc0009190 comp rx=0 tx=0).stop 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 msgr2=0x7facd8159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 0x7facd8159860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7facc800c6f0 tx=0x7facc800cbb0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 shutdown_connections 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7facb80762d0 0x7facb80787e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facd8157990 0x7facd8149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facd80c4800 0x7facd81f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 --2- 172.21.15.46:0/3382377183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd80b17d0 0x7facd8159860 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 >> 172.21.15.46:0/3382377183 conn(0x7facd8068ec0 msgr2=0x7facd80c2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 shutdown_connections 2024-05-09T02:18:56.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:56.975+0000 7facdd868640 1 -- 172.21.15.46:0/3382377183 wait complete. 2024-05-09T02:18:56.989 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:18:58.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:18:59.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.117+0000 7f686f029640 1 Processor -- start 2024-05-09T02:18:59.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.117+0000 7f686f029640 1 -- start start 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f686f029640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6868154fd0 0x7f68680c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f686f029640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68681553e0 con 0x7f68680c6d70 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f686f029640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6868158580 con 0x7f686815af70 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f686f029640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f68680c2690 con 0x7f6868154fd0 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f6867fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6868154fd0 0x7f68680c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f6867fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6868154fd0 0x7f68680c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39280/0 (socket says 172.21.15.46:39280) 2024-05-09T02:18:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f686cdc5640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f68680c6d70 0x7f68680c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47664/0 (socket says 172.21.15.46:47664) 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f6867fff640 1 -- 172.21.15.46:0/4029343217 learned_addr learned my addr 172.21.15.46:0/4029343217 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f6867fff640 1 -- 172.21.15.46:0/4029343217 >> v1:172.21.15.107:6789/0 conn(0x7f686815af70 legacy=0x7f686815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f6867fff640 1 -- 172.21.15.46:0/4029343217 >> v1:172.21.15.46:6789/0 conn(0x7f68680c6d70 legacy=0x7f68680c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.119+0000 7f6867fff640 1 -- 172.21.15.46:0/4029343217 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6868158860 con 0x7f6868154fd0 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.120+0000 7f6867fff640 1 --2- 172.21.15.46:0/4029343217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6868154fd0 0x7f68680c9a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6858009e50 tx=0x7f685802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fcdf4d5f610670 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.120+0000 7f68677fe640 1 -- 172.21.15.46:0/4029343217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858036070 con 0x7f6868154fd0 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.120+0000 7f68677fe640 1 -- 172.21.15.46:0/4029343217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858031600 con 0x7f6868154fd0 2024-05-09T02:18:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.120+0000 7f68677fe640 1 -- 172.21.15.46:0/4029343217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68580319d0 con 0x7f6868154fd0 2024-05-09T02:18:59.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 -- 172.21.15.46:0/4029343217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6868154fd0 msgr2=0x7f68680c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 --2- 172.21.15.46:0/4029343217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6868154fd0 0x7f68680c9a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6858009e50 tx=0x7f685802a5b0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 -- 172.21.15.46:0/4029343217 shutdown_connections 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 --2- 172.21.15.46:0/4029343217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6868154fd0 0x7f68680c9a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 -- 172.21.15.46:0/4029343217 >> 172.21.15.46:0/4029343217 conn(0x7f686806e8f0 msgr2=0x7f686806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 -- 172.21.15.46:0/4029343217 shutdown_connections 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.121+0000 7f686f029640 1 -- 172.21.15.46:0/4029343217 wait complete. 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.123+0000 7f686f029640 1 Processor -- start 2024-05-09T02:18:59.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.123+0000 7f686f029640 1 -- start start 2024-05-09T02:18:59.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686f029640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68680c6d70 0x7f68681ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:59.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686f029640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6868154fd0 0x7f68680c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:59.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686f029640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 0x7f68681f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:59.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686f029640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f68680c9f40 con 0x7f686815af70 2024-05-09T02:18:59.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686f029640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f68680c2320 con 0x7f68680c6d70 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686f029640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f686815ba90 con 0x7f6868154fd0 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686d5c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 0x7f68681f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686d5c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 0x7f68681f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39284/0 (socket says 172.21.15.46:39284) 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.124+0000 7f686d5c6640 1 -- 172.21.15.46:0/3015063058 learned_addr learned my addr 172.21.15.46:0/3015063058 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686cdc5640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68680c6d70 0x7f68681ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f6867fff640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6868154fd0 0x7f68680c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686d5c6640 1 -- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6868154fd0 msgr2=0x7f68680c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686d5c6640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6868154fd0 0x7f68680c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686d5c6640 1 -- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68680c6d70 msgr2=0x7f68681ee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686d5c6640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68680c6d70 0x7f68681ee9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686d5c6640 1 -- 172.21.15.46:0/3015063058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68680cc8e0 con 0x7f686815af70 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686d5c6640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 0x7f68681f1880 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f685000c3f0 tx=0x7f685000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850017070 con 0x7f686815af70 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68500052d0 con 0x7f686815af70 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68680cb3b0 con 0x7f686815af70 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850003810 con 0x7f686815af70 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.125+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681f22e0 con 0x7f686815af70 2024-05-09T02:18:59.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.126+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686806a330 con 0x7f686815af70 2024-05-09T02:18:59.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.127+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f685001a070 con 0x7f686815af70 2024-05-09T02:18:59.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.128+0000 7f68657fa640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6848076300 0x7f6848078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:18:59.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.128+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f6850096c10 con 0x7f686815af70 2024-05-09T02:18:59.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.128+0000 7f686cdc5640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6848076300 0x7f6848078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:18:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.129+0000 7f686cdc5640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6848076300 0x7f6848078810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6860000f60 tx=0x7f6860007e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:18:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.133+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f685005fb80 con 0x7f686815af70 2024-05-09T02:18:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.361+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6868069e80 con 0x7f686815af70 2024-05-09T02:18:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.362+0000 7f68657fa640 1 -- 172.21.15.46:0/3015063058 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f68500681c0 con 0x7f686815af70 2024-05-09T02:18:59.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:18:59.365 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:18:59.365 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:18:59.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.363+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6848076300 msgr2=0x7f6848078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6848076300 0x7f6848078810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6860000f60 tx=0x7f6860007e00 comp rx=0 tx=0).stop 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 msgr2=0x7f68681f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 0x7f68681f1880 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f685000c3f0 tx=0x7f685000c8b0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 shutdown_connections 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6848076300 0x7f6848078810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686815af70 0x7f68681f1880 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6868154fd0 0x7f68680c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 --2- 172.21.15.46:0/3015063058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68680c6d70 0x7f68681ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 >> 172.21.15.46:0/3015063058 conn(0x7f686806e8f0 msgr2=0x7f68680c58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 shutdown_connections 2024-05-09T02:18:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:18:59.364+0000 7f686f029640 1 -- 172.21.15.46:0/3015063058 wait complete. 2024-05-09T02:18:59.378 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:19:01.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:01.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.505+0000 7f7a18b06640 1 Processor -- start 2024-05-09T02:19:01.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.505+0000 7f7a18b06640 1 -- start start 2024-05-09T02:19:01.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a18b06640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a140c96c0 0x7f7a140c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a18b06640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7a1415b3a0 0x7f7a1415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a18b06640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a14158ae0 con 0x7f7a14155160 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a18b06640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f7a14155570 con 0x7f7a1415b3a0 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a18b06640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7a14157ed0 con 0x7f7a140c96c0 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a12d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7a1415b3a0 0x7f7a1415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a1259c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7a14155160 0x7f7a140c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47666/0 (socket says 172.21.15.46:47666) 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.506+0000 7f7a1259c640 1 -- 172.21.15.46:0/1138247312 learned_addr learned my addr 172.21.15.46:0/1138247312 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a0bfff640 1 --2- 172.21.15.46:0/1138247312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a140c96c0 0x7f7a140c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a11d9b640 1 -- 172.21.15.46:0/1138247312 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837182583 0 0) 0x7f7a14158ae0 con 0x7f7a14155160 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a11d9b640 1 -- 172.21.15.46:0/1138247312 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a00003520 con 0x7f7a14155160 2024-05-09T02:19:01.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a12d9d640 1 -- 172.21.15.46:0/1138247312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a140c96c0 msgr2=0x7f7a140c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:01.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a12d9d640 1 --2- 172.21.15.46:0/1138247312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a140c96c0 0x7f7a140c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a12d9d640 1 -- 172.21.15.46:0/1138247312 >> v1:172.21.15.46:6789/0 conn(0x7f7a14155160 legacy=0x7f7a140c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:01.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a12d9d640 1 -- 172.21.15.46:0/1138247312 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a141581b0 con 0x7f7a1415b3a0 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.507+0000 7f7a12d9d640 1 --2- 172.21.15.46:0/1138247312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a1415b3a0 0x7f7a1415b7b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009d90 tx=0x7f7a0c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7ac944907de268 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a11d9b640 1 -- 172.21.15.46:0/1138247312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c007740 con 0x7f7a1415b3a0 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a11d9b640 1 -- 172.21.15.46:0/1138247312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0078e0 con 0x7f7a1415b3a0 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a11d9b640 1 -- 172.21.15.46:0/1138247312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c007cb0 con 0x7f7a1415b3a0 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 -- 172.21.15.46:0/1138247312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a1415b3a0 msgr2=0x7f7a1415b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 --2- 172.21.15.46:0/1138247312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a1415b3a0 0x7f7a1415b7b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009d90 tx=0x7f7a0c02a530 comp rx=0 tx=0).stop 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 -- 172.21.15.46:0/1138247312 shutdown_connections 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 --2- 172.21.15.46:0/1138247312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a1415b3a0 0x7f7a1415b7b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 --2- 172.21.15.46:0/1138247312 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a140c96c0 0x7f7a140c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 -- 172.21.15.46:0/1138247312 >> 172.21.15.46:0/1138247312 conn(0x7f7a140aebe0 msgr2=0x7f7a140aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.508+0000 7f7a18b06640 1 -- 172.21.15.46:0/1138247312 shutdown_connections 2024-05-09T02:19:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.509+0000 7f7a18b06640 1 -- 172.21.15.46:0/1138247312 wait complete. 2024-05-09T02:19:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.510+0000 7f7a18b06640 1 Processor -- start 2024-05-09T02:19:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.510+0000 7f7a18b06640 1 -- start start 2024-05-09T02:19:01.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a18b06640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a140c96c0 0x7f7a141515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:01.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a18b06640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 0x7f7a140ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a18b06640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a1415b3a0 0x7f7a1414a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a18b06640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a140c8670 con 0x7f7a14155160 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a18b06640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14158770 con 0x7f7a140c96c0 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a18b06640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7a14157b30 con 0x7f7a1415b3a0 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 0x7f7a140ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 0x7f7a140ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39296/0 (socket says 172.21.15.46:39296) 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 -- 172.21.15.46:0/832705205 learned_addr learned my addr 172.21.15.46:0/832705205 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a12d9d640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a1415b3a0 0x7f7a1414a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a1259c640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a140c96c0 0x7f7a141515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 -- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a1415b3a0 msgr2=0x7f7a1414a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a1415b3a0 0x7f7a1414a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 -- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a140c96c0 msgr2=0x7f7a141515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a140c96c0 0x7f7a141515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 -- 172.21.15.46:0/832705205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a14159ad0 con 0x7f7a14155160 2024-05-09T02:19:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0bfff640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 0x7f7a140ae140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d5f0 tx=0x7f79fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.512+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0125f0 con 0x7f7a14155160 2024-05-09T02:19:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.513+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc019070 con 0x7f7a14155160 2024-05-09T02:19:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.513+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1415aa40 con 0x7f7a14155160 2024-05-09T02:19:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.513+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0129d0 con 0x7f7a14155160 2024-05-09T02:19:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.513+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1415a1c0 con 0x7f7a14155160 2024-05-09T02:19:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.514+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a14159d40 con 0x7f7a14155160 2024-05-09T02:19:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.514+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79fc012b70 con 0x7f7a14155160 2024-05-09T02:19:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.515+0000 7f7a0affd640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f79f4076300 0x7f79f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.515+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f79fc097cd0 con 0x7f7a14155160 2024-05-09T02:19:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.515+0000 7f7a1259c640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f79f4076300 0x7f79f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.516+0000 7f7a1259c640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f79f4076300 0x7f79f4078810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a04007a60 tx=0x7f7a04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:01.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.520+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f79fc061320 con 0x7f7a14155160 2024-05-09T02:19:01.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.747+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a1408e4c0 con 0x7f7a14155160 2024-05-09T02:19:01.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.748+0000 7f7a0affd640 1 -- 172.21.15.46:0/832705205 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7f79fc060c20 con 0x7f7a14155160 2024-05-09T02:19:01.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:01.751 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:01.751 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f79f4076300 msgr2=0x7f79f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f79f4076300 0x7f79f4078810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a04007a60 tx=0x7f7a04009040 comp rx=0 tx=0).stop 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 msgr2=0x7f7a140ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 0x7f7a140ae140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d5f0 tx=0x7f79fc00dab0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 shutdown_connections 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f79f4076300 0x7f79f4078810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a1415b3a0 0x7f7a1414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a14155160 0x7f7a140ae140 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 --2- 172.21.15.46:0/832705205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a140c96c0 0x7f7a141515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 >> 172.21.15.46:0/832705205 conn(0x7f7a140aebe0 msgr2=0x7f7a140c2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 shutdown_connections 2024-05-09T02:19:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:01.750+0000 7f7a18b06640 1 -- 172.21.15.46:0/832705205 wait complete. 2024-05-09T02:19:01.764 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:19:03.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:03.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.893+0000 7ff328c15640 1 Processor -- start 2024-05-09T02:19:03.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.893+0000 7ff328c15640 1 -- start start 2024-05-09T02:19:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.894+0000 7ff328c15640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3240c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.894+0000 7ff328c15640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3240c2530 con 0x7ff3240c8410 2024-05-09T02:19:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.894+0000 7ff328c15640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3241588b0 con 0x7ff324140d40 2024-05-09T02:19:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.894+0000 7ff328c15640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff3240c8820 con 0x7ff3241584a0 2024-05-09T02:19:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.894+0000 7ff319d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff3240c8410 0x7ff3240c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47668/0 (socket says 172.21.15.46:47668) 2024-05-09T02:19:03.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.894+0000 7ff319d9b640 1 -- 172.21.15.46:0/4282453931 learned_addr learned my addr 172.21.15.46:0/4282453931 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff322d9d640 1 --2- 172.21.15.46:0/4282453931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3240c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382547283 0 0) 0x7ff3240c2530 con 0x7ff3240c8410 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff310003520 con 0x7ff3240c8410 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900330089 0 0) 0x7ff3241588b0 con 0x7ff324140d40 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3240c2530 con 0x7ff324140d40 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1714742997 0 0) 0x7ff310003520 con 0x7ff3240c8410 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff322d9d640 1 -- 172.21.15.46:0/4282453931 >> v1:172.21.15.107:6789/0 conn(0x7ff324140d40 legacy=0x7ff32406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff322d9d640 1 -- 172.21.15.46:0/4282453931 >> v1:172.21.15.46:6789/0 conn(0x7ff3240c8410 legacy=0x7ff3240c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:03.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.895+0000 7ff322d9d640 1 -- 172.21.15.46:0/4282453931 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32406ed30 con 0x7ff3241584a0 2024-05-09T02:19:03.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.896+0000 7ff322d9d640 1 --2- 172.21.15.46:0/4282453931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3240c8be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009dc0 tx=0x7ff31c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d078514754627b7f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:03.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.896+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0016f0 con 0x7ff3241584a0 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.896+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c007540 con 0x7ff3241584a0 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.896+0000 7ff321d9b640 1 -- 172.21.15.46:0/4282453931 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c007910 con 0x7ff3241584a0 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 -- 172.21.15.46:0/4282453931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 msgr2=0x7ff3240c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 --2- 172.21.15.46:0/4282453931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3240c8be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009dc0 tx=0x7ff31c02a5d0 comp rx=0 tx=0).stop 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 -- 172.21.15.46:0/4282453931 shutdown_connections 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 --2- 172.21.15.46:0/4282453931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3240c8be0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 -- 172.21.15.46:0/4282453931 >> 172.21.15.46:0/4282453931 conn(0x7ff324068e00 msgr2=0x7ff3240c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 -- 172.21.15.46:0/4282453931 shutdown_connections 2024-05-09T02:19:03.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.897+0000 7ff328c15640 1 -- 172.21.15.46:0/4282453931 wait complete. 2024-05-09T02:19:03.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.899+0000 7ff328c15640 1 Processor -- start 2024-05-09T02:19:03.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.899+0000 7ff328c15640 1 -- start start 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff328c15640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 0x7ff3241ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff328c15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff324140d40 0x7ff32413f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff328c15640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3241536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff328c15640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff3240c7c10 con 0x7ff3240c8410 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff328c15640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff32406f010 con 0x7ff324140d40 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff328c15640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff3240c7ef0 con 0x7ff3241584a0 2024-05-09T02:19:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff32259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 0x7ff3241ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff32259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 0x7ff3241ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39312/0 (socket says 172.21.15.46:39312) 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff32259c640 1 -- 172.21.15.46:0/2517378656 learned_addr learned my addr 172.21.15.46:0/2517378656 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff319d9b640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff324140d40 0x7ff32413f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.900+0000 7ff322d9d640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3241536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff32259c640 1 -- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 msgr2=0x7ff3241536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff32259c640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3241536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff32259c640 1 -- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff324140d40 msgr2=0x7ff32413f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff32259c640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff324140d40 0x7ff32413f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff32259c640 1 -- 172.21.15.46:0/2517378656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3241576e0 con 0x7ff3240c8410 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff32259c640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 0x7ff3241ed930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c390 tx=0x7ff31400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314017070 con 0x7ff3240c8410 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3140052d0 con 0x7ff3240c8410 2024-05-09T02:19:03.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32413a990 con 0x7ff3240c8410 2024-05-09T02:19:03.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314003830 con 0x7ff3240c8410 2024-05-09T02:19:03.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.901+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3241f1320 con 0x7ff3240c8410 2024-05-09T02:19:03.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.902+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3241f0e50 con 0x7ff3240c8410 2024-05-09T02:19:03.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.903+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff31401a070 con 0x7ff3240c8410 2024-05-09T02:19:03.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.903+0000 7ff31b7fe640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff3040762d0 0x7ff3040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:03.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.903+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff314096b70 con 0x7ff3240c8410 2024-05-09T02:19:03.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.904+0000 7ff319d9b640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff3040762d0 0x7ff3040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:03.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.904+0000 7ff319d9b640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff3040762d0 0x7ff3040787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff3240c99e0 tx=0x7ff30c0016a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:03.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:03.908+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff31405faf0 con 0x7ff3240c8410 2024-05-09T02:19:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.140+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff324155ea0 con 0x7ff3240c8410 2024-05-09T02:19:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.140+0000 7ff31b7fe640 1 -- 172.21.15.46:0/2517378656 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6476 (secure 0 0 0) 0x7ff314068130 con 0x7ff3240c8410 2024-05-09T02:19:04.143 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:18:17.542144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/16654146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":16654146},{"type":"v1","addr":"172.21.15.107:6837","nonce":16654146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4293,"qdb_cluster":[4293]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 14 2024-05-09T02:19:04.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff3040762d0 msgr2=0x7ff3040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:04.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff3040762d0 0x7ff3040787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff3240c99e0 tx=0x7ff30c0016a0 comp rx=0 tx=0).stop 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 msgr2=0x7ff3241ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 0x7ff3241ed930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c390 tx=0x7ff31400c850 comp rx=0 tx=0).stop 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 shutdown_connections 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff3040762d0 0x7ff3040787e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3241584a0 0x7ff3241536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff324140d40 0x7ff32413f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 --2- 172.21.15.46:0/2517378656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3240c8410 0x7ff3241ed930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.142+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 >> 172.21.15.46:0/2517378656 conn(0x7ff324068e00 msgr2=0x7ff3240c1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.143+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 shutdown_connections 2024-05-09T02:19:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:04.143+0000 7ff328c15640 1 -- 172.21.15.46:0/2517378656 wait complete. 2024-05-09T02:19:04.157 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:19:06.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:06.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.284+0000 7fc172c43640 1 Processor -- start 2024-05-09T02:19:06.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.284+0000 7fc172c43640 1 -- start start 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc172c43640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c5f70 0x7fc16c156310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc172c43640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc16c0c8fe0 0x7fc16c0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc172c43640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16c159d60 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc172c43640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc16c0cb940 con 0x7fc16c0c8fe0 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc172c43640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc16c1598d0 con 0x7fc16c0c5f70 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc16bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc16c0c8fe0 0x7fc16c0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc1711e0640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc16c0c9fc0 0x7fc16c0ca3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47678/0 (socket says 172.21.15.46:47678) 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc1711e0640 1 -- 172.21.15.46:0/226626391 learned_addr learned my addr 172.21.15.46:0/226626391 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc1709df640 1 --2- 172.21.15.46:0/226626391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c5f70 0x7fc16c156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc16bfff640 1 -- 172.21.15.46:0/226626391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c5f70 msgr2=0x7fc16c156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:06.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc16bfff640 1 --2- 172.21.15.46:0/226626391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c5f70 0x7fc16c156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc16bfff640 1 -- 172.21.15.46:0/226626391 >> v1:172.21.15.46:6789/0 conn(0x7fc16c0c9fc0 legacy=0x7fc16c0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc16b7fe640 1 -- 172.21.15.46:0/226626391 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174177096 0 0) 0x7fc16c159d60 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.286+0000 7fc16bfff640 1 -- 172.21.15.46:0/226626391 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c0caae0 con 0x7fc16c0c8fe0 2024-05-09T02:19:06.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.287+0000 7fc16bfff640 1 --2- 172.21.15.46:0/226626391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c8fe0 0x7fc16c0c93f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009d90 tx=0x7fc15c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf805eb8ab9fa69 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:06.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.287+0000 7fc16b7fe640 1 -- 172.21.15.46:0/226626391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c031600 con 0x7fc16c0c8fe0 2024-05-09T02:19:06.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.287+0000 7fc16b7fe640 1 -- 172.21.15.46:0/226626391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c0317a0 con 0x7fc16c0c8fe0 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.287+0000 7fc16b7fe640 1 -- 172.21.15.46:0/226626391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c031b70 con 0x7fc16c0c8fe0 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 -- 172.21.15.46:0/226626391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c8fe0 msgr2=0x7fc16c0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 --2- 172.21.15.46:0/226626391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c8fe0 0x7fc16c0c93f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009d90 tx=0x7fc15c02a5d0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 -- 172.21.15.46:0/226626391 shutdown_connections 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 --2- 172.21.15.46:0/226626391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c8fe0 0x7fc16c0c93f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 --2- 172.21.15.46:0/226626391 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c5f70 0x7fc16c156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 -- 172.21.15.46:0/226626391 >> 172.21.15.46:0/226626391 conn(0x7fc16c0aca30 msgr2=0x7fc16c0ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:06.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 -- 172.21.15.46:0/226626391 shutdown_connections 2024-05-09T02:19:06.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.288+0000 7fc172c43640 1 -- 172.21.15.46:0/226626391 wait complete. 2024-05-09T02:19:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.290+0000 7fc172c43640 1 Processor -- start 2024-05-09T02:19:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.290+0000 7fc172c43640 1 -- start start 2024-05-09T02:19:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc172c43640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc16c0c5f70 0x7fc16c1ec460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc172c43640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c8fe0 0x7fc16c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc172c43640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 0x7fc16c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc172c43640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c159560 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc172c43640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c159280 con 0x7fc16c0c5f70 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc172c43640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc16c0c9cb0 con 0x7fc16c0c8fe0 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc1711e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 0x7fc16c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc1711e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 0x7fc16c148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39338/0 (socket says 172.21.15.46:39338) 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.291+0000 7fc1711e0640 1 -- 172.21.15.46:0/2859988679 learned_addr learned my addr 172.21.15.46:0/2859988679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1709df640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc16c0c5f70 0x7fc16c1ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc16bfff640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c8fe0 0x7fc16c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1711e0640 1 -- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c8fe0 msgr2=0x7fc16c14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1711e0640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c8fe0 0x7fc16c14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1711e0640 1 -- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc16c0c5f70 msgr2=0x7fc16c1ec460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1711e0640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc16c0c5f70 0x7fc16c1ec460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1711e0640 1 -- 172.21.15.46:0/2859988679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c1eb9c0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1709df640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc16c0c5f70 0x7fc16c1ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc16bfff640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c8fe0 0x7fc16c14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1711e0640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 0x7fc16c148a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c390 tx=0x7fc16400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640074e0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1640047e0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c1ef9d0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164004bd0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.292+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c1efcb0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.293+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16c06a330 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.294+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc164011070 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.294+0000 7fc1697fa640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc14c076300 0x7fc14c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.295+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7fc164097400 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.295+0000 7fc1709df640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc14c076300 0x7fc14c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.295+0000 7fc1709df640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc14c076300 0x7fc14c078810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc154006fd0 tx=0x7fc154008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:06.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.300+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc1640609f0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.529+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc16c0c8dc0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.529+0000 7fc1697fa640 1 -- 172.21.15.46:0/2859988679 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5655 (secure 0 0 0) 0x7fc1640602f0 con 0x7fc16c0c9fc0 2024-05-09T02:19:06.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:06.532 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:04.906300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T02:19:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.531+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc14c076300 msgr2=0x7fc14c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.531+0000 7fc172c43640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc14c076300 0x7fc14c078810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc154006fd0 tx=0x7fc154008040 comp rx=0 tx=0).stop 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.531+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 msgr2=0x7fc16c148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.531+0000 7fc172c43640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 0x7fc16c148a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c390 tx=0x7fc16400c850 comp rx=0 tx=0).stop 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 shutdown_connections 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc14c076300 0x7fc14c078810 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc16c0c9fc0 0x7fc16c148a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc16c0c8fe0 0x7fc16c14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 --2- 172.21.15.46:0/2859988679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc16c0c5f70 0x7fc16c1ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 >> 172.21.15.46:0/2859988679 conn(0x7fc16c0aca30 msgr2=0x7fc16c153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:06.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 shutdown_connections 2024-05-09T02:19:06.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.532+0000 7fc172c43640 1 -- 172.21.15.46:0/2859988679 wait complete. 2024-05-09T02:19:06.546 INFO:tasks.mds_thrash.fs.[a]:mds.b down, removed from mdsmap 2024-05-09T02:19:06.546 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T02:19:06.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:06.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.658+0000 7f3adcc05640 1 Processor -- start 2024-05-09T02:19:06.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.658+0000 7f3adcc05640 1 -- start start 2024-05-09T02:19:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3adcc05640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ad8070b30 0x7f3ad80722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3adcc05640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ad8152ea0 0x7f3ad8072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3adcc05640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad80c83b0 con 0x7f3ad80c4e80 2024-05-09T02:19:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3adcc05640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad8159d00 con 0x7f3ad8070b30 2024-05-09T02:19:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3adcc05640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad8156c30 con 0x7f3ad8152ea0 2024-05-09T02:19:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3ad659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ad8070b30 0x7f3ad80722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3ad659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ad8070b30 0x7f3ad80722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35842/0 (socket says 172.21.15.46:35842) 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3ad659c640 1 -- 172.21.15.46:0/3101174245 learned_addr learned my addr 172.21.15.46:0/3101174245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3ad6d9d640 1 --2- 172.21.15.46:0/3101174245 >> v2:172.21.15.107:3300/0 conn(0x7f3ad8152ea0 0x7f3ad8072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3ad659c640 1 -- 172.21.15.46:0/3101174245 >> v2:172.21.15.107:3300/0 conn(0x7f3ad8152ea0 msgr2=0x7f3ad8072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.659+0000 7f3ad659c640 1 --2- 172.21.15.46:0/3101174245 >> v2:172.21.15.107:3300/0 conn(0x7f3ad8152ea0 0x7f3ad8072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad659c640 1 -- 172.21.15.46:0/3101174245 >> v1:172.21.15.107:6789/0 conn(0x7f3ad80c4e80 legacy=0x7f3ad8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad659c640 1 -- 172.21.15.46:0/3101174245 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8155740 con 0x7f3ad8070b30 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad6d9d640 1 --2- 172.21.15.46:0/3101174245 >> v2:172.21.15.107:3300/0 conn(0x7f3ad8152ea0 0x7f3ad8072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad659c640 1 --2- 172.21.15.46:0/3101174245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80722c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8070780 tx=0x7f3ad002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c283d941b47758 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad559a640 1 -- 172.21.15.46:0/3101174245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0037070 con 0x7f3ad8070b30 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad559a640 1 -- 172.21.15.46:0/3101174245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad0032440 con 0x7f3ad8070b30 2024-05-09T02:19:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.660+0000 7f3ad559a640 1 -- 172.21.15.46:0/3101174245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0032810 con 0x7f3ad8070b30 2024-05-09T02:19:06.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 -- 172.21.15.46:0/3101174245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 msgr2=0x7f3ad80722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 --2- 172.21.15.46:0/3101174245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80722c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8070780 tx=0x7f3ad002a1e0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 -- 172.21.15.46:0/3101174245 shutdown_connections 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 --2- 172.21.15.46:0/3101174245 >> v2:172.21.15.107:3300/0 conn(0x7f3ad8152ea0 0x7f3ad8072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 --2- 172.21.15.46:0/3101174245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80722c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 -- 172.21.15.46:0/3101174245 >> 172.21.15.46:0/3101174245 conn(0x7f3ad8069040 msgr2=0x7f3ad80ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 -- 172.21.15.46:0/3101174245 shutdown_connections 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.661+0000 7f3adcc05640 1 -- 172.21.15.46:0/3101174245 wait complete. 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.663+0000 7f3adcc05640 1 Processor -- start 2024-05-09T02:19:06.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.663+0000 7f3adcc05640 1 -- start start 2024-05-09T02:19:06.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3adcc05640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3adcc05640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ad80c4e80 0x7f3ad81e1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3adcc05640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ad8152ea0 0x7f3ad814de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3adcc05640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8159a20 con 0x7f3ad8070b30 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3adcc05640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad80ca600 con 0x7f3ad8152ea0 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3adcc05640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad80ca8a0 con 0x7f3ad80c4e80 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3ad659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3ad659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35856/0 (socket says 172.21.15.46:35856) 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.664+0000 7f3ad659c640 1 -- 172.21.15.46:0/616170304 learned_addr learned my addr 172.21.15.46:0/616170304 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad5d9b640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ad80c4e80 0x7f3ad81e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad6d9d640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ad8152ea0 0x7f3ad814de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad659c640 1 -- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ad80c4e80 msgr2=0x7f3ad81e1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad659c640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ad80c4e80 0x7f3ad81e1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad659c640 1 -- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ad8152ea0 msgr2=0x7f3ad814de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad659c640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ad8152ea0 0x7f3ad814de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad659c640 1 -- 172.21.15.46:0/616170304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8155570 con 0x7f3ad8070b30 2024-05-09T02:19:06.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad6d9d640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ad8152ea0 0x7f3ad814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad5d9b640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ad80c4e80 0x7f3ad81e1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3ad659c640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80aebc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ad002a220 tx=0x7f3ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0041020 con 0x7f3ad8070b30 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad00306c0 con 0x7f3ad8070b30 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad81dfd20 con 0x7f3ad8070b30 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0037040 con 0x7f3ad8070b30 2024-05-09T02:19:06.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.665+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad80c74c0 con 0x7f3ad8070b30 2024-05-09T02:19:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.666+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad806a330 con 0x7f3ad8070b30 2024-05-09T02:19:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.667+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ad0044020 con 0x7f3ad8070b30 2024-05-09T02:19:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.667+0000 7f3aceffd640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ab8076300 0x7f3ab8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.668+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f3ad00b8280 con 0x7f3ad8070b30 2024-05-09T02:19:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.668+0000 7f3ad5d9b640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ab8076300 0x7f3ab8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.668+0000 7f3ad5d9b640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ab8076300 0x7f3ab8078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8155030 tx=0x7f3ac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.672+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ad004b030 con 0x7f3ad8070b30 2024-05-09T02:19:06.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.902+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ad80c9560 con 0x7f3ad8070b30 2024-05-09T02:19:06.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.902+0000 7f3aceffd640 1 -- 172.21.15.46:0/616170304 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5652 (secure 0 0 0) 0x7f3ad8155740 con 0x7f3ad8070b30 2024-05-09T02:19:06.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:06.905 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:05.892692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:06.905 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-05-09T02:19:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ab8076300 msgr2=0x7f3ab8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ab8076300 0x7f3ab8078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8155030 tx=0x7f3ac0009040 comp rx=0 tx=0).stop 2024-05-09T02:19:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 msgr2=0x7f3ad80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80aebc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ad002a220 tx=0x7f3ad00046c0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 shutdown_connections 2024-05-09T02:19:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ab8076300 0x7f3ab8078810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ad8152ea0 0x7f3ad814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ad80c4e80 0x7f3ad81e1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 --2- 172.21.15.46:0/616170304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8070b30 0x7f3ad80aebc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 >> 172.21.15.46:0/616170304 conn(0x7f3ad8069040 msgr2=0x7f3ad80c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 shutdown_connections 2024-05-09T02:19:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:06.904+0000 7f3adcc05640 1 -- 172.21.15.46:0/616170304 wait complete. 2024-05-09T02:19:06.919 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:13.523096+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4278": { "addr": "172.21.15.46:6835/687229870", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6834", "nonce": 687229870, "type": "v2" }, { "addr": "172.21.15.46:6835", "nonce": 687229870, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4278, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:rejoin", "state_seq": 17 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T02:19:05.892692+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4278 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:22.572836+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 14, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4288": { "addr": "172.21.15.46:6833/268323982", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6832", "nonce": 268323982, "type": "v2" }, { "addr": "172.21.15.46:6833", "nonce": 268323982, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4288, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T02:18:26.603395+0000", "qdb_cluster": [ 4288 ], "qdb_leader": 4288, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288 } } } ], "standbys": [ { "addr": "172.21.15.107:6836/1968918469", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6834", "nonce": 1968918469, "type": "v2" }, { "addr": "172.21.15.107:6836", "nonce": 1968918469, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4232, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T02:19:07.908 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 02:18:14.128601107 +0000 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 02:18:42.170226026 +0000 2024-05-09T02:19:07.909 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-05-09T02:19:07.909 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T02:19:07.909 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T02:19:07.946 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-09 02:18:23.206228837 +0000 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-09 02:18:42.252497278 +0000 2024-05-09T02:19:07.965 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-09T02:19:07.966 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-09T02:19:07.966 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-09T02:19:08.039 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:19:08.040 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T02:19:08.060 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T02:19:08.096 INFO:tasks.workunit.client.1.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-09T02:19:08.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:09.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.035+0000 7fbd38415640 1 Processor -- start 2024-05-09T02:19:09.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.035+0000 7fbd38415640 1 -- start start 2024-05-09T02:19:09.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd38415640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd300c5f10 0x7fbd300c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd38415640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd30154ec0 0x7fbd300c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd38415640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd300ca490 0x7fbd30157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd38415640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fbd300c6320 con 0x7fbd30154ec0 2024-05-09T02:19:09.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd38415640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbd30157950 con 0x7fbd300ca490 2024-05-09T02:19:09.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd38415640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd301552d0 con 0x7fbd300c5f10 2024-05-09T02:19:09.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd359b0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd30154ec0 0x7fbd300c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd359b0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd30154ec0 0x7fbd300c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35862/0 (socket says 172.21.15.46:35862) 2024-05-09T02:19:09.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd359b0640 1 -- 172.21.15.46:0/1622517199 learned_addr learned my addr 172.21.15.46:0/1622517199 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd361b1640 1 --2- 172.21.15.46:0/1622517199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd300c5f10 0x7fbd300c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.036+0000 7fbd369b2640 1 --2- 172.21.15.46:0/1622517199 >> v2:172.21.15.107:3300/0 conn(0x7fbd300ca490 0x7fbd30157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.037+0000 7fbd359b0640 1 -- 172.21.15.46:0/1622517199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd300c5f10 msgr2=0x7fbd300c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.037+0000 7fbd359b0640 1 --2- 172.21.15.46:0/1622517199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd300c5f10 0x7fbd300c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.037+0000 7fbd359b0640 1 -- 172.21.15.46:0/1622517199 >> v2:172.21.15.107:3300/0 conn(0x7fbd300ca490 msgr2=0x7fbd30157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.037+0000 7fbd359b0640 1 --2- 172.21.15.46:0/1622517199 >> v2:172.21.15.107:3300/0 conn(0x7fbd300ca490 0x7fbd30157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.037+0000 7fbd359b0640 1 -- 172.21.15.46:0/1622517199 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3015af40 con 0x7fbd30154ec0 2024-05-09T02:19:09.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.037+0000 7fbd359b0640 1 --2- 172.21.15.46:0/1622517199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd30154ec0 0x7fbd300c9f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbd300cab10 tx=0x7fbd2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b20153a425de7c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:09.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd351af640 1 -- 172.21.15.46:0/1622517199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20037070 con 0x7fbd30154ec0 2024-05-09T02:19:09.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd351af640 1 -- 172.21.15.46:0/1622517199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd20032440 con 0x7fbd30154ec0 2024-05-09T02:19:09.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd351af640 1 -- 172.21.15.46:0/1622517199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20032810 con 0x7fbd30154ec0 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 -- 172.21.15.46:0/1622517199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd30154ec0 msgr2=0x7fbd300c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 --2- 172.21.15.46:0/1622517199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd30154ec0 0x7fbd300c9f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbd300cab10 tx=0x7fbd2002a1e0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 -- 172.21.15.46:0/1622517199 shutdown_connections 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 --2- 172.21.15.46:0/1622517199 >> v2:172.21.15.107:3300/0 conn(0x7fbd300ca490 0x7fbd30157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 --2- 172.21.15.46:0/1622517199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd30154ec0 0x7fbd300c9f50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 --2- 172.21.15.46:0/1622517199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd300c5f10 0x7fbd300c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 -- 172.21.15.46:0/1622517199 >> 172.21.15.46:0/1622517199 conn(0x7fbd30069040 msgr2=0x7fbd300ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 -- 172.21.15.46:0/1622517199 shutdown_connections 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.038+0000 7fbd38415640 1 -- 172.21.15.46:0/1622517199 wait complete. 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.040+0000 7fbd38415640 1 Processor -- start 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.040+0000 7fbd38415640 1 -- start start 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd38415640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 0x7fbd301ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd38415640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd300ca490 0x7fbd300ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd38415640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd30154ec0 0x7fbd301e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd38415640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300c7cb0 con 0x7fbd300c5f10 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd38415640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300c79d0 con 0x7fbd300ca490 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd38415640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd300c7f90 con 0x7fbd30154ec0 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd361b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 0x7fbd301ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd361b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 0x7fbd301ee780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35878/0 (socket says 172.21.15.46:35878) 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd361b1640 1 -- 172.21.15.46:0/3086553424 learned_addr learned my addr 172.21.15.46:0/3086553424 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:09.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd369b2640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd30154ec0 0x7fbd301e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.041+0000 7fbd359b0640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd300ca490 0x7fbd300ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd361b1640 1 -- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd30154ec0 msgr2=0x7fbd301e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd361b1640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd30154ec0 0x7fbd301e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd361b1640 1 -- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd300ca490 msgr2=0x7fbd300ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd361b1640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd300ca490 0x7fbd300ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd361b1640 1 -- 172.21.15.46:0/3086553424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd301e3e80 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd361b1640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 0x7fbd301ee780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00e870 tx=0x7fbd2c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c017070 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00ee60 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00cb80 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd300af700 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.042+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd300afcc0 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.043+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3006f960 con 0x7fbd300c5f10 2024-05-09T02:19:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.044+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd2c01a070 con 0x7fbd300c5f10 2024-05-09T02:19:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.044+0000 7fbd26ffd640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd14076300 0x7fbd14078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.044+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7fbd2c097b50 con 0x7fbd300c5f10 2024-05-09T02:19:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.044+0000 7fbd359b0640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd14076300 0x7fbd14078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.045+0000 7fbd359b0640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd14076300 0x7fbd14078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd20034000 tx=0x7fbd2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.049+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd2c060a60 con 0x7fbd300c5f10 2024-05-09T02:19:09.117 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-05-09T02:19:09.114+0000 7fdd7b096640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:19:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.281+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd3006a330 con 0x7fbd300c5f10 2024-05-09T02:19:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.282+0000 7fbd26ffd640 1 -- 172.21.15.46:0/3086553424 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5659 (secure 0 0 0) 0x7fbd2c064d60 con 0x7fbd300c5f10 2024-05-09T02:19:09.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:09.285 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd14076300 msgr2=0x7fbd14078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd14076300 0x7fbd14078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd20034000 tx=0x7fbd2002e000 comp rx=0 tx=0).stop 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 msgr2=0x7fbd301ee780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 0x7fbd301ee780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00e870 tx=0x7fbd2c00ed30 comp rx=0 tx=0).stop 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 shutdown_connections 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd14076300 0x7fbd14078810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd30154ec0 0x7fbd301e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd300ca490 0x7fbd300ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 --2- 172.21.15.46:0/3086553424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd300c5f10 0x7fbd301ee780 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 >> 172.21.15.46:0/3086553424 conn(0x7fbd30069040 msgr2=0x7fbd300c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 shutdown_connections 2024-05-09T02:19:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:09.284+0000 7fbd38415640 1 -- 172.21.15.46:0/3086553424 wait complete. 2024-05-09T02:19:09.297 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4293 2024-05-09T02:19:09.298 INFO:tasks.mds_thrash.fs.[a]:waiting for 1 secs before reviving mds.b 2024-05-09T02:19:10.299 INFO:tasks.mds_thrash.fs.[a]:reviving mds.b 2024-05-09T02:19:10.299 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T02:19:10.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T02:19:10.302 INFO:tasks.ceph.mds.b:Started 2024-05-09T02:19:10.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:10.401 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-09T02:19:10.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.427+0000 7f684e986640 1 Processor -- start 2024-05-09T02:19:10.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.427+0000 7f684e986640 1 -- start start 2024-05-09T02:19:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f684e986640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6848151ef0 0x7f68480aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f684e986640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68480a91e0 0x7f6848073b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f684e986640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6848154720 0x7f68480c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f684e986640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f68480733b0 con 0x7f6848151ef0 2024-05-09T02:19:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f684e986640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f68480ab290 con 0x7f68480a91e0 2024-05-09T02:19:10.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f684e986640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f68480ab570 con 0x7f6848154720 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f6847fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6848151ef0 0x7f68480aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f6847fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6848151ef0 0x7f68480aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35886/0 (socket says 172.21.15.46:35886) 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.428+0000 7f6847fff640 1 -- 172.21.15.46:0/4100685470 learned_addr learned my addr 172.21.15.46:0/4100685470 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f68477fe640 1 --2- 172.21.15.46:0/4100685470 >> v2:172.21.15.107:3300/0 conn(0x7f68480a91e0 0x7f6848073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f684cf23640 1 --2- 172.21.15.46:0/4100685470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6848154720 0x7f68480c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f6847fff640 1 -- 172.21.15.46:0/4100685470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6848154720 msgr2=0x7f68480c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f6847fff640 1 --2- 172.21.15.46:0/4100685470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6848154720 0x7f68480c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f6847fff640 1 -- 172.21.15.46:0/4100685470 >> v2:172.21.15.107:3300/0 conn(0x7f68480a91e0 msgr2=0x7f6848073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f6847fff640 1 --2- 172.21.15.46:0/4100685470 >> v2:172.21.15.107:3300/0 conn(0x7f68480a91e0 0x7f6848073b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f6847fff640 1 -- 172.21.15.46:0/4100685470 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6848073620 con 0x7f6848151ef0 2024-05-09T02:19:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.429+0000 7f68477fe640 1 --2- 172.21.15.46:0/4100685470 >> v2:172.21.15.107:3300/0 conn(0x7f68480a91e0 0x7f6848073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f6847fff640 1 --2- 172.21.15.46:0/4100685470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848151ef0 0x7f68480aac90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6848072de0 tx=0x7f683802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fcd55fd4468453 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f6846ffd640 1 -- 172.21.15.46:0/4100685470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838037070 con 0x7f6848151ef0 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f6846ffd640 1 -- 172.21.15.46:0/4100685470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6838032440 con 0x7f6848151ef0 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f6846ffd640 1 -- 172.21.15.46:0/4100685470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838032810 con 0x7f6848151ef0 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 -- 172.21.15.46:0/4100685470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848151ef0 msgr2=0x7f68480aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 --2- 172.21.15.46:0/4100685470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848151ef0 0x7f68480aac90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6848072de0 tx=0x7f683802a1e0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 -- 172.21.15.46:0/4100685470 shutdown_connections 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 --2- 172.21.15.46:0/4100685470 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6848154720 0x7f68480c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 --2- 172.21.15.46:0/4100685470 >> v2:172.21.15.107:3300/0 conn(0x7f68480a91e0 0x7f6848073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 --2- 172.21.15.46:0/4100685470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848151ef0 0x7f68480aac90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.430+0000 7f684e986640 1 -- 172.21.15.46:0/4100685470 >> 172.21.15.46:0/4100685470 conn(0x7f68480c5940 msgr2=0x7f68480c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.431+0000 7f684e986640 1 -- 172.21.15.46:0/4100685470 shutdown_connections 2024-05-09T02:19:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.431+0000 7f684e986640 1 -- 172.21.15.46:0/4100685470 wait complete. 2024-05-09T02:19:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.432+0000 7f684e986640 1 Processor -- start 2024-05-09T02:19:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.432+0000 7f684e986640 1 -- start start 2024-05-09T02:19:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684e986640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68480a91e0 0x7f68480c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684e986640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6848151ef0 0x7f68481ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684e986640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 0x7f684814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684e986640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f68480c5460 con 0x7f6848154720 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684e986640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f68480ab850 con 0x7f6848151ef0 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684e986640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f68480c55e0 con 0x7f68480a91e0 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 0x7f684814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 0x7f684814b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35888/0 (socket says 172.21.15.46:35888) 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 -- 172.21.15.46:0/3725881315 learned_addr learned my addr 172.21.15.46:0/3725881315 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f6847fff640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68480a91e0 0x7f68480c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f68477fe640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6848151ef0 0x7f68481ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 -- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68480a91e0 msgr2=0x7f68480c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68480a91e0 0x7f68480c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 -- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6848151ef0 msgr2=0x7f68481ebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6848151ef0 0x7f68481ebf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 -- 172.21.15.46:0/3725881315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6848155db0 con 0x7f6848154720 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f68477fe640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6848151ef0 0x7f68481ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.434+0000 7f684cf23640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 0x7f684814b9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6840009fd0 tx=0x7f684000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.435+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840014420 con 0x7f6848154720 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.435+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6840019070 con 0x7f6848154720 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.435+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6848154fe0 con 0x7f6848154720 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.435+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840014800 con 0x7f6848154720 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.435+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68481555a0 con 0x7f6848154720 2024-05-09T02:19:10.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.435+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6848155f80 con 0x7f6848154720 2024-05-09T02:19:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.436+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f68400149a0 con 0x7f6848154720 2024-05-09T02:19:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.437+0000 7f6844ff9640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6834076300 0x7f6834078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.437+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f68400981a0 con 0x7f6848154720 2024-05-09T02:19:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.437+0000 7f6847fff640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6834076300 0x7f6834078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:10.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.438+0000 7f6847fff640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6834076300 0x7f6834078810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:10.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.442+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f68400610b0 con 0x7f6848154720 2024-05-09T02:19:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.670+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f684806d7c0 con 0x7f6848154720 2024-05-09T02:19:10.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.671+0000 7f6844ff9640 1 -- 172.21.15.46:0/3725881315 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5659 (secure 0 0 0) 0x7f68400653b0 con 0x7f6848154720 2024-05-09T02:19:10.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:10.674 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:10.674 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6834076300 msgr2=0x7f6834078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6834076300 0x7f6834078810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).stop 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 msgr2=0x7f684814b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 0x7f684814b9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6840009fd0 tx=0x7f684000e4b0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 shutdown_connections 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6834076300 0x7f6834078810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6848154720 0x7f684814b9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6848151ef0 0x7f68481ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 --2- 172.21.15.46:0/3725881315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68480a91e0 0x7f68480c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:10.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 >> 172.21.15.46:0/3725881315 conn(0x7f68480c5940 msgr2=0x7f68480c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 shutdown_connections 2024-05-09T02:19:10.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:10.673+0000 7f684e986640 1 -- 172.21.15.46:0/3725881315 wait complete. 2024-05-09T02:19:10.687 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-05-09T02:19:12.688 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.815+0000 7f3776269640 1 Processor -- start 2024-05-09T02:19:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.815+0000 7f3776269640 1 -- start start 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f3776269640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3770155160 0x7f37700c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f3776269640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37700c84a0 0x7f37700c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f3776269640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700c9c00 0x7f377015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f3776269640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f3770158ae0 con 0x7f3770155160 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f3776269640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3770155570 con 0x7f37700c84a0 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f3776269640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3770157ed0 con 0x7f37700c9c00 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f376ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3770155160 0x7f37700c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f376ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3770155160 0x7f37700c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35896/0 (socket says 172.21.15.46:35896) 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.816+0000 7f376ffff640 1 -- 172.21.15.46:0/3096037933 learned_addr learned my addr 172.21.15.46:0/3096037933 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376f7fe640 1 --2- 172.21.15.46:0/3096037933 >> v2:172.21.15.107:3300/0 conn(0x7f37700c84a0 0x7f37700c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f3774806640 1 --2- 172.21.15.46:0/3096037933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700c9c00 0x7f377015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376ffff640 1 -- 172.21.15.46:0/3096037933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700c9c00 msgr2=0x7f377015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:12.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376ffff640 1 --2- 172.21.15.46:0/3096037933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700c9c00 0x7f377015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376ffff640 1 -- 172.21.15.46:0/3096037933 >> v2:172.21.15.107:3300/0 conn(0x7f37700c84a0 msgr2=0x7f37700c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:12.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376ffff640 1 --2- 172.21.15.46:0/3096037933 >> v2:172.21.15.107:3300/0 conn(0x7f37700c84a0 0x7f37700c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376ffff640 1 -- 172.21.15.46:0/3096037933 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37701581b0 con 0x7f3770155160 2024-05-09T02:19:12.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.817+0000 7f376ffff640 1 --2- 172.21.15.46:0/3096037933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3770155160 0x7f37700c7f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37700b2fc0 tx=0x7f376002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508b9730b6b8debc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:12.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f376effd640 1 -- 172.21.15.46:0/3096037933 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760037070 con 0x7f3770155160 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f376effd640 1 -- 172.21.15.46:0/3096037933 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376002ae00 con 0x7f3770155160 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f376effd640 1 -- 172.21.15.46:0/3096037933 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760032660 con 0x7f3770155160 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 -- 172.21.15.46:0/3096037933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3770155160 msgr2=0x7f37700c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 --2- 172.21.15.46:0/3096037933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3770155160 0x7f37700c7f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37700b2fc0 tx=0x7f376002a0b0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 -- 172.21.15.46:0/3096037933 shutdown_connections 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 --2- 172.21.15.46:0/3096037933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37700c9c00 0x7f377015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 --2- 172.21.15.46:0/3096037933 >> v2:172.21.15.107:3300/0 conn(0x7f37700c84a0 0x7f37700c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 --2- 172.21.15.46:0/3096037933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3770155160 0x7f37700c7f60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.818+0000 7f3776269640 1 -- 172.21.15.46:0/3096037933 >> 172.21.15.46:0/3096037933 conn(0x7f37700aebe0 msgr2=0x7f37700aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.819+0000 7f3776269640 1 -- 172.21.15.46:0/3096037933 shutdown_connections 2024-05-09T02:19:12.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.819+0000 7f3776269640 1 -- 172.21.15.46:0/3096037933 wait complete. 2024-05-09T02:19:12.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.820+0000 7f3776269640 1 Processor -- start 2024-05-09T02:19:12.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.821+0000 7f3776269640 1 -- start start 2024-05-09T02:19:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3776269640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 0x7f3770151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3776269640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37700c9c00 0x7f3770153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3776269640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3770155160 0x7f37701569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3776269640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3770157b30 con 0x7f37700c84a0 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3776269640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3770158770 con 0x7f37700c9c00 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3776269640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3770157cb0 con 0x7f3770155160 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 0x7f3770151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 0x7f3770151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35912/0 (socket says 172.21.15.46:35912) 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 -- 172.21.15.46:0/2966317135 learned_addr learned my addr 172.21.15.46:0/2966317135 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376f7fe640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37700c9c00 0x7f3770153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f3774806640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3770155160 0x7f37701569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 -- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3770155160 msgr2=0x7f37701569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3770155160 0x7f37701569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 -- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37700c9c00 msgr2=0x7f3770153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37700c9c00 0x7f3770153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 -- 172.21.15.46:0/2966317135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3770152e20 con 0x7f37700c84a0 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.822+0000 7f376ffff640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 0x7f3770151630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f376002a0f0 tx=0x7f37600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.823+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760041030 con 0x7f37700c84a0 2024-05-09T02:19:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.823+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376002ac00 con 0x7f37700c84a0 2024-05-09T02:19:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.823+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760037040 con 0x7f37700c84a0 2024-05-09T02:19:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.823+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3770152b40 con 0x7f37700c84a0 2024-05-09T02:19:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.823+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37701ee570 con 0x7f37700c84a0 2024-05-09T02:19:12.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.824+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377006a330 con 0x7f37700c84a0 2024-05-09T02:19:12.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.825+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3760044070 con 0x7f37700c84a0 2024-05-09T02:19:12.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.825+0000 7f376cff9640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f375c076300 0x7f375c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:12.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.825+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f37600b7d00 con 0x7f37700c84a0 2024-05-09T02:19:12.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.825+0000 7f376f7fe640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f375c076300 0x7f375c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:12.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.826+0000 7f376f7fe640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f375c076300 0x7f375c078810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f37700af060 tx=0x7f3764008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:12.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:12.830+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f376004b070 con 0x7f37700c84a0 2024-05-09T02:19:13.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.059+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37700cb100 con 0x7f37700c84a0 2024-05-09T02:19:13.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.060+0000 7f376cff9640 1 -- 172.21.15.46:0/2966317135 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f3760081260 con 0x7f37700c84a0 2024-05-09T02:19:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:13.063 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:13.064 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f375c076300 msgr2=0x7f375c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:13.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f375c076300 0x7f375c078810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f37700af060 tx=0x7f3764008040 comp rx=0 tx=0).stop 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 msgr2=0x7f3770151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 0x7f3770151630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f376002a0f0 tx=0x7f37600046c0 comp rx=0 tx=0).stop 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 shutdown_connections 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f375c076300 0x7f375c078810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3770155160 0x7f37701569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37700c9c00 0x7f3770153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 --2- 172.21.15.46:0/2966317135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37700c84a0 0x7f3770151630 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 >> 172.21.15.46:0/2966317135 conn(0x7f37700aebe0 msgr2=0x7f3770151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:13.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 shutdown_connections 2024-05-09T02:19:13.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:13.062+0000 7f3776269640 1 -- 172.21.15.46:0/2966317135 wait complete. 2024-05-09T02:19:13.076 INFO:tasks.mds_thrash.fs.[a]:mds.b reported in up:standby state 2024-05-09T02:19:13.077 INFO:tasks.mds_thrash.fs.[a]:waiting for 65 secs before thrashing 2024-05-09T02:19:16.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:19:16.333 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:19:39.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:39.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.547+0000 7f751644c640 1 Processor -- start 2024-05-09T02:19:39.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.547+0000 7f751644c640 1 -- start start 2024-05-09T02:19:39.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f751644c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f75100c2ee0 0x7f7510073320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f751644c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7510153e00 con 0x7f751014de20 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f751644c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75100a86c0 con 0x7f7510154880 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f751644c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f75100a89a0 con 0x7f75100c2ee0 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f750ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f75100c2ee0 0x7f7510073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f7507fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f751014de20 0x7f75101573f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32896/0 (socket says 172.21.15.46:32896) 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.548+0000 7f7507fff640 1 -- 172.21.15.46:0/1106585548 learned_addr learned my addr 172.21.15.46:0/1106585548 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.549+0000 7f750ffff640 1 -- 172.21.15.46:0/1106585548 >> v1:172.21.15.107:6789/0 conn(0x7f7510154880 legacy=0x7f75100702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.549+0000 7f750ffff640 1 -- 172.21.15.46:0/1106585548 >> v1:172.21.15.46:6789/0 conn(0x7f751014de20 legacy=0x7f75101573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.549+0000 7f750ffff640 1 -- 172.21.15.46:0/1106585548 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100a8c80 con 0x7f75100c2ee0 2024-05-09T02:19:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.549+0000 7f750f7fe640 1 -- 172.21.15.46:0/1106585548 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510499058 0 0) 0x7f74f8001110 con 0x7f751014de20 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.549+0000 7f750ffff640 1 --2- 172.21.15.46:0/1106585548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75100c2ee0 0x7f7510073320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75000097a0 tx=0x7f750002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5425a74d97acbf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.549+0000 7f750f7fe640 1 -- 172.21.15.46:0/1106585548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500037070 con 0x7f75100c2ee0 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f750f7fe640 1 -- 172.21.15.46:0/1106585548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500032440 con 0x7f75100c2ee0 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f750f7fe640 1 -- 172.21.15.46:0/1106585548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750002ae60 con 0x7f75100c2ee0 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 -- 172.21.15.46:0/1106585548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75100c2ee0 msgr2=0x7f7510073320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 --2- 172.21.15.46:0/1106585548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75100c2ee0 0x7f7510073320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75000097a0 tx=0x7f750002a110 comp rx=0 tx=0).stop 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 -- 172.21.15.46:0/1106585548 shutdown_connections 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 --2- 172.21.15.46:0/1106585548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75100c2ee0 0x7f7510073320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 -- 172.21.15.46:0/1106585548 >> 172.21.15.46:0/1106585548 conn(0x7f75100c5940 msgr2=0x7f75100c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 -- 172.21.15.46:0/1106585548 shutdown_connections 2024-05-09T02:19:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.550+0000 7f751644c640 1 -- 172.21.15.46:0/1106585548 wait complete. 2024-05-09T02:19:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.552+0000 7f751644c640 1 Processor -- start 2024-05-09T02:19:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.552+0000 7f751644c640 1 -- start start 2024-05-09T02:19:39.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f751644c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75100c2ee0 0x7f7510145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f751644c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 0x7f751014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f751644c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7510154880 0x7f751014d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f751644c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f751014e230 con 0x7f751014de20 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f751644c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7510154360 con 0x7f7510154880 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f751644c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7510154c90 con 0x7f75100c2ee0 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f7507fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 0x7f751014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.553+0000 7f7507fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 0x7f751014cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45250/0 (socket says 172.21.15.46:45250) 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 -- 172.21.15.46:0/2622611965 learned_addr learned my addr 172.21.15.46:0/2622611965 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f750ffff640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75100c2ee0 0x7f7510145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f75149e9640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7510154880 0x7f751014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 -- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75100c2ee0 msgr2=0x7f7510145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75100c2ee0 0x7f7510145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 -- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7510154880 msgr2=0x7f751014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7510154880 0x7f751014d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 -- 172.21.15.46:0/2622611965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100ad9a0 con 0x7f751014de20 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f75149e9640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7510154880 0x7f751014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f7507fff640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 0x7f751014cfc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74f800c3d0 tx=0x7f74f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f80074e0 con 0x7f751014de20 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f80047e0 con 0x7f751014de20 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8004c10 con 0x7f751014de20 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7510143b10 con 0x7f751014de20 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.554+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7510144be0 con 0x7f751014de20 2024-05-09T02:19:39.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.555+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75101ee830 con 0x7f751014de20 2024-05-09T02:19:39.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.556+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74f8011070 con 0x7f751014de20 2024-05-09T02:19:39.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.557+0000 7f750d7fa640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74f0076300 0x7f74f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.557+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f74f80975c0 con 0x7f751014de20 2024-05-09T02:19:39.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.557+0000 7f750ffff640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74f0076300 0x7f74f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.557+0000 7f750ffff640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74f0076300 0x7f74f0078810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7500034000 tx=0x7f750002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:39.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.562+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7510153e00 con 0x7f751014de20 2024-05-09T02:19:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.788+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f751006a330 con 0x7f751014de20 2024-05-09T02:19:39.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.789+0000 7f750d7fa640 1 -- 172.21.15.46:0/2622611965 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f74f80609f0 con 0x7f751014de20 2024-05-09T02:19:39.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:39.791 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:39.791 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.791+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74f0076300 msgr2=0x7f74f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.791+0000 7f751644c640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74f0076300 0x7f74f0078810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7500034000 tx=0x7f750002e000 comp rx=0 tx=0).stop 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.791+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 msgr2=0x7f751014cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.791+0000 7f751644c640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 0x7f751014cfc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74f800c3d0 tx=0x7f74f800c890 comp rx=0 tx=0).stop 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 shutdown_connections 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74f0076300 0x7f74f0078810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7510154880 0x7f751014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751014de20 0x7f751014cfc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 --2- 172.21.15.46:0/2622611965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75100c2ee0 0x7f7510145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 >> 172.21.15.46:0/2622611965 conn(0x7f75100c5940 msgr2=0x7f7510070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 shutdown_connections 2024-05-09T02:19:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.792+0000 7f751644c640 1 -- 172.21.15.46:0/2622611965 wait complete. 2024-05-09T02:19:39.805 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-05-09T02:19:39.805 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T02:19:39.805 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:19:39.815 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T02:19:39.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:39.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.969+0000 7f3388b01640 1 Processor -- start 2024-05-09T02:19:39.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.969+0000 7f3388b01640 1 -- start start 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f3388b01640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3384151ef0 0x7f33840aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f3388b01640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33840733b0 con 0x7f3384154720 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f3388b01640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33840ab290 con 0x7f33840a91e0 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f3388b01640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f33840ab570 con 0x7f3384151ef0 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f3382d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3384154720 0x7f33840c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32902/0 (socket says 172.21.15.46:32902) 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f3382d9d640 1 -- 172.21.15.46:0/1584679484 learned_addr learned my addr 172.21.15.46:0/1584679484 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338259c640 1 --2- 172.21.15.46:0/1584679484 >> v2:172.21.15.107:3300/0 conn(0x7f3384151ef0 0x7f33840aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241825512 0 0) 0x7f33840733b0 con 0x7f3384154720 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3370003520 con 0x7f3384154720 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156793528 0 0) 0x7f33840ab290 con 0x7f33840a91e0 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33840733b0 con 0x7f33840a91e0 2024-05-09T02:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 968893378 0 0) 0x7f3370003520 con 0x7f3384154720 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 >> v2:172.21.15.107:3300/0 conn(0x7f3384151ef0 msgr2=0x7f33840aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 --2- 172.21.15.46:0/1584679484 >> v2:172.21.15.107:3300/0 conn(0x7f3384151ef0 0x7f33840aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 >> v1:172.21.15.107:6789/0 conn(0x7f33840a91e0 legacy=0x7f3384073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3384073620 con 0x7f3384154720 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f337c0016f0 con 0x7f3384154720 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 >> v1:172.21.15.46:6789/0 conn(0x7f3384154720 legacy=0x7f33840c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3370003c30 0x7f3370004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370004800 0x7f3370004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3370005280 0x7f337000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f33840ab570 con 0x7f3370005280 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f337000c230 con 0x7f3370004800 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.971+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f337000c430 con 0x7f3370003c30 2024-05-09T02:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f338259c640 1 --2- 172.21.15.46:0/1584679484 >> v2:172.21.15.107:3300/0 conn(0x7f3384151ef0 0x7f33840aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3370005280 0x7f337000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3381d9b640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370004800 0x7f3370004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f338259c640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3370003c30 0x7f3370004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3382d9d640 1 -- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3370003c30 msgr2=0x7f3370004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3370003c30 0x7f3370004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3382d9d640 1 -- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370004800 msgr2=0x7f3370004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370004800 0x7f3370004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f3382d9d640 1 -- 172.21.15.46:0/1584679484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3370003520 con 0x7f3370005280 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.972+0000 7f338259c640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3370003c30 0x7f3370004080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f3382d9d640 1 -- 172.21.15.46:0/1584679484 reap_dead start 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3370005280 0x7f337000b9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c160 tx=0x7f3370005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4075a539d58f77d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c007ca0 con 0x7f3370005280 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c005af0 con 0x7f3370005280 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f338159a640 1 -- 172.21.15.46:0/1584679484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c007070 con 0x7f3370005280 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f3388b01640 1 -- 172.21.15.46:0/1584679484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3370005280 msgr2=0x7f337000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.973+0000 7f3388b01640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3370005280 0x7f337000b9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c160 tx=0x7f3370005830 comp rx=0 tx=0).stop 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.974+0000 7f3388b01640 1 -- 172.21.15.46:0/1584679484 shutdown_connections 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.974+0000 7f3388b01640 1 --2- 172.21.15.46:0/1584679484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3370005280 0x7f337000b9c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.974+0000 7f3388b01640 1 -- 172.21.15.46:0/1584679484 >> 172.21.15.46:0/1584679484 conn(0x7f33840c5940 msgr2=0x7f33840c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.974+0000 7f3388b01640 1 -- 172.21.15.46:0/1584679484 shutdown_connections 2024-05-09T02:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.974+0000 7f3388b01640 1 -- 172.21.15.46:0/1584679484 wait complete. 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.976+0000 7f3388b01640 1 Processor -- start 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.976+0000 7f3388b01640 1 -- start start 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3388b01640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370005280 0x7f338414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3388b01640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33841eeb40 0x7f338414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3388b01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 0x7f338414b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3388b01640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f33840c55e0 con 0x7f33841eef50 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3388b01640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f33840c5460 con 0x7f3370005280 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3388b01640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3384154b30 con 0x7f33841eeb40 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 0x7f338414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 0x7f338414b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45270/0 (socket says 172.21.15.46:45270) 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 -- 172.21.15.46:0/1084918385 learned_addr learned my addr 172.21.15.46:0/1084918385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 -- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33841eeb40 msgr2=0x7f338414dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33841eeb40 0x7f338414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 -- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370005280 msgr2=0x7f338414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370005280 0x7f338414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 -- 172.21.15.46:0/1084918385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33840aec10 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.977+0000 7f3382d9d640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 0x7f338414b960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c280 tx=0x7f33840737f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.978+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c001be0 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.978+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c040070 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.978+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33841ef410 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.978+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c004a00 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.978+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338414e730 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.979+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f338406a330 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.979+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f337c03a070 con 0x7f33841eef50 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.980+0000 7f337affd640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3364076300 0x7f3364078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.980+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f337c0b7370 con 0x7f33841eef50 2024-05-09T02:19:39.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.980+0000 7f338259c640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3364076300 0x7f3364078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:39.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.981+0000 7f338259c640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3364076300 0x7f3364078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3374007440 tx=0x7f3374009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:39.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:39.985+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f337c080840 con 0x7f33841eef50 2024-05-09T02:19:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.212+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33840730f0 con 0x7f33841eef50 2024-05-09T02:19:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.213+0000 7f337affd640 1 -- 172.21.15.46:0/1084918385 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f337c080140 con 0x7f33841eef50 2024-05-09T02:19:40.214 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:40.215 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3364076300 msgr2=0x7f3364078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3364076300 0x7f3364078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3374007440 tx=0x7f3374009750 comp rx=0 tx=0).stop 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 msgr2=0x7f338414b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 0x7f338414b960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c280 tx=0x7f33840737f0 comp rx=0 tx=0).stop 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 shutdown_connections 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3364076300 0x7f3364078810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33841eef50 0x7f338414b960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33841eeb40 0x7f338414dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 --2- 172.21.15.46:0/1084918385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3370005280 0x7f338414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 >> 172.21.15.46:0/1084918385 conn(0x7f33840c5940 msgr2=0x7f33840c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 shutdown_connections 2024-05-09T02:19:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:40.215+0000 7f3388b01640 1 -- 172.21.15.46:0/1084918385 wait complete. 2024-05-09T02:19:40.231 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:42.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:42.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.359+0000 7f46f19ce640 1 Processor -- start 2024-05-09T02:19:42.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.360+0000 7f46f19ce640 1 -- start start 2024-05-09T02:19:42.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46f19ce640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f46ec155160 0x7f46ec0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46f19ce640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec15b3a0 0x7f46ec15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46f19ce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec158ae0 con 0x7f46ec0c84a0 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46f19ce640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec155570 con 0x7f46ec155160 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46f19ce640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec157ed0 con 0x7f46ec15b3a0 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f46ec155160 0x7f46ec0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f46ec155160 0x7f46ec0c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45282/0 (socket says 172.21.15.46:45282) 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 -- 172.21.15.46:0/1330805235 learned_addr learned my addr 172.21.15.46:0/1330805235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eb7fe640 1 --2- 172.21.15.46:0/1330805235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec15b3a0 0x7f46ec15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 -- 172.21.15.46:0/1330805235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec15b3a0 msgr2=0x7f46ec15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 --2- 172.21.15.46:0/1330805235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec15b3a0 0x7f46ec15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 -- 172.21.15.46:0/1330805235 >> v1:172.21.15.107:6789/0 conn(0x7f46ec0c84a0 legacy=0x7f46ec0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.361+0000 7f46eaffd640 1 -- 172.21.15.46:0/1330805235 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec1581b0 con 0x7f46ec155160 2024-05-09T02:19:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.362+0000 7f46eaffd640 1 --2- 172.21.15.46:0/1330805235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec155160 0x7f46ec0c7f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e50 tx=0x7f46dc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d291e0ad8718d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:42.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.362+0000 7f46e9ffb640 1 -- 172.21.15.46:0/1330805235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc036070 con 0x7f46ec155160 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.362+0000 7f46e9ffb640 1 -- 172.21.15.46:0/1330805235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc031600 con 0x7f46ec155160 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.362+0000 7f46e9ffb640 1 -- 172.21.15.46:0/1330805235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0319d0 con 0x7f46ec155160 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 -- 172.21.15.46:0/1330805235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec155160 msgr2=0x7f46ec0c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 --2- 172.21.15.46:0/1330805235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec155160 0x7f46ec0c7f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e50 tx=0x7f46dc02a5f0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 -- 172.21.15.46:0/1330805235 shutdown_connections 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 --2- 172.21.15.46:0/1330805235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec15b3a0 0x7f46ec15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 --2- 172.21.15.46:0/1330805235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec155160 0x7f46ec0c7f60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 -- 172.21.15.46:0/1330805235 >> 172.21.15.46:0/1330805235 conn(0x7f46ec0aebe0 msgr2=0x7f46ec0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 -- 172.21.15.46:0/1330805235 shutdown_connections 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.363+0000 7f46f19ce640 1 -- 172.21.15.46:0/1330805235 wait complete. 2024-05-09T02:19:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.365+0000 7f46f19ce640 1 Processor -- start 2024-05-09T02:19:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.365+0000 7f46f19ce640 1 -- start start 2024-05-09T02:19:42.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46f19ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46ec0c84a0 0x7f46ec150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46f19ce640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec155160 0x7f46ec14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46f19ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 0x7f46ec144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46f19ce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec157b30 con 0x7f46ec15b3a0 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46f19ce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec158770 con 0x7f46ec0c84a0 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46f19ce640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec157cb0 con 0x7f46ec155160 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.366+0000 7f46eb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 0x7f46ec144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:42.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 0x7f46ec144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45296/0 (socket says 172.21.15.46:45296) 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 -- 172.21.15.46:0/3897594109 learned_addr learned my addr 172.21.15.46:0/3897594109 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46ea7fc640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec155160 0x7f46ec14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eaffd640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46ec0c84a0 0x7f46ec150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 -- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec155160 msgr2=0x7f46ec14fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec155160 0x7f46ec14fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 -- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46ec0c84a0 msgr2=0x7f46ec150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46ec0c84a0 0x7f46ec150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 -- 172.21.15.46:0/3897594109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec14f750 con 0x7f46ec15b3a0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46eb7fe640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 0x7f46ec144670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f46e400d510 tx=0x7f46e400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40125f0 con 0x7f46ec15b3a0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4019070 con 0x7f46ec15b3a0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec152b20 con 0x7f46ec15b3a0 2024-05-09T02:19:42.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40129f0 con 0x7f46ec15b3a0 2024-05-09T02:19:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.367+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec1530e0 con 0x7f46ec15b3a0 2024-05-09T02:19:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.368+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec1559f0 con 0x7f46ec15b3a0 2024-05-09T02:19:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.369+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46e4012b90 con 0x7f46ec15b3a0 2024-05-09T02:19:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.370+0000 7f46e3fff640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f46cc076300 0x7f46cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.370+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f46e4098630 con 0x7f46ec15b3a0 2024-05-09T02:19:42.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.370+0000 7f46eaffd640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f46cc076300 0x7f46cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:42.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.371+0000 7f46eaffd640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f46cc076300 0x7f46cc078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46dc033000 tx=0x7f46dc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:42.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.374+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f46e4061620 con 0x7f46ec15b3a0 2024-05-09T02:19:42.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.604+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46ec1eeb40 con 0x7f46ec15b3a0 2024-05-09T02:19:42.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.604+0000 7f46e3fff640 1 -- 172.21.15.46:0/3897594109 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f46e4065920 con 0x7f46ec15b3a0 2024-05-09T02:19:42.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:42.607 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.606+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f46cc076300 msgr2=0x7f46cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.606+0000 7f46f19ce640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f46cc076300 0x7f46cc078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46dc033000 tx=0x7f46dc009000 comp rx=0 tx=0).stop 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.606+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 msgr2=0x7f46ec144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.606+0000 7f46f19ce640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 0x7f46ec144670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f46e400d510 tx=0x7f46e400d9d0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 shutdown_connections 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f46cc076300 0x7f46cc078810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46ec15b3a0 0x7f46ec144670 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46ec155160 0x7f46ec14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 --2- 172.21.15.46:0/3897594109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46ec0c84a0 0x7f46ec150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 >> 172.21.15.46:0/3897594109 conn(0x7f46ec0aebe0 msgr2=0x7f46ec0c33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 shutdown_connections 2024-05-09T02:19:42.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:42.607+0000 7f46f19ce640 1 -- 172.21.15.46:0/3897594109 wait complete. 2024-05-09T02:19:42.619 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:44.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:44.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.747+0000 7f05a5e78640 1 Processor -- start 2024-05-09T02:19:44.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.747+0000 7f05a5e78640 1 -- start start 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f05a5e78640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f05a00c96c0 0x7f05a00c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f05a5e78640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a0158ae0 con 0x7f05a015b3a0 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f05a5e78640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a0155570 con 0x7f05a0155160 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f05a5e78640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f05a0157ed0 con 0x7f05a00c96c0 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f059ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f05a015b3a0 0x7f05a015b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32910/0 (socket says 172.21.15.46:32910) 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f059ffff640 1 -- 172.21.15.46:0/3863990605 learned_addr learned my addr 172.21.15.46:0/3863990605 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.748+0000 7f059effd640 1 --2- 172.21.15.46:0/3863990605 >> v2:172.21.15.107:3300/0 conn(0x7f05a00c96c0 0x7f05a00c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098773130 0 0) 0x7f05a0158ae0 con 0x7f05a015b3a0 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0588003520 con 0x7f05a015b3a0 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183005272 0 0) 0x7f05a0155570 con 0x7f05a0155160 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a0158ae0 con 0x7f05a0155160 2024-05-09T02:19:44.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059effd640 1 -- 172.21.15.46:0/3863990605 >> v1:172.21.15.107:6789/0 conn(0x7f05a0155160 legacy=0x7f05a00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:44.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059effd640 1 -- 172.21.15.46:0/3863990605 >> v1:172.21.15.46:6789/0 conn(0x7f05a015b3a0 legacy=0x7f05a015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:44.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.749+0000 7f059effd640 1 -- 172.21.15.46:0/3863990605 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a01581b0 con 0x7f05a00c96c0 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f059effd640 1 --2- 172.21.15.46:0/3863990605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a00c96c0 0x7f05a00c9ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05940097a0 tx=0x7f059402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909ffe11ad44c573 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594037070 con 0x7f05a00c96c0 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0594032440 con 0x7f05a00c96c0 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f059e7fc640 1 -- 172.21.15.46:0/3863990605 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059402ae60 con 0x7f05a00c96c0 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f05a5e78640 1 -- 172.21.15.46:0/3863990605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a00c96c0 msgr2=0x7f05a00c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f05a5e78640 1 --2- 172.21.15.46:0/3863990605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a00c96c0 0x7f05a00c9ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05940097a0 tx=0x7f059402a110 comp rx=0 tx=0).stop 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f05a5e78640 1 -- 172.21.15.46:0/3863990605 shutdown_connections 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f05a5e78640 1 --2- 172.21.15.46:0/3863990605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a00c96c0 0x7f05a00c9ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.750+0000 7f05a5e78640 1 -- 172.21.15.46:0/3863990605 >> 172.21.15.46:0/3863990605 conn(0x7f05a00aebe0 msgr2=0x7f05a00aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.751+0000 7f05a5e78640 1 -- 172.21.15.46:0/3863990605 shutdown_connections 2024-05-09T02:19:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.751+0000 7f05a5e78640 1 -- 172.21.15.46:0/3863990605 wait complete. 2024-05-09T02:19:44.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.752+0000 7f05a5e78640 1 Processor -- start 2024-05-09T02:19:44.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.752+0000 7f05a5e78640 1 -- start start 2024-05-09T02:19:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f05a5e78640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 0x7f05a01f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f05a5e78640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a0155160 0x7f05a01eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f05a5e78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a015b3a0 0x7f05a0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f05a5e78640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f05a00c8670 con 0x7f05a00c96c0 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f05a5e78640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0158770 con 0x7f05a015b3a0 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f05a5e78640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05a0157b30 con 0x7f05a0155160 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 0x7f05a01f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 0x7f05a01f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45302/0 (socket says 172.21.15.46:45302) 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 -- 172.21.15.46:0/2157713814 learned_addr learned my addr 172.21.15.46:0/2157713814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059ffff640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a015b3a0 0x7f05a0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059effd640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a0155160 0x7f05a01eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 -- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a0155160 msgr2=0x7f05a01eeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a0155160 0x7f05a01eeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 -- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a015b3a0 msgr2=0x7f05a0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a015b3a0 0x7f05a0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 -- 172.21.15.46:0/2157713814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a01eeff0 con 0x7f05a00c96c0 2024-05-09T02:19:44.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.754+0000 7f059f7fe640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 0x7f05a01f15e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f059000c3c0 tx=0x7f059000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:44.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.755+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590017070 con 0x7f05a00c96c0 2024-05-09T02:19:44.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.755+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05900052d0 con 0x7f05a00c96c0 2024-05-09T02:19:44.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.755+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a00c6600 con 0x7f05a00c96c0 2024-05-09T02:19:44.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.755+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590003830 con 0x7f05a00c96c0 2024-05-09T02:19:44.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.755+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a01ee2b0 con 0x7f05a00c96c0 2024-05-09T02:19:44.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.756+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a015aec0 con 0x7f05a00c96c0 2024-05-09T02:19:44.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.757+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f059001a070 con 0x7f05a00c96c0 2024-05-09T02:19:44.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.757+0000 7f0587fff640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f058c076300 0x7f058c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:44.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.757+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f0590096c20 con 0x7f05a00c96c0 2024-05-09T02:19:44.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.758+0000 7f059effd640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f058c076300 0x7f058c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:44.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.758+0000 7f059effd640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f058c076300 0x7f058c078810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0594034000 tx=0x7f059402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:44.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.762+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05a015aec0 con 0x7f05a00c96c0 2024-05-09T02:19:44.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.995+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05a01ee0a0 con 0x7f05a00c96c0 2024-05-09T02:19:44.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.996+0000 7f0587fff640 1 -- 172.21.15.46:0/2157713814 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f0590068170 con 0x7f05a00c96c0 2024-05-09T02:19:44.999 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:44.999 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:44.999 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f058c076300 msgr2=0x7f058c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f058c076300 0x7f058c078810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0594034000 tx=0x7f059402e000 comp rx=0 tx=0).stop 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 msgr2=0x7f05a01f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 0x7f05a01f15e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f059000c3c0 tx=0x7f059000c880 comp rx=0 tx=0).stop 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 shutdown_connections 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f058c076300 0x7f058c078810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a015b3a0 0x7f05a0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:45.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a0155160 0x7f05a01eeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:45.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 --2- 172.21.15.46:0/2157713814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a00c96c0 0x7f05a01f15e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:45.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 >> 172.21.15.46:0/2157713814 conn(0x7f05a00aebe0 msgr2=0x7f05a00c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:45.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 shutdown_connections 2024-05-09T02:19:45.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:44.998+0000 7f05a5e78640 1 -- 172.21.15.46:0/2157713814 wait complete. 2024-05-09T02:19:45.012 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:46.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:19:46.504 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:19:47.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.140+0000 7f3f11f84640 1 Processor -- start 2024-05-09T02:19:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.140+0000 7f3f11f84640 1 -- start start 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f11f84640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3f0c0c6d70 0x7f3f0c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f11f84640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3f0c0c92f0 0x7f3f0c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f11f84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f11f84640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c0c2690 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f11f84640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c158580 con 0x7f3f0c0c92f0 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f11f84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c158860 con 0x7f3f0c0c9c40 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.141+0000 7f3f0b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3f0c0c6d70 0x7f3f0c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3f0c0c6d70 0x7f3f0c154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43448/0 (socket says 172.21.15.46:43448) 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/3075642336 learned_addr learned my addr 172.21.15.46:0/3075642336 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0affd640 1 --2- 172.21.15.46:0/3075642336 >> v2:172.21.15.107:3300/0 conn(0x7f3f0c0c92f0 0x7f3f0c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0bfff640 1 --2- 172.21.15.46:0/3075642336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/3075642336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 msgr2=0x7f3f0c0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 --2- 172.21.15.46:0/3075642336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c0c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/3075642336 >> v2:172.21.15.107:3300/0 conn(0x7f3f0c0c92f0 msgr2=0x7f3f0c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 --2- 172.21.15.46:0/3075642336 >> v2:172.21.15.107:3300/0 conn(0x7f3f0c0c92f0 0x7f3f0c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/3075642336 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c0c2040 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.142+0000 7f3f0affd640 1 --2- 172.21.15.46:0/3075642336 >> v2:172.21.15.107:3300/0 conn(0x7f3f0c0c92f0 0x7f3f0c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.143+0000 7f3f0b7fe640 1 --2- 172.21.15.46:0/3075642336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c154fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0c4f40 tx=0x7f3efc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82578e41fb1d3652 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.143+0000 7f3f0a7fc640 1 -- 172.21.15.46:0/3075642336 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc037070 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.143+0000 7f3f0a7fc640 1 -- 172.21.15.46:0/3075642336 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc02ae00 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.143+0000 7f3f0a7fc640 1 -- 172.21.15.46:0/3075642336 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc032660 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 -- 172.21.15.46:0/3075642336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 msgr2=0x7f3f0c154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 --2- 172.21.15.46:0/3075642336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c154fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0c4f40 tx=0x7f3efc02a0b0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 -- 172.21.15.46:0/3075642336 shutdown_connections 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 --2- 172.21.15.46:0/3075642336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 --2- 172.21.15.46:0/3075642336 >> v2:172.21.15.107:3300/0 conn(0x7f3f0c0c92f0 0x7f3f0c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 --2- 172.21.15.46:0/3075642336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c154fd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 -- 172.21.15.46:0/3075642336 >> 172.21.15.46:0/3075642336 conn(0x7f3f0c06e8f0 msgr2=0x7f3f0c06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 -- 172.21.15.46:0/3075642336 shutdown_connections 2024-05-09T02:19:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.144+0000 7f3f11f84640 1 -- 172.21.15.46:0/3075642336 wait complete. 2024-05-09T02:19:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.145+0000 7f3f11f84640 1 Processor -- start 2024-05-09T02:19:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.146+0000 7f3f11f84640 1 -- start start 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f11f84640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f11f84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f0c0c92f0 0x7f3f0c1eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f11f84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f11f84640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0c7ed0 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f11f84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0c7d50 con 0x7f3f0c0c92f0 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f11f84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c0c8050 con 0x7f3f0c0c9c40 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43458/0 (socket says 172.21.15.46:43458) 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/4114331301 learned_addr learned my addr 172.21.15.46:0/4114331301 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0bfff640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0affd640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f0c0c92f0 0x7f3f0c1eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 msgr2=0x7f3f0c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f0c0c92f0 msgr2=0x7f3f0c1eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f0c0c92f0 0x7f3f0c1eeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.147+0000 7f3f0b7fe640 1 -- 172.21.15.46:0/4114331301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c1ee100 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.148+0000 7f3f0b7fe640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c0cc170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3efc02a0f0 tx=0x7f3efc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.148+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc041030 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.148+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc02ac00 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.148+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c0cab90 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.148+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc037040 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.148+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c0cb150 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.149+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0c06a330 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.150+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3efc044070 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.150+0000 7f3ef3fff640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ef80762d0 0x7f3ef80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.150+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f3efc0b7d70 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.150+0000 7f3f0affd640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ef80762d0 0x7f3ef80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.151+0000 7f3f0affd640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ef80762d0 0x7f3ef80787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c15bf30 tx=0x7f3f00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.155+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3efc080c00 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.383+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f0c069e80 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.384+0000 7f3ef3fff640 1 -- 172.21.15.46:0/4114331301 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f3efc089240 con 0x7f3f0c0c6d70 2024-05-09T02:19:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:47.391 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.386+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ef80762d0 msgr2=0x7f3ef80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.386+0000 7f3f11f84640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ef80762d0 0x7f3ef80787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c15bf30 tx=0x7f3f00008040 comp rx=0 tx=0).stop 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.386+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 msgr2=0x7f3f0c0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.386+0000 7f3f11f84640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c0cc170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3efc02a0f0 tx=0x7f3efc0046c0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 shutdown_connections 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ef80762d0 0x7f3ef80787e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f0c0c9c40 0x7f3f0c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f0c0c92f0 0x7f3f0c1eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 --2- 172.21.15.46:0/4114331301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f0c0c6d70 0x7f3f0c0cc170 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:47.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 >> 172.21.15.46:0/4114331301 conn(0x7f3f0c06e8f0 msgr2=0x7f3f0c1579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 shutdown_connections 2024-05-09T02:19:47.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:47.387+0000 7f3f11f84640 1 -- 172.21.15.46:0/4114331301 wait complete. 2024-05-09T02:19:47.400 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:49.401 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.528+0000 7f7d78ea8640 1 Processor -- start 2024-05-09T02:19:49.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.528+0000 7f7d78ea8640 1 -- start start 2024-05-09T02:19:49.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d78ea8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d74155160 0x7f7d740c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d78ea8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7d7415b3a0 0x7f7d7415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d78ea8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d74158ae0 con 0x7f7d740c84a0 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d78ea8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f7d74155570 con 0x7f7d74155160 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d78ea8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7d74157ed0 con 0x7f7d7415b3a0 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d7259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d74155160 0x7f7d740c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d71d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7d740c84a0 0x7f7d740c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39268/0 (socket says 172.21.15.46:39268) 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d71d9b640 1 -- 172.21.15.46:0/2445289179 learned_addr learned my addr 172.21.15.46:0/2445289179 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d72d9d640 1 --2- 172.21.15.46:0/2445289179 >> v2:172.21.15.107:3300/0 conn(0x7f7d7415b3a0 0x7f7d7415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d7259c640 1 -- 172.21.15.46:0/2445289179 >> v2:172.21.15.107:3300/0 conn(0x7f7d7415b3a0 msgr2=0x7f7d7415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:49.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.530+0000 7f7d7259c640 1 --2- 172.21.15.46:0/2445289179 >> v2:172.21.15.107:3300/0 conn(0x7f7d7415b3a0 0x7f7d7415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d7259c640 1 -- 172.21.15.46:0/2445289179 >> v1:172.21.15.46:6789/0 conn(0x7f7d740c84a0 legacy=0x7f7d740c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:49.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d7259c640 1 -- 172.21.15.46:0/2445289179 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d741581b0 con 0x7f7d74155160 2024-05-09T02:19:49.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d7159a640 1 -- 172.21.15.46:0/2445289179 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495528588 0 0) 0x7f7d74158ae0 con 0x7f7d740c84a0 2024-05-09T02:19:49.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d72d9d640 1 --2- 172.21.15.46:0/2445289179 >> v2:172.21.15.107:3300/0 conn(0x7f7d7415b3a0 0x7f7d7415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:19:49.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d7259c640 1 --2- 172.21.15.46:0/2445289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d74155160 0x7f7d740c7f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d740c3e30 tx=0x7f7d5c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19f940a80e5f484 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:49.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d7159a640 1 -- 172.21.15.46:0/2445289179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c037070 con 0x7f7d74155160 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.531+0000 7f7d7159a640 1 -- 172.21.15.46:0/2445289179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c02add0 con 0x7f7d74155160 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d7159a640 1 -- 172.21.15.46:0/2445289179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c032660 con 0x7f7d74155160 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 -- 172.21.15.46:0/2445289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d74155160 msgr2=0x7f7d740c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/2445289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d74155160 0x7f7d740c7f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d740c3e30 tx=0x7f7d5c02a080 comp rx=0 tx=0).stop 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 -- 172.21.15.46:0/2445289179 shutdown_connections 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/2445289179 >> v2:172.21.15.107:3300/0 conn(0x7f7d7415b3a0 0x7f7d7415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/2445289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d74155160 0x7f7d740c7f60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 -- 172.21.15.46:0/2445289179 >> 172.21.15.46:0/2445289179 conn(0x7f7d740aebe0 msgr2=0x7f7d740aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 -- 172.21.15.46:0/2445289179 shutdown_connections 2024-05-09T02:19:49.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.532+0000 7f7d78ea8640 1 -- 172.21.15.46:0/2445289179 wait complete. 2024-05-09T02:19:49.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.534+0000 7f7d78ea8640 1 Processor -- start 2024-05-09T02:19:49.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.534+0000 7f7d78ea8640 1 -- start start 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.535+0000 7f7d78ea8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d740c84a0 0x7f7d741eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.535+0000 7f7d78ea8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d74155160 0x7f7d74152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d78ea8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 0x7f7d741446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d78ea8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74157b30 con 0x7f7d7415b3a0 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d78ea8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74158770 con 0x7f7d74155160 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d78ea8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d74157cb0 con 0x7f7d740c84a0 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 0x7f7d741446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 0x7f7d741446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43484/0 (socket says 172.21.15.46:43484) 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 -- 172.21.15.46:0/3488036252 learned_addr learned my addr 172.21.15.46:0/3488036252 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d71d9b640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d74155160 0x7f7d74152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d7259c640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d740c84a0 0x7f7d741eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 -- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d740c84a0 msgr2=0x7f7d741eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d740c84a0 0x7f7d741eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 -- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d74155160 msgr2=0x7f7d74152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d74155160 0x7f7d74152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 -- 172.21.15.46:0/3488036252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d741f1000 con 0x7f7d7415b3a0 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d72d9d640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 0x7f7d741446e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c007ea0 tx=0x7f7d6c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c01a070 con 0x7f7d7415b3a0 2024-05-09T02:19:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.536+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d6c003bb0 con 0x7f7d7415b3a0 2024-05-09T02:19:49.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.537+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d741f12a0 con 0x7f7d7415b3a0 2024-05-09T02:19:49.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.537+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00de70 con 0x7f7d7415b3a0 2024-05-09T02:19:49.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.537+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741f1860 con 0x7f7d7415b3a0 2024-05-09T02:19:49.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.537+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d7406a330 con 0x7f7d7415b3a0 2024-05-09T02:19:49.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.538+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d6c005d10 con 0x7f7d7415b3a0 2024-05-09T02:19:49.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.539+0000 7f7d6affd640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7d54076300 0x7f7d54078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:49.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.539+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f7d6c098010 con 0x7f7d7415b3a0 2024-05-09T02:19:49.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.539+0000 7f7d7259c640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7d54076300 0x7f7d54078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:49.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.540+0000 7f7d7259c640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7d54076300 0x7f7d54078810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c034000 tx=0x7f7d5c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:49.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.543+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d6c024080 con 0x7f7d7415b3a0 2024-05-09T02:19:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.779+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d740c71e0 con 0x7f7d7415b3a0 2024-05-09T02:19:49.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.780+0000 7f7d6affd640 1 -- 172.21.15.46:0/3488036252 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f7d6c010070 con 0x7f7d7415b3a0 2024-05-09T02:19:49.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:49.783 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:49.783 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7d54076300 msgr2=0x7f7d54078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7d54076300 0x7f7d54078810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c034000 tx=0x7f7d5c02e000 comp rx=0 tx=0).stop 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 msgr2=0x7f7d741446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 0x7f7d741446e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c007ea0 tx=0x7f7d6c007f90 comp rx=0 tx=0).stop 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 shutdown_connections 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7d54076300 0x7f7d54078810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d7415b3a0 0x7f7d741446e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d74155160 0x7f7d74152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 --2- 172.21.15.46:0/3488036252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d740c84a0 0x7f7d741eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 >> 172.21.15.46:0/3488036252 conn(0x7f7d740aebe0 msgr2=0x7f7d7414d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 shutdown_connections 2024-05-09T02:19:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:49.782+0000 7f7d78ea8640 1 -- 172.21.15.46:0/3488036252 wait complete. 2024-05-09T02:19:49.797 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:51.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.910+0000 7fcc7d95e640 1 Processor -- start 2024-05-09T02:19:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.910+0000 7fcc7d95e640 1 -- start start 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc7d95e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc7d95e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcc78155100 0x7fcc7815b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc7d95e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc780c9410 con 0x7fcc7815bb60 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc7d95e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcc780c96f0 con 0x7fcc78155100 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc7d95e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc780c8ee0 con 0x7fcc780c5790 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc777fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcc7815bb60 0x7fcc780ca0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39274/0 (socket says 172.21.15.46:39274) 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc777fe640 1 -- 172.21.15.46:0/1369305804 learned_addr learned my addr 172.21.15.46:0/1369305804 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc767fc640 1 --2- 172.21.15.46:0/1369305804 >> v2:172.21.15.107:3300/0 conn(0x7fcc78155100 0x7fcc7815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.911+0000 7fcc76ffd640 1 --2- 172.21.15.46:0/1369305804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc75ffb640 1 -- 172.21.15.46:0/1369305804 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161537084 0 0) 0x7fcc780c9410 con 0x7fcc7815bb60 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc75ffb640 1 -- 172.21.15.46:0/1369305804 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc60003520 con 0x7fcc7815bb60 2024-05-09T02:19:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc76ffd640 1 -- 172.21.15.46:0/1369305804 >> v2:172.21.15.107:3300/0 conn(0x7fcc78155100 msgr2=0x7fcc7815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc76ffd640 1 --2- 172.21.15.46:0/1369305804 >> v2:172.21.15.107:3300/0 conn(0x7fcc78155100 0x7fcc7815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc76ffd640 1 -- 172.21.15.46:0/1369305804 >> v1:172.21.15.46:6789/0 conn(0x7fcc7815bb60 legacy=0x7fcc780ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc76ffd640 1 -- 172.21.15.46:0/1369305804 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7815b100 con 0x7fcc780c5790 2024-05-09T02:19:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.912+0000 7fcc767fc640 1 --2- 172.21.15.46:0/1369305804 >> v2:172.21.15.107:3300/0 conn(0x7fcc78155100 0x7fcc7815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc76ffd640 1 --2- 172.21.15.46:0/1369305804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781579f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc680097a0 tx=0x7fcc6802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=505bbe882d060456 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc75ffb640 1 -- 172.21.15.46:0/1369305804 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68037070 con 0x7fcc780c5790 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc75ffb640 1 -- 172.21.15.46:0/1369305804 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6802adb0 con 0x7fcc780c5790 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc75ffb640 1 -- 172.21.15.46:0/1369305804 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68032660 con 0x7fcc780c5790 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc7d95e640 1 -- 172.21.15.46:0/1369305804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 msgr2=0x7fcc781579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/1369305804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781579f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc680097a0 tx=0x7fcc6802a060 comp rx=0 tx=0).stop 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc7d95e640 1 -- 172.21.15.46:0/1369305804 shutdown_connections 2024-05-09T02:19:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/1369305804 >> v2:172.21.15.107:3300/0 conn(0x7fcc78155100 0x7fcc7815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/1369305804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781579f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.913+0000 7fcc7d95e640 1 -- 172.21.15.46:0/1369305804 >> 172.21.15.46:0/1369305804 conn(0x7fcc7806cb10 msgr2=0x7fcc7806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.914+0000 7fcc7d95e640 1 -- 172.21.15.46:0/1369305804 shutdown_connections 2024-05-09T02:19:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.914+0000 7fcc7d95e640 1 -- 172.21.15.46:0/1369305804 wait complete. 2024-05-09T02:19:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.915+0000 7fcc7d95e640 1 Processor -- start 2024-05-09T02:19:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.915+0000 7fcc7d95e640 1 -- start start 2024-05-09T02:19:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc7d95e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc7d95e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc78155100 0x7fcc781f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc7d95e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc7815bb60 0x7fcc7814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc7d95e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780c9a40 con 0x7fcc78155100 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc7d95e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780c98c0 con 0x7fcc7815bb60 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc7d95e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc78072aa0 con 0x7fcc780c5790 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc767fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc78155100 0x7fcc781f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:40472/0 (socket says 172.21.15.46:40472) 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 -- 172.21.15.46:0/3658750300 learned_addr learned my addr 172.21.15.46:0/3658750300 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc777fe640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc7815bb60 0x7fcc7814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 -- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc7815bb60 msgr2=0x7fcc7814d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc7815bb60 0x7fcc7814d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 -- 172.21.15.46:0/3658750300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc78155100 msgr2=0x7fcc781f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc78155100 0x7fcc781f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 -- 172.21.15.46:0/3658750300 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc780c0570 con 0x7fcc780c5790 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc767fc640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc78155100 0x7fcc781f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.917+0000 7fcc76ffd640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781501a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcc68035040 tx=0x7fcc680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.918+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68041070 con 0x7fcc780c5790 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.918+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6803c460 con 0x7fcc780c5790 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.918+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68037040 con 0x7fcc780c5790 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.918+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc781f1790 con 0x7fcc780c5790 2024-05-09T02:19:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.918+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc780c1720 con 0x7fcc780c5790 2024-05-09T02:19:51.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.919+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7806a330 con 0x7fcc780c5790 2024-05-09T02:19:51.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.920+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc6803a070 con 0x7fcc780c5790 2024-05-09T02:19:51.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.920+0000 7fcc5ffff640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcc640762d0 0x7fcc640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:51.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.920+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7fcc680b7b90 con 0x7fcc780c5790 2024-05-09T02:19:51.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.920+0000 7fcc767fc640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcc640762d0 0x7fcc640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:51.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.921+0000 7fcc767fc640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcc640762d0 0x7fcc640787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009560 tx=0x7fcc6c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:51.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:51.925+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc68080aa0 con 0x7fcc780c5790 2024-05-09T02:19:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.160+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc781f1a70 con 0x7fcc780c5790 2024-05-09T02:19:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.160+0000 7fcc5ffff640 1 -- 172.21.15.46:0/3658750300 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7fcc680890e0 con 0x7fcc780c5790 2024-05-09T02:19:52.164 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:52.164 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcc640762d0 msgr2=0x7fcc640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcc640762d0 0x7fcc640787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009560 tx=0x7fcc6c009190 comp rx=0 tx=0).stop 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 msgr2=0x7fcc781501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781501a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcc68035040 tx=0x7fcc680046c0 comp rx=0 tx=0).stop 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 shutdown_connections 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fcc640762d0 0x7fcc640787e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc7815bb60 0x7fcc7814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc78155100 0x7fcc781f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 --2- 172.21.15.46:0/3658750300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc780c5790 0x7fcc781501a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 >> 172.21.15.46:0/3658750300 conn(0x7fcc7806cb10 msgr2=0x7fcc781e0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 shutdown_connections 2024-05-09T02:19:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:52.163+0000 7fcc7d95e640 1 -- 172.21.15.46:0/3658750300 wait complete. 2024-05-09T02:19:52.177 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:54.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:54.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.292+0000 7f5512c19640 1 Processor -- start 2024-05-09T02:19:54.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.292+0000 7f5512c19640 1 -- start start 2024-05-09T02:19:54.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f5512c19640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c0c97c0 0x7f550c152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f5512c19640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f550c155830 0x7f550c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f5512c19640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f550c159070 con 0x7f550c074700 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f5512c19640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f550c158e20 con 0x7f550c155830 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f5512c19640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f550c159350 con 0x7f550c0c97c0 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f55111b6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f550c155830 0x7f550c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f550bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f550c074700 0x7f550c0af0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39290/0 (socket says 172.21.15.46:39290) 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f550bfff640 1 -- 172.21.15.46:0/308256206 learned_addr learned my addr 172.21.15.46:0/308256206 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.293+0000 7f55109b5640 1 --2- 172.21.15.46:0/308256206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c0c97c0 0x7f550c152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.294+0000 7f55111b6640 1 -- 172.21.15.46:0/308256206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c0c97c0 msgr2=0x7f550c152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.294+0000 7f55111b6640 1 --2- 172.21.15.46:0/308256206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c0c97c0 0x7f550c152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.294+0000 7f55111b6640 1 -- 172.21.15.46:0/308256206 >> v1:172.21.15.46:6789/0 conn(0x7f550c074700 legacy=0x7f550c0af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.294+0000 7f55111b6640 1 -- 172.21.15.46:0/308256206 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c159630 con 0x7f550c155830 2024-05-09T02:19:54.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.294+0000 7f550b7fe640 1 -- 172.21.15.46:0/308256206 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534519821 0 0) 0x7f550c159070 con 0x7f550c074700 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.295+0000 7f55111b6640 1 --2- 172.21.15.46:0/308256206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c155830 0x7f550c155c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5504009d90 tx=0x7f550402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c9a9b8aa253140 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.295+0000 7f550b7fe640 1 -- 172.21.15.46:0/308256206 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504007740 con 0x7f550c155830 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.295+0000 7f550b7fe640 1 -- 172.21.15.46:0/308256206 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55040078e0 con 0x7f550c155830 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.295+0000 7f550b7fe640 1 -- 172.21.15.46:0/308256206 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504007cb0 con 0x7f550c155830 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 -- 172.21.15.46:0/308256206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c155830 msgr2=0x7f550c155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 --2- 172.21.15.46:0/308256206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c155830 0x7f550c155c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5504009d90 tx=0x7f550402a5f0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 -- 172.21.15.46:0/308256206 shutdown_connections 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 --2- 172.21.15.46:0/308256206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c155830 0x7f550c155c40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 --2- 172.21.15.46:0/308256206 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c0c97c0 0x7f550c152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 -- 172.21.15.46:0/308256206 >> 172.21.15.46:0/308256206 conn(0x7f550c06de00 msgr2=0x7f550c0aba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:54.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 -- 172.21.15.46:0/308256206 shutdown_connections 2024-05-09T02:19:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.296+0000 7f5512c19640 1 -- 172.21.15.46:0/308256206 wait complete. 2024-05-09T02:19:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.298+0000 7f5512c19640 1 Processor -- start 2024-05-09T02:19:54.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.298+0000 7f5512c19640 1 -- start start 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f5512c19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 0x7f550c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f5512c19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f550c0c97c0 0x7f550c14e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f5512c19640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c155830 0x7f550c0c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f5512c19640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0af930 con 0x7f550c074700 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f5512c19640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0af7b0 con 0x7f550c0c97c0 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f5512c19640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f550c073df0 con 0x7f550c155830 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 0x7f550c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:54.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 0x7f550c14ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43514/0 (socket says 172.21.15.46:43514) 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 -- 172.21.15.46:0/161537861 learned_addr learned my addr 172.21.15.46:0/161537861 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55111b6640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c155830 0x7f550c0c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f550bfff640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f550c0c97c0 0x7f550c14e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 -- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c155830 msgr2=0x7f550c0c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c155830 0x7f550c0c3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 -- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f550c0c97c0 msgr2=0x7f550c14e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f550c0c97c0 0x7f550c14e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.299+0000 7f55109b5640 1 -- 172.21.15.46:0/161537861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c1f0ee0 con 0x7f550c074700 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.300+0000 7f55109b5640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 0x7f550c14ba60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f550000e8a0 tx=0x7f550000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.300+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500017070 con 0x7f550c074700 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.300+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550000c940 con 0x7f550c074700 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.300+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550000cd30 con 0x7f550c074700 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.300+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1f11c0 con 0x7f550c074700 2024-05-09T02:19:54.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.300+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1f1780 con 0x7f550c074700 2024-05-09T02:19:54.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.301+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c06a330 con 0x7f550c074700 2024-05-09T02:19:54.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.302+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f550001a070 con 0x7f550c074700 2024-05-09T02:19:54.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.303+0000 7f55097fa640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f54f0076300 0x7f54f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:54.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.303+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f5500097bb0 con 0x7f550c074700 2024-05-09T02:19:54.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.303+0000 7f550bfff640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f54f0076300 0x7f54f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:54.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.303+0000 7f550bfff640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f54f0076300 0x7f54f0078810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f54f8007fd0 tx=0x7f54f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:54.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.307+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5500060ac0 con 0x7f550c074700 2024-05-09T02:19:54.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.565+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f550c0a97e0 con 0x7f550c074700 2024-05-09T02:19:54.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.565+0000 7f55097fa640 1 -- 172.21.15.46:0/161537861 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6487 (secure 0 0 0) 0x7f5500064dc0 con 0x7f550c074700 2024-05-09T02:19:54.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:54.568 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:18:26.603395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6833/268323982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":268323982},{"type":"v1","addr":"172.21.15.46:6833","nonce":268323982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":2}]} 2024-05-09T02:19:54.569 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f54f0076300 msgr2=0x7f54f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f54f0076300 0x7f54f0078810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f54f8007fd0 tx=0x7f54f8009040 comp rx=0 tx=0).stop 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 msgr2=0x7f550c14ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 0x7f550c14ba60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f550000e8a0 tx=0x7f550000ed60 comp rx=0 tx=0).stop 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 shutdown_connections 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f54f0076300 0x7f54f0078810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f550c155830 0x7f550c0c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f550c0c97c0 0x7f550c14e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 --2- 172.21.15.46:0/161537861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550c074700 0x7f550c14ba60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:54.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 >> 172.21.15.46:0/161537861 conn(0x7f550c06de00 msgr2=0x7f550c1541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:54.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 shutdown_connections 2024-05-09T02:19:54.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:54.568+0000 7f5512c19640 1 -- 172.21.15.46:0/161537861 wait complete. 2024-05-09T02:19:54.582 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:19:56.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.695+0000 7fdb05114640 1 Processor -- start 2024-05-09T02:19:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.696+0000 7fdb05114640 1 -- start start 2024-05-09T02:19:56.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdb05114640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdb00155190 0x7fdb000c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:56.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdb05114640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb0015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:56.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdb05114640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb000c42e0 con 0x7fdb000c3ac0 2024-05-09T02:19:56.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdb05114640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdb000c30a0 con 0x7fdb00155190 2024-05-09T02:19:56.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdb05114640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdb000c3660 con 0x7fdb000c3ed0 2024-05-09T02:19:56.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdafed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdb00155190 0x7fdb000c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdafe59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fdb000c3ac0 0x7fdb0015b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:40246/0 (socket says 172.21.15.46:40246) 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdafe59c640 1 -- 172.21.15.46:0/336084006 learned_addr learned my addr 172.21.15.46:0/336084006 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdaff59e640 1 --2- 172.21.15.46:0/336084006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb0015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdaff59e640 1 -- 172.21.15.46:0/336084006 >> v2:172.21.15.107:3300/0 conn(0x7fdb00155190 msgr2=0x7fdb000c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdaff59e640 1 --2- 172.21.15.46:0/336084006 >> v2:172.21.15.107:3300/0 conn(0x7fdb00155190 0x7fdb000c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdaff59e640 1 -- 172.21.15.46:0/336084006 >> v1:172.21.15.107:6789/0 conn(0x7fdb000c3ac0 legacy=0x7fdb0015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdaff59e640 1 -- 172.21.15.46:0/336084006 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0015bdf0 con 0x7fdb000c3ed0 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdafdd9b640 1 -- 172.21.15.46:0/336084006 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920769894 0 0) 0x7fdb000c42e0 con 0x7fdb000c3ac0 2024-05-09T02:19:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.697+0000 7fdafed9d640 1 --2- 172.21.15.46:0/336084006 >> v2:172.21.15.107:3300/0 conn(0x7fdb00155190 0x7fdb000c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.698+0000 7fdaff59e640 1 --2- 172.21.15.46:0/336084006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb0015b8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009d90 tx=0x7fdaf002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63af76ef1a965c95 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.698+0000 7fdafdd9b640 1 -- 172.21.15.46:0/336084006 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0031600 con 0x7fdb000c3ed0 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.698+0000 7fdafdd9b640 1 -- 172.21.15.46:0/336084006 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf00317a0 con 0x7fdb000c3ed0 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.698+0000 7fdafdd9b640 1 -- 172.21.15.46:0/336084006 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0031b70 con 0x7fdb000c3ed0 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 -- 172.21.15.46:0/336084006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 msgr2=0x7fdb0015b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 --2- 172.21.15.46:0/336084006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb0015b8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009d90 tx=0x7fdaf002a5d0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 -- 172.21.15.46:0/336084006 shutdown_connections 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 --2- 172.21.15.46:0/336084006 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb0015b8b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 --2- 172.21.15.46:0/336084006 >> v2:172.21.15.107:3300/0 conn(0x7fdb00155190 0x7fdb000c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 -- 172.21.15.46:0/336084006 >> 172.21.15.46:0/336084006 conn(0x7fdb000c6770 msgr2=0x7fdb000c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 -- 172.21.15.46:0/336084006 shutdown_connections 2024-05-09T02:19:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.699+0000 7fdb05114640 1 -- 172.21.15.46:0/336084006 wait complete. 2024-05-09T02:19:56.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.701+0000 7fdb05114640 1 Processor -- start 2024-05-09T02:19:56.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.701+0000 7fdb05114640 1 -- start start 2024-05-09T02:19:56.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.702+0000 7fdb05114640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 0x7fdb0014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:56.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.702+0000 7fdb05114640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb000abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.702+0000 7fdb05114640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb00155190 0x7fdb000ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.702+0000 7fdb05114640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00074540 con 0x7fdb00155190 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.702+0000 7fdb05114640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001555a0 con 0x7fdb000c3ac0 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.702+0000 7fdb05114640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdb00074820 con 0x7fdb000c3ed0 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdaff59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb00155190 0x7fdb000ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 0x7fdb0014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb000abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 0x7fdb0014f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:33290/0 (socket says 172.21.15.46:33290) 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdaff59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb00155190 0x7fdb000ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51044/0 (socket says 172.21.15.46:51044) 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafed9d640 1 -- 172.21.15.46:0/2113140704 learned_addr learned my addr 172.21.15.46:0/2113140704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 -- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 msgr2=0x7fdb0014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 0x7fdb0014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 -- 172.21.15.46:0/2113140704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb00155190 msgr2=0x7fdb000ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb00155190 0x7fdb000ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 -- 172.21.15.46:0/2113140704 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00152990 con 0x7fdb000c3ed0 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafed9d640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 0x7fdb0014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdafe59c640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb000abb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c3f0 tx=0x7fdae800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae80074e0 con 0x7fdb000c3ed0 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae80047e0 con 0x7fdb000c3ed0 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb00154160 con 0x7fdb000c3ed0 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8004bd0 con 0x7fdb000c3ed0 2024-05-09T02:19:56.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.703+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb00154720 con 0x7fdb000c3ed0 2024-05-09T02:19:56.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.704+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb001f1f30 con 0x7fdb000c3ed0 2024-05-09T02:19:56.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.705+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdae8011070 con 0x7fdb000c3ed0 2024-05-09T02:19:56.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.706+0000 7fdaf77fe640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdae0076300 0x7fdae0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:56.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.706+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fdae80979b0 con 0x7fdb000c3ed0 2024-05-09T02:19:56.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.706+0000 7fdafed9d640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdae0076300 0x7fdae0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:56.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.706+0000 7fdafed9d640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdae0076300 0x7fdae0078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8006a90 tx=0x7fdaf8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:56.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.711+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdae8060910 con 0x7fdb000c3ed0 2024-05-09T02:19:56.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.944+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb0006a330 con 0x7fdb000c3ed0 2024-05-09T02:19:56.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.944+0000 7fdaf77fe640 1 -- 172.21.15.46:0/2113140704 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5661 (secure 0 0 0) 0x7fdae8064c10 con 0x7fdb000c3ed0 2024-05-09T02:19:56.948 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:56.948 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:55.902310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":14,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:19:56.948 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.946+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdae0076300 msgr2=0x7fdae0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.946+0000 7fdb05114640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdae0076300 0x7fdae0078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8006a90 tx=0x7fdaf8009190 comp rx=0 tx=0).stop 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.946+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 msgr2=0x7fdb000abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb000abb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c3f0 tx=0x7fdae800c8b0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 shutdown_connections 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdae0076300 0x7fdae0078810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb00155190 0x7fdb000ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdb000c3ed0 0x7fdb000abb50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 --2- 172.21.15.46:0/2113140704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb000c3ac0 0x7fdb0014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:56.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 >> 172.21.15.46:0/2113140704 conn(0x7fdb000c6770 msgr2=0x7fdb0014d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:56.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 shutdown_connections 2024-05-09T02:19:56.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:56.947+0000 7fdb05114640 1 -- 172.21.15.46:0/2113140704 wait complete. 2024-05-09T02:19:56.960 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-05-09T02:19:56.961 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T02:19:56.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.074+0000 7f2bd8805640 1 Processor -- start 2024-05-09T02:19:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.074+0000 7f2bd8805640 1 -- start start 2024-05-09T02:19:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd8805640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2bd40c5810 0x7f2bd4156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd8805640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2bd4070fb0 0x7f2bd406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd8805640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd40c5420 con 0x7f2bd406dc10 2024-05-09T02:19:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd8805640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd4156750 con 0x7f2bd4070fb0 2024-05-09T02:19:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd8805640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd40c5d40 con 0x7f2bd40c5810 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd1d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2bd4070fb0 0x7f2bd406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd2d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2bd406dc10 0x7f2bd40ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47660/0 (socket says 172.21.15.46:47660) 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd2d9d640 1 -- 172.21.15.46:0/3380951857 learned_addr learned my addr 172.21.15.46:0/3380951857 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd259c640 1 --2- 172.21.15.46:0/3380951857 >> v2:172.21.15.107:3300/0 conn(0x7f2bd40c5810 0x7f2bd4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/3380951857 >> v2:172.21.15.107:3300/0 conn(0x7f2bd40c5810 msgr2=0x7f2bd4156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd1d9b640 1 --2- 172.21.15.46:0/3380951857 >> v2:172.21.15.107:3300/0 conn(0x7f2bd40c5810 0x7f2bd4156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/3380951857 >> v1:172.21.15.46:6789/0 conn(0x7f2bd406dc10 legacy=0x7f2bd40ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd159a640 1 -- 172.21.15.46:0/3380951857 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495367665 0 0) 0x7f2bd40c5420 con 0x7f2bd406dc10 2024-05-09T02:19:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.076+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/3380951857 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd4158e50 con 0x7f2bd4070fb0 2024-05-09T02:19:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.077+0000 7f2bd1d9b640 1 --2- 172.21.15.46:0/3380951857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd406d6d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40729d0 tx=0x7f2bc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d2cba71927b672 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.077+0000 7f2bd159a640 1 -- 172.21.15.46:0/3380951857 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8037070 con 0x7f2bd4070fb0 2024-05-09T02:19:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.077+0000 7f2bd159a640 1 -- 172.21.15.46:0/3380951857 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc8032440 con 0x7f2bd4070fb0 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.077+0000 7f2bd159a640 1 -- 172.21.15.46:0/3380951857 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc802ae60 con 0x7f2bd4070fb0 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 -- 172.21.15.46:0/3380951857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 msgr2=0x7f2bd406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 --2- 172.21.15.46:0/3380951857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd406d6d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40729d0 tx=0x7f2bc802a110 comp rx=0 tx=0).stop 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 -- 172.21.15.46:0/3380951857 shutdown_connections 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 --2- 172.21.15.46:0/3380951857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd406d6d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 --2- 172.21.15.46:0/3380951857 >> v2:172.21.15.107:3300/0 conn(0x7f2bd40c5810 0x7f2bd4156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 -- 172.21.15.46:0/3380951857 >> 172.21.15.46:0/3380951857 conn(0x7f2bd40733e0 msgr2=0x7f2bd40737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 -- 172.21.15.46:0/3380951857 shutdown_connections 2024-05-09T02:19:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.078+0000 7f2bd8805640 1 -- 172.21.15.46:0/3380951857 wait complete. 2024-05-09T02:19:57.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.080+0000 7f2bd8805640 1 Processor -- start 2024-05-09T02:19:57.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.080+0000 7f2bd8805640 1 -- start start 2024-05-09T02:19:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.081+0000 7f2bd8805640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bd406dc10 0x7f2bd41eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.081+0000 7f2bd8805640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.081+0000 7f2bd8805640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2bd40c5810 0x7f2bd414c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.081+0000 7f2bd8805640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41596f0 con 0x7f2bd4070fb0 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.081+0000 7f2bd8805640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4159410 con 0x7f2bd406dc10 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.081+0000 7f2bd8805640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd4159c10 con 0x7f2bd40c5810 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd4157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51072/0 (socket says 172.21.15.46:51072) 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/1754480804 learned_addr learned my addr 172.21.15.46:0/1754480804 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd259c640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bd406dc10 0x7f2bd41eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd2d9d640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2bd40c5810 0x7f2bd414c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2bd40c5810 msgr2=0x7f2bd414c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2bd40c5810 0x7f2bd414c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bd406dc10 msgr2=0x7f2bd41eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bd406dc10 0x7f2bd41eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 -- 172.21.15.46:0/1754480804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd41ef560 con 0x7f2bd4070fb0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd1d9b640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd4157f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009890 tx=0x7f2bc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8037040 con 0x7f2bd4070fb0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc8042070 con 0x7f2bd4070fb0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd4150400 con 0x7f2bd4070fb0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.082+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8030920 con 0x7f2bd4070fb0 2024-05-09T02:19:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.083+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd41eb980 con 0x7f2bd4070fb0 2024-05-09T02:19:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.083+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd406a330 con 0x7f2bd4070fb0 2024-05-09T02:19:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.085+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2bc8030ac0 con 0x7f2bd4070fb0 2024-05-09T02:19:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.085+0000 7f2bc2ffd640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2bb40762d0 0x7f2bb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.085+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f2bc80b81a0 con 0x7f2bd4070fb0 2024-05-09T02:19:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.085+0000 7f2bd259c640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2bb40762d0 0x7f2bb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.086+0000 7f2bd259c640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2bb40762d0 0x7f2bb40787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bd406f400 tx=0x7f2bc4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:57.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.090+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2bc80810f0 con 0x7f2bd4070fb0 2024-05-09T02:19:57.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.323+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bd4150920 con 0x7f2bd4070fb0 2024-05-09T02:19:57.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.323+0000 7f2bc2ffd640 1 -- 172.21.15.46:0/1754480804 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5661 (secure 0 0 0) 0x7f2bc80853f0 con 0x7f2bd4070fb0 2024-05-09T02:19:57.326 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:57.326 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:55.902310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":14,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:19:57.327 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2024-05-09T02:19:57.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2bb40762d0 msgr2=0x7f2bb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:57.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2bb40762d0 0x7f2bb40787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bd406f400 tx=0x7f2bc4009190 comp rx=0 tx=0).stop 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 msgr2=0x7f2bd4157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd4157f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009890 tx=0x7f2bc80046c0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 shutdown_connections 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2bb40762d0 0x7f2bb40787e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2bd40c5810 0x7f2bd414c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bd4070fb0 0x7f2bd4157f10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 --2- 172.21.15.46:0/1754480804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bd406dc10 0x7f2bd41eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.325+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 >> 172.21.15.46:0/1754480804 conn(0x7f2bd40733e0 msgr2=0x7f2bd406ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.326+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 shutdown_connections 2024-05-09T02:19:57.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:57.326+0000 7f2bd8805640 1 -- 172.21.15.46:0/1754480804 wait complete. 2024-05-09T02:19:57.340 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:13.523096+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4278": { "addr": "172.21.15.46:6835/687229870", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6834", "nonce": 687229870, "type": "v2" }, { "addr": "172.21.15.46:6835", "nonce": 687229870, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4278, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 18 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T02:19:07.894919+0000", "qdb_cluster": [ 4278 ], "qdb_leader": 4278, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4278 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:22.572836+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4888": { "addr": "172.21.15.107:6837/3709209674", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6835", "nonce": 3709209674, "type": "v2" }, { "addr": "172.21.15.107:6837", "nonce": 3709209674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4888, "incarnation": 20, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:rejoin", "state_seq": 14 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T02:19:55.902310+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4888 } } } ], "standbys": [ { "addr": "172.21.15.107:6836/1968918469", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6834", "nonce": 1968918469, "type": "v2" }, { "addr": "172.21.15.107:6836", "nonce": 1968918469, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4232, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T02:19:59.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:59.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.455+0000 7f99acd1c640 1 Processor -- start 2024-05-09T02:19:59.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.455+0000 7f99acd1c640 1 -- start start 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.456+0000 7f99acd1c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8070b30 0x7f99a80722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.456+0000 7f99acd1c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f99a80c4e80 0x7f99a8072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.456+0000 7f99acd1c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99a80c83b0 con 0x7f99a8152ea0 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.456+0000 7f99acd1c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f99a8159d00 con 0x7f99a80c4e80 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.456+0000 7f99acd1c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99a8156c30 con 0x7f99a8070b30 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a5d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f99a80c4e80 0x7f99a8072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a6d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f99a8152ea0 0x7f99a8155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47670/0 (socket says 172.21.15.46:47670) 2024-05-09T02:19:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a6d9d640 1 -- 172.21.15.46:0/1409220487 learned_addr learned my addr 172.21.15.46:0/1409220487 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a659c640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8070b30 0x7f99a80722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a5d9b640 1 -- 172.21.15.46:0/1409220487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8070b30 msgr2=0x7f99a80722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a5d9b640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8070b30 0x7f99a80722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a5d9b640 1 -- 172.21.15.46:0/1409220487 >> v1:172.21.15.46:6789/0 conn(0x7f99a8152ea0 legacy=0x7f99a8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a559a640 1 -- 172.21.15.46:0/1409220487 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239028265 0 0) 0x7f99a80c83b0 con 0x7f99a8152ea0 2024-05-09T02:19:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a5d9b640 1 -- 172.21.15.46:0/1409220487 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a8155740 con 0x7f99a80c4e80 2024-05-09T02:19:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.457+0000 7f99a659c640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8070b30 0x7f99a80722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.458+0000 7f99a5d9b640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a8072800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f999c0097d0 tx=0x7f999c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb0a908bb944df6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.458+0000 7f99a559a640 1 -- 172.21.15.46:0/1409220487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c037070 con 0x7f99a80c4e80 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.458+0000 7f99a559a640 1 -- 172.21.15.46:0/1409220487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c02ae40 con 0x7f99a80c4e80 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.458+0000 7f99a559a640 1 -- 172.21.15.46:0/1409220487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c032660 con 0x7f99a80c4e80 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 -- 172.21.15.46:0/1409220487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 msgr2=0x7f99a8072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a8072800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f999c0097d0 tx=0x7f999c02a130 comp rx=0 tx=0).stop 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 -- 172.21.15.46:0/1409220487 shutdown_connections 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a8072800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 --2- 172.21.15.46:0/1409220487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8070b30 0x7f99a80722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 -- 172.21.15.46:0/1409220487 >> 172.21.15.46:0/1409220487 conn(0x7f99a8069040 msgr2=0x7f99a80ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:59.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 -- 172.21.15.46:0/1409220487 shutdown_connections 2024-05-09T02:19:59.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.459+0000 7f99acd1c640 1 -- 172.21.15.46:0/1409220487 wait complete. 2024-05-09T02:19:59.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.461+0000 7f99acd1c640 1 Processor -- start 2024-05-09T02:19:59.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.461+0000 7f99acd1c640 1 -- start start 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99acd1c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a8070b30 0x7f99a80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99acd1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99acd1c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8152ea0 0x7f99a814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99acd1c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f99a8159a20 con 0x7f99a80c4e80 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99acd1c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99a80ca600 con 0x7f99a8070b30 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99acd1c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f99a80ca8a0 con 0x7f99a8152ea0 2024-05-09T02:19:59.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a80c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51088/0 (socket says 172.21.15.46:51088) 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a5d9b640 1 -- 172.21.15.46:0/789997635 learned_addr learned my addr 172.21.15.46:0/789997635 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a659c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a8070b30 0x7f99a80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a6d9d640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8152ea0 0x7f99a814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a659c640 1 -- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8152ea0 msgr2=0x7f99a814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a659c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8152ea0 0x7f99a814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a659c640 1 -- 172.21.15.46:0/789997635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 msgr2=0x7f99a80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a659c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a80c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.462+0000 7f99a659c640 1 -- 172.21.15.46:0/789997635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a80cb5d0 con 0x7f99a8070b30 2024-05-09T02:19:59.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.463+0000 7f99a659c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a8070b30 0x7f99a80afae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f999800e840 tx=0x7f999800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.463+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998017070 con 0x7f99a8070b30 2024-05-09T02:19:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.463+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999800c940 con 0x7f99a8070b30 2024-05-09T02:19:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.463+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999800cd10 con 0x7f99a8070b30 2024-05-09T02:19:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.463+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a806db40 con 0x7f99a8070b30 2024-05-09T02:19:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.463+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a81f0e50 con 0x7f99a8070b30 2024-05-09T02:19:59.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.464+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a806a330 con 0x7f99a8070b30 2024-05-09T02:19:59.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.465+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f999801a070 con 0x7f99a8070b30 2024-05-09T02:19:59.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.465+0000 7f9996ffd640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f99880762d0 0x7f99880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.465+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f99980983b0 con 0x7f99a8070b30 2024-05-09T02:19:59.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.466+0000 7f99a5d9b640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f99880762d0 0x7f99880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.466+0000 7f99a5d9b640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f99880762d0 0x7f99880787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f999c009720 tx=0x7f999c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:59.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.470+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99a80cb5d0 con 0x7f99a8070b30 2024-05-09T02:19:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.740+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99a80c76d0 con 0x7f99a8070b30 2024-05-09T02:19:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.741+0000 7f9996ffd640 1 -- 172.21.15.46:0/789997635 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5668 (secure 0 0 0) 0x7f9998061270 con 0x7f99a8070b30 2024-05-09T02:19:59.744 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:19:59.744 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:19:59.744 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-05-09T02:19:59.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f99880762d0 msgr2=0x7f99880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f99880762d0 0x7f99880787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f999c009720 tx=0x7f999c02e000 comp rx=0 tx=0).stop 2024-05-09T02:19:59.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a8070b30 msgr2=0x7f99a80afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a8070b30 0x7f99a80afae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f999800e840 tx=0x7f999800ed00 comp rx=0 tx=0).stop 2024-05-09T02:19:59.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 shutdown_connections 2024-05-09T02:19:59.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f99880762d0 0x7f99880787e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a8152ea0 0x7f99a814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99a80c4e80 0x7f99a80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 --2- 172.21.15.46:0/789997635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a8070b30 0x7f99a80afae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 >> 172.21.15.46:0/789997635 conn(0x7f99a8069040 msgr2=0x7f99a80aa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 shutdown_connections 2024-05-09T02:19:59.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.743+0000 7f99acd1c640 1 -- 172.21.15.46:0/789997635 wait complete. 2024-05-09T02:19:59.757 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=4288 2024-05-09T02:19:59.757 INFO:tasks.mds_thrash.fs.[b]:waiting for 0 secs before reviving mds.c 2024-05-09T02:19:59.758 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-05-09T02:19:59.758 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T02:19:59.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T02:19:59.760 INFO:tasks.ceph.mds.c:Started 2024-05-09T02:19:59.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:19:59.851 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-05-09T02:19:59.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.877+0000 7f74c723b640 1 Processor -- start 2024-05-09T02:19:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.877+0000 7f74c723b640 1 -- start start 2024-05-09T02:19:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c723b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00c8fb0 0x7f74c015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c723b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74c0154f50 0x7f74c0158230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c723b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c00c5bc0 con 0x7f74c0158770 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c723b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f74c00c5ea0 con 0x7f74c0154f50 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c723b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74c00c6180 con 0x7f74c00c8fb0 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c4fd7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00c8fb0 0x7f74c015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74bffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74c0154f50 0x7f74c0158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c57d8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f74c0158770 0x7f74c00c7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:40270/0 (socket says 172.21.15.46:40270) 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.879+0000 7f74c57d8640 1 -- 172.21.15.46:0/3452237494 learned_addr learned my addr 172.21.15.46:0/3452237494 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74bf7fe640 1 -- 172.21.15.46:0/3452237494 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841167279 0 0) 0x7f74c00c5bc0 con 0x7f74c0158770 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74bf7fe640 1 -- 172.21.15.46:0/3452237494 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74b0003520 con 0x7f74c0158770 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74c4fd7640 1 -- 172.21.15.46:0/3452237494 >> v2:172.21.15.107:3300/0 conn(0x7f74c0154f50 msgr2=0x7f74c0158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74c4fd7640 1 --2- 172.21.15.46:0/3452237494 >> v2:172.21.15.107:3300/0 conn(0x7f74c0154f50 0x7f74c0158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74c4fd7640 1 -- 172.21.15.46:0/3452237494 >> v1:172.21.15.107:6789/0 conn(0x7f74c0158770 legacy=0x7f74c00c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74c4fd7640 1 -- 172.21.15.46:0/3452237494 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c0157d10 con 0x7f74c00c8fb0 2024-05-09T02:19:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.880+0000 7f74bffff640 1 --2- 172.21.15.46:0/3452237494 >> v2:172.21.15.107:3300/0 conn(0x7f74c0154f50 0x7f74c0158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:59.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.881+0000 7f74c4fd7640 1 --2- 172.21.15.46:0/3452237494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00c8fb0 0x7f74c015b9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74b40097a0 tx=0x7f74b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626d1c3d48ff0dd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:59.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.881+0000 7f74bf7fe640 1 -- 172.21.15.46:0/3452237494 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4037070 con 0x7f74c00c8fb0 2024-05-09T02:19:59.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.881+0000 7f74bf7fe640 1 -- 172.21.15.46:0/3452237494 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b4032440 con 0x7f74c00c8fb0 2024-05-09T02:19:59.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.881+0000 7f74bf7fe640 1 -- 172.21.15.46:0/3452237494 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b40327f0 con 0x7f74c00c8fb0 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 -- 172.21.15.46:0/3452237494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00c8fb0 msgr2=0x7f74c015b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 --2- 172.21.15.46:0/3452237494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00c8fb0 0x7f74c015b9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74b40097a0 tx=0x7f74b402a180 comp rx=0 tx=0).stop 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 -- 172.21.15.46:0/3452237494 shutdown_connections 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 --2- 172.21.15.46:0/3452237494 >> v2:172.21.15.107:3300/0 conn(0x7f74c0154f50 0x7f74c0158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 --2- 172.21.15.46:0/3452237494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c00c8fb0 0x7f74c015b9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 -- 172.21.15.46:0/3452237494 >> 172.21.15.46:0/3452237494 conn(0x7f74c0069040 msgr2=0x7f74c00ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 -- 172.21.15.46:0/3452237494 shutdown_connections 2024-05-09T02:19:59.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.882+0000 7f74c723b640 1 -- 172.21.15.46:0/3452237494 wait complete. 2024-05-09T02:19:59.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.885+0000 7f74c723b640 1 Processor -- start 2024-05-09T02:19:59.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.885+0000 7f74c723b640 1 -- start start 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c723b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00c8fb0 0x7f74c00add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c723b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c0154f50 0x7f74c01f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c723b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 0x7f74c014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c723b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74c01579c0 con 0x7f74c0158770 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c723b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0155360 con 0x7f74c00c8fb0 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c723b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74c00c7d60 con 0x7f74c0154f50 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c57d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 0x7f74c014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74bffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c0154f50 0x7f74c01f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c57d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 0x7f74c014d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51116/0 (socket says 172.21.15.46:51116) 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c57d8640 1 -- 172.21.15.46:0/3950767455 learned_addr learned my addr 172.21.15.46:0/3950767455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.887+0000 7f74c4fd7640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00c8fb0 0x7f74c00add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c4fd7640 1 -- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c0154f50 msgr2=0x7f74c01f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c4fd7640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c0154f50 0x7f74c01f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c4fd7640 1 -- 172.21.15.46:0/3950767455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 msgr2=0x7f74c014d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c4fd7640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 0x7f74c014d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c4fd7640 1 -- 172.21.15.46:0/3950767455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c00af930 con 0x7f74c00c8fb0 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74bffff640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c0154f50 0x7f74c01f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c57d8640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 0x7f74c014d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c4fd7640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00c8fb0 0x7f74c00add40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74b4031000 tx=0x7f74b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4042020 con 0x7f74c00c8fb0 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b4038040 con 0x7f74c00c8fb0 2024-05-09T02:19:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c00cb560 con 0x7f74c00c8fb0 2024-05-09T02:19:59.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4037050 con 0x7f74c00c8fb0 2024-05-09T02:19:59.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.888+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c014e130 con 0x7f74c00c8fb0 2024-05-09T02:19:59.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.889+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c006a330 con 0x7f74c00c8fb0 2024-05-09T02:19:59.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.890+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74b403c6d0 con 0x7f74c00c8fb0 2024-05-09T02:19:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.891+0000 7f74bd7fa640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74a40762d0 0x7f74a40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:19:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.891+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f74b40b8a30 con 0x7f74c00c8fb0 2024-05-09T02:19:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.891+0000 7f74bffff640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74a40762d0 0x7f74a40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:19:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.891+0000 7f74bffff640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74a40762d0 0x7f74a40787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009560 tx=0x7f74ac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:19:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:19:59.895+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f74b404c020 con 0x7f74c00c8fb0 2024-05-09T02:20:00.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.128+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74c01576b0 con 0x7f74c00c8fb0 2024-05-09T02:20:00.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.128+0000 7f74bd7fa640 1 -- 172.21.15.46:0/3950767455 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f74b4081960 con 0x7f74c00c8fb0 2024-05-09T02:20:00.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:00.131 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:00.132 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74a40762d0 msgr2=0x7f74a40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74a40762d0 0x7f74a40787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009560 tx=0x7f74ac009190 comp rx=0 tx=0).stop 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00c8fb0 msgr2=0x7f74c00add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00c8fb0 0x7f74c00add40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74b4031000 tx=0x7f74b40046c0 comp rx=0 tx=0).stop 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 shutdown_connections 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74a40762d0 0x7f74a40787e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74c0158770 0x7f74c014d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74c0154f50 0x7f74c01f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 --2- 172.21.15.46:0/3950767455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00c8fb0 0x7f74c00add40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:00.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 >> 172.21.15.46:0/3950767455 conn(0x7f74c0069040 msgr2=0x7f74c00c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:00.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 shutdown_connections 2024-05-09T02:20:00.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:00.131+0000 7f74c723b640 1 -- 172.21.15.46:0/3950767455 wait complete. 2024-05-09T02:20:00.145 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-05-09T02:20:00.145 INFO:tasks.mds_thrash.fs.[b]:waiting for 15 secs before thrashing 2024-05-09T02:20:00.929 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-09T02:20:00.926+0000 7f037e1cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:20:15.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.324+0000 7f6cd133f640 1 Processor -- start 2024-05-09T02:20:15.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.324+0000 7f6cd133f640 1 -- start start 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6cd133f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ccc0c42e0 0x7f6ccc153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6cd133f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc0c2ee0 0x7f6ccc155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6cd133f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ccc0aa900 con 0x7f6ccc0c51a0 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6cd133f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f6ccc153560 con 0x7f6ccc0c42e0 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6cd133f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc0c3e50 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6cca7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ccc0c42e0 0x7f6ccc153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6ccaffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6ccc0c51a0 0x7f6ccc06f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56066/0 (socket says 172.21.15.46:56066) 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6ccaffd640 1 -- 172.21.15.46:0/856315847 learned_addr learned my addr 172.21.15.46:0/856315847 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.326+0000 7f6ccb7fe640 1 --2- 172.21.15.46:0/856315847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc0c2ee0 0x7f6ccc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.327+0000 7f6cca7fc640 1 -- 172.21.15.46:0/856315847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc0c2ee0 msgr2=0x7f6ccc155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:15.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.327+0000 7f6cca7fc640 1 --2- 172.21.15.46:0/856315847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc0c2ee0 0x7f6ccc155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.327+0000 7f6cca7fc640 1 -- 172.21.15.46:0/856315847 >> v1:172.21.15.46:6789/0 conn(0x7f6ccc0c51a0 legacy=0x7f6ccc06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.327+0000 7f6cca7fc640 1 -- 172.21.15.46:0/856315847 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc0aa620 con 0x7f6ccc0c42e0 2024-05-09T02:20:15.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.327+0000 7f6cc9ffb640 1 -- 172.21.15.46:0/856315847 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759815580 0 0) 0x7f6ccc0aa900 con 0x7f6ccc0c51a0 2024-05-09T02:20:15.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.328+0000 7f6cca7fc640 1 --2- 172.21.15.46:0/856315847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c42e0 0x7f6ccc153020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00097a0 tx=0x7f6cc002a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895bdf6f37e6bb86 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:15.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.330+0000 7f6cc9ffb640 1 -- 172.21.15.46:0/856315847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0037070 con 0x7f6ccc0c42e0 2024-05-09T02:20:15.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.330+0000 7f6cc9ffb640 1 -- 172.21.15.46:0/856315847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc002ae30 con 0x7f6ccc0c42e0 2024-05-09T02:20:15.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.330+0000 7f6cc9ffb640 1 -- 172.21.15.46:0/856315847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0032640 con 0x7f6ccc0c42e0 2024-05-09T02:20:15.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.331+0000 7f6cd133f640 1 -- 172.21.15.46:0/856315847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c42e0 msgr2=0x7f6ccc153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.331+0000 7f6cd133f640 1 --2- 172.21.15.46:0/856315847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c42e0 0x7f6ccc153020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00097a0 tx=0x7f6cc002a0e0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.331+0000 7f6cd133f640 1 -- 172.21.15.46:0/856315847 shutdown_connections 2024-05-09T02:20:15.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.331+0000 7f6cd133f640 1 --2- 172.21.15.46:0/856315847 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc0c2ee0 0x7f6ccc155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.331+0000 7f6cd133f640 1 --2- 172.21.15.46:0/856315847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c42e0 0x7f6ccc153020 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.331+0000 7f6cd133f640 1 -- 172.21.15.46:0/856315847 >> 172.21.15.46:0/856315847 conn(0x7f6ccc0c5940 msgr2=0x7f6ccc0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:15.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.334+0000 7f6cd133f640 1 -- 172.21.15.46:0/856315847 shutdown_connections 2024-05-09T02:20:15.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.334+0000 7f6cd133f640 1 -- 172.21.15.46:0/856315847 wait complete. 2024-05-09T02:20:15.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.336+0000 7f6cd133f640 1 Processor -- start 2024-05-09T02:20:15.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.337+0000 7f6cd133f640 1 -- start start 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cd133f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 0x7f6ccc1f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cd133f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ccc0c51a0 0x7f6ccc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cd133f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc1f1340 0x7f6ccc0c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cd133f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0aa2b0 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cd133f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0c3ae0 con 0x7f6ccc0c51a0 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cd133f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc0700c0 con 0x7f6ccc1f1340 2024-05-09T02:20:15.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6ccaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 0x7f6ccc1f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6ccaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 0x7f6ccc1f0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38304/0 (socket says 172.21.15.46:38304) 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6ccaffd640 1 -- 172.21.15.46:0/4165078565 learned_addr learned my addr 172.21.15.46:0/4165078565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6ccb7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc1f1340 0x7f6ccc0c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6cca7fc640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ccc0c51a0 0x7f6ccc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6ccaffd640 1 -- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc1f1340 msgr2=0x7f6ccc0c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.339+0000 7f6ccaffd640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc1f1340 0x7f6ccc0c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6ccaffd640 1 -- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ccc0c51a0 msgr2=0x7f6ccc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6ccaffd640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ccc0c51a0 0x7f6ccc1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6ccaffd640 1 -- 172.21.15.46:0/4165078565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc1eb370 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6cca7fc640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ccc0c51a0 0x7f6ccc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6ccaffd640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 0x7f6ccc1f0e00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00c3d0 tx=0x7f6cbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0074e0 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0047e0 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc1f1810 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.340+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc1541a0 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.341+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc004bd0 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.342+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc06a330 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.343+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6cbc011070 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.344+0000 7f6cb37fe640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6cb80762d0 0x7f6cb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.345+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f6cbc097690 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.345+0000 7f6cca7fc640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6cb80762d0 0x7f6cb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.345+0000 7f6cca7fc640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6cb80762d0 0x7f6cb80787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0034000 tx=0x7f6cc002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:15.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.353+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6cbc060a70 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.823+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ccc0c5f00 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.824+0000 7f6cb37fe640 1 -- 172.21.15.46:0/4165078565 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f6cbc060370 con 0x7f6ccc0c2ee0 2024-05-09T02:20:15.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:15.826 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:15.827 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6cb80762d0 msgr2=0x7f6cb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6cb80762d0 0x7f6cb80787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0034000 tx=0x7f6cc002e000 comp rx=0 tx=0).stop 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 msgr2=0x7f6ccc1f0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 0x7f6ccc1f0e00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00c3d0 tx=0x7f6cbc00c890 comp rx=0 tx=0).stop 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 shutdown_connections 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6cb80762d0 0x7f6cb80787e0 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0034000 tx=0x7f6cc002e000 comp rx=0 tx=0).stop 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ccc1f1340 0x7f6ccc0c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ccc0c51a0 0x7f6ccc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 --2- 172.21.15.46:0/4165078565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ccc0c2ee0 0x7f6ccc1f0e00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.826+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 >> 172.21.15.46:0/4165078565 conn(0x7f6ccc0c5940 msgr2=0x7f6ccc06f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.827+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 shutdown_connections 2024-05-09T02:20:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.827+0000 7f6cd133f640 1 -- 172.21.15.46:0/4165078565 wait complete. 2024-05-09T02:20:15.846 INFO:tasks.mds_thrash.fs.[b]:kill mds.b (rank=0) 2024-05-09T02:20:15.846 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T02:20:15.846 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:20:15.859 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T02:20:15.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:15.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.986+0000 7f774138c640 1 Processor -- start 2024-05-09T02:20:15.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.986+0000 7f774138c640 1 -- start start 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.987+0000 7f774138c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f773c06df50 0x7f773c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.987+0000 7f774138c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f773c0c6050 0x7f773c073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.987+0000 7f774138c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c074020 0x7f773c0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.987+0000 7f774138c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f773c15fd50 con 0x7f773c06df50 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.987+0000 7f774138c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f773c071660 con 0x7f773c0c6050 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.987+0000 7f774138c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f773c0c9670 con 0x7f773c074020 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f773c06df50 0x7f773c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f773c06df50 0x7f773c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38312/0 (socket says 172.21.15.46:38312) 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 -- 172.21.15.46:0/1617426329 learned_addr learned my addr 172.21.15.46:0/1617426329 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:15.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773b7fe640 1 --2- 172.21.15.46:0/1617426329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c074020 0x7f773c0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773a7fc640 1 --2- 172.21.15.46:0/1617426329 >> v2:172.21.15.107:3300/0 conn(0x7f773c0c6050 0x7f773c073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 -- 172.21.15.46:0/1617426329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c074020 msgr2=0x7f773c0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 --2- 172.21.15.46:0/1617426329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c074020 0x7f773c0c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 -- 172.21.15.46:0/1617426329 >> v2:172.21.15.107:3300/0 conn(0x7f773c0c6050 msgr2=0x7f773c073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 --2- 172.21.15.46:0/1617426329 >> v2:172.21.15.107:3300/0 conn(0x7f773c0c6050 0x7f773c073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.988+0000 7f773affd640 1 -- 172.21.15.46:0/1617426329 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c160280 con 0x7f773c06df50 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.989+0000 7f773affd640 1 --2- 172.21.15.46:0/1617426329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c06df50 0x7f773c06faf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f773c0c9420 tx=0x7f772c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0239719c0d110f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.989+0000 7f7739ffb640 1 -- 172.21.15.46:0/1617426329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c037070 con 0x7f773c06df50 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.989+0000 7f7739ffb640 1 -- 172.21.15.46:0/1617426329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c02ae00 con 0x7f773c06df50 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.989+0000 7f7739ffb640 1 -- 172.21.15.46:0/1617426329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c032660 con 0x7f773c06df50 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 -- 172.21.15.46:0/1617426329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c06df50 msgr2=0x7f773c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 --2- 172.21.15.46:0/1617426329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c06df50 0x7f773c06faf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f773c0c9420 tx=0x7f772c02a0b0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 -- 172.21.15.46:0/1617426329 shutdown_connections 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 --2- 172.21.15.46:0/1617426329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c074020 0x7f773c0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 --2- 172.21.15.46:0/1617426329 >> v2:172.21.15.107:3300/0 conn(0x7f773c0c6050 0x7f773c073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 --2- 172.21.15.46:0/1617426329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c06df50 0x7f773c06faf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:15.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.990+0000 7f774138c640 1 -- 172.21.15.46:0/1617426329 >> 172.21.15.46:0/1617426329 conn(0x7f773c0aba90 msgr2=0x7f773c0abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:15.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.991+0000 7f774138c640 1 -- 172.21.15.46:0/1617426329 shutdown_connections 2024-05-09T02:20:15.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.991+0000 7f774138c640 1 -- 172.21.15.46:0/1617426329 wait complete. 2024-05-09T02:20:15.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.993+0000 7f774138c640 1 Processor -- start 2024-05-09T02:20:15.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.993+0000 7f774138c640 1 -- start start 2024-05-09T02:20:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f774138c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c074020 0x7f773c15e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f774138c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 0x7f773c154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f774138c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f773c155550 0x7f773c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f774138c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f773c071af0 con 0x7f773c074020 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f774138c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f773c15ffa0 con 0x7f773c155550 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f774138c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f773c0c6460 con 0x7f773c0c6050 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f773a7fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 0x7f773c154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f773affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c074020 0x7f773c15e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f773a7fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 0x7f773c154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:50992/0 (socket says 172.21.15.46:50992) 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f773a7fc640 1 -- 172.21.15.46:0/2017698705 learned_addr learned my addr 172.21.15.46:0/2017698705 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.994+0000 7f773b7fe640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f773c155550 0x7f773c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773a7fc640 1 -- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f773c155550 msgr2=0x7f773c154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773a7fc640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f773c155550 0x7f773c154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773a7fc640 1 -- 172.21.15.46:0/2017698705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c074020 msgr2=0x7f773c15e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773a7fc640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c074020 0x7f773c15e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773a7fc640 1 -- 172.21.15.46:0/2017698705 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c0ae740 con 0x7f773c0c6050 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773affd640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c074020 0x7f773c15e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f773a7fc640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 0x7f773c154510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f773000e870 tx=0x7f773000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730017070 con 0x7f773c0c6050 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f773000c940 con 0x7f773c0c6050 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.995+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773c159a00 con 0x7f773c0c6050 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.996+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f773c0aea20 con 0x7f773c0c6050 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.996+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773000cd30 con 0x7f773c0c6050 2024-05-09T02:20:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.997+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773c155150 con 0x7f773c0c6050 2024-05-09T02:20:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.998+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f773001a070 con 0x7f773c0c6050 2024-05-09T02:20:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.999+0000 7f77237fe640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f77280762d0 0x7f77280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.999+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f7730098470 con 0x7f773c0c6050 2024-05-09T02:20:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:15.999+0000 7f773affd640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f77280762d0 0x7f77280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.000+0000 7f773affd640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f77280762d0 0x7f77280787e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f772c034000 tx=0x7f772c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.007+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7730061280 con 0x7f773c0c6050 2024-05-09T02:20:16.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.242+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f773c06a330 con 0x7f773c0c6050 2024-05-09T02:20:16.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.243+0000 7f77237fe640 1 -- 172.21.15.46:0/2017698705 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f7730065580 con 0x7f773c0c6050 2024-05-09T02:20:16.247 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:16.247 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.245+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f77280762d0 msgr2=0x7f77280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.245+0000 7f774138c640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f77280762d0 0x7f77280787e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f772c034000 tx=0x7f772c02e000 comp rx=0 tx=0).stop 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.245+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 msgr2=0x7f773c154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.245+0000 7f774138c640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 0x7f773c154510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f773000e870 tx=0x7f773000ed30 comp rx=0 tx=0).stop 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 shutdown_connections 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f77280762d0 0x7f77280787e0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f772c034000 tx=0x7f772c02e000 comp rx=0 tx=0).stop 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f773c155550 0x7f773c154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f773c0c6050 0x7f773c154510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 --2- 172.21.15.46:0/2017698705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f773c074020 0x7f773c15e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 >> 172.21.15.46:0/2017698705 conn(0x7f773c0aba90 msgr2=0x7f773c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 shutdown_connections 2024-05-09T02:20:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:16.246+0000 7f774138c640 1 -- 172.21.15.46:0/2017698705 wait complete. 2024-05-09T02:20:16.260 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:20:16.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:20:16.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:20:18.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:18.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.252+0000 7f172f75e640 1 Processor -- start 2024-05-09T02:20:18.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.252+0000 7f172f75e640 1 -- start start 2024-05-09T02:20:18.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172f75e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1728156080 0x7f1728156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172f75e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17280c4750 0x7f17280c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172f75e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1728073f60 con 0x7f17280af580 2024-05-09T02:20:18.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172f75e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f17280c5af0 con 0x7f1728156080 2024-05-09T02:20:18.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172f75e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1728071170 con 0x7f17280c4750 2024-05-09T02:20:18.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172dcfb640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17280c4750 0x7f17280c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172d4fa640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f17280af580 0x7f17280abdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:53112/0 (socket says 172.21.15.46:53112) 2024-05-09T02:20:18.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.254+0000 7f172d4fa640 1 -- 172.21.15.46:0/610678804 learned_addr learned my addr 172.21.15.46:0/610678804 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:18.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f172ccf9640 1 --2- 172.21.15.46:0/610678804 >> v2:172.21.15.107:3300/0 conn(0x7f1728156080 0x7f1728156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f171ffff640 1 -- 172.21.15.46:0/610678804 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375327766 0 0) 0x7f1728073f60 con 0x7f17280af580 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f171ffff640 1 -- 172.21.15.46:0/610678804 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1714003520 con 0x7f17280af580 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f172dcfb640 1 -- 172.21.15.46:0/610678804 >> v2:172.21.15.107:3300/0 conn(0x7f1728156080 msgr2=0x7f1728156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f172dcfb640 1 --2- 172.21.15.46:0/610678804 >> v2:172.21.15.107:3300/0 conn(0x7f1728156080 0x7f1728156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f172dcfb640 1 -- 172.21.15.46:0/610678804 >> v1:172.21.15.107:6789/0 conn(0x7f17280af580 legacy=0x7f17280abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.255+0000 7f172dcfb640 1 -- 172.21.15.46:0/610678804 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17280713c0 con 0x7f17280c4750 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.256+0000 7f172dcfb640 1 --2- 172.21.15.46:0/610678804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17280c4750 0x7f17280c4b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1720009d90 tx=0x7f172002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ec5a8bd0a8e13f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.256+0000 7f171ffff640 1 -- 172.21.15.46:0/610678804 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720031600 con 0x7f17280c4750 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.256+0000 7f171ffff640 1 -- 172.21.15.46:0/610678804 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17200317a0 con 0x7f17280c4750 2024-05-09T02:20:18.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.256+0000 7f171ffff640 1 -- 172.21.15.46:0/610678804 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720031b70 con 0x7f17280c4750 2024-05-09T02:20:18.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:18.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.257+0000 7f172f75e640 1 -- 172.21.15.46:0/610678804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17280c4750 msgr2=0x7f17280c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.257+0000 7f172f75e640 1 --2- 172.21.15.46:0/610678804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17280c4750 0x7f17280c4b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1720009d90 tx=0x7f172002a5d0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.257+0000 7f172f75e640 1 -- 172.21.15.46:0/610678804 shutdown_connections 2024-05-09T02:20:18.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.257+0000 7f172f75e640 1 --2- 172.21.15.46:0/610678804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f17280c4750 0x7f17280c4b60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.257+0000 7f172f75e640 1 --2- 172.21.15.46:0/610678804 >> v2:172.21.15.107:3300/0 conn(0x7f1728156080 0x7f1728156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.257+0000 7f172f75e640 1 -- 172.21.15.46:0/610678804 >> 172.21.15.46:0/610678804 conn(0x7f17280c6770 msgr2=0x7f17280c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:18.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.258+0000 7f172f75e640 1 -- 172.21.15.46:0/610678804 shutdown_connections 2024-05-09T02:20:18.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.258+0000 7f172f75e640 1 -- 172.21.15.46:0/610678804 wait complete. 2024-05-09T02:20:18.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.260+0000 7f172f75e640 1 Processor -- start 2024-05-09T02:20:18.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.260+0000 7f172f75e640 1 -- start start 2024-05-09T02:20:18.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.262+0000 7f172f75e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 0x7f17280c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172f75e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17280c4750 0x7f1728150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 0x7f17280c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 0x7f17280c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44292/0 (socket says 172.21.15.46:44292) 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 -- 172.21.15.46:0/1500000634 learned_addr learned my addr 172.21.15.46:0/1500000634 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1728156080 0x7f172814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1728071980 con 0x7f17280af580 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1728070b20 con 0x7f17280c4750 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f17280af990 con 0x7f1728156080 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172dcfb640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1728156080 0x7f172814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172ccf9640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17280c4750 0x7f1728150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 -- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1728156080 msgr2=0x7f172814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1728156080 0x7f172814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 -- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17280c4750 msgr2=0x7f1728150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17280c4750 0x7f1728150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172d4fa640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17280c2690 con 0x7f17280af580 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.263+0000 7f172ccf9640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17280c4750 0x7f1728150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.264+0000 7f172d4fa640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 0x7f17280c8f10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1724001b80 tx=0x7f1724014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.264+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724001d30 con 0x7f17280af580 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.264+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724014d40 con 0x7f17280af580 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.264+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17281ec460 con 0x7f17280af580 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.264+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724005af0 con 0x7f17280af580 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.264+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17280bf010 con 0x7f17280af580 2024-05-09T02:20:18.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.266+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172806a330 con 0x7f17280af580 2024-05-09T02:20:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.267+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1724005c90 con 0x7f17280af580 2024-05-09T02:20:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.268+0000 7f171dffb640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f170c076470 0x7f170c078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.268+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f172409f5d0 con 0x7f17280af580 2024-05-09T02:20:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.269+0000 7f172ccf9640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f170c076470 0x7f170c078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.270+0000 7f172ccf9640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f170c076470 0x7f170c078980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1728076bf0 tx=0x7f1718008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:18.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.277+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1724068a40 con 0x7f17280af580 2024-05-09T02:20:18.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.437+0000 7f1a0b386640 1 Processor -- start 2024-05-09T02:20:18.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.437+0000 7f1a0b386640 1 -- start start 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.439+0000 7f1a0b386640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1a04071030 0x7f1a041587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.439+0000 7f1a0b386640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a04073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a0b386640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a04158030 con 0x7f1a04071580 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a0b386640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f1a0415b190 con 0x7f1a04071030 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a0b386640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0415b470 con 0x7f1a04157c20 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a09923640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a04073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a09923640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a04073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:53636/0 (socket says 172.21.15.46:53636) 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a09923640 1 -- 172.21.15.46:0/2327876581 learned_addr learned my addr 172.21.15.46:0/2327876581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a09122640 1 --2- 172.21.15.46:0/2327876581 >> v2:172.21.15.46:3300/0 conn(0x7f1a04071030 0x7f1a041587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f1a09923640 1 -- 172.21.15.46:0/2327876581 >> v2:172.21.15.46:3300/0 conn(0x7f1a04071030 msgr2=0x7f1a041587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.440+0000 7f19fbfff640 1 -- 172.21.15.46:0/2327876581 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842447339 0 0) 0x7f19f4001110 con 0x7f1a04071580 2024-05-09T02:20:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.441+0000 7f1a09923640 1 --2- 172.21.15.46:0/2327876581 >> v2:172.21.15.46:3300/0 conn(0x7f1a04071030 0x7f1a041587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.441+0000 7f1a09923640 1 -- 172.21.15.46:0/2327876581 >> v1:172.21.15.46:6789/0 conn(0x7f1a04071580 legacy=0x7f1a0415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.441+0000 7f1a09923640 1 -- 172.21.15.46:0/2327876581 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a04070e00 con 0x7f1a04157c20 2024-05-09T02:20:18.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.441+0000 7f1a09122640 1 --2- 172.21.15.46:0/2327876581 >> v2:172.21.15.46:3300/0 conn(0x7f1a04071030 0x7f1a041587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.442+0000 7f1a09923640 1 --2- 172.21.15.46:0/2327876581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a04073ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009e50 tx=0x7f19fc02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4b8f141c0ecf796 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.442+0000 7f19fbfff640 1 -- 172.21.15.46:0/2327876581 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc036070 con 0x7f1a04157c20 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.442+0000 7f19fbfff640 1 -- 172.21.15.46:0/2327876581 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19fc031600 con 0x7f1a04157c20 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.442+0000 7f19fbfff640 1 -- 172.21.15.46:0/2327876581 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0319d0 con 0x7f1a04157c20 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.443+0000 7f1a0b386640 1 -- 172.21.15.46:0/2327876581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 msgr2=0x7f1a04073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.443+0000 7f1a0b386640 1 --2- 172.21.15.46:0/2327876581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a04073ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009e50 tx=0x7f19fc02a5f0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.443+0000 7f1a0b386640 1 -- 172.21.15.46:0/2327876581 shutdown_connections 2024-05-09T02:20:18.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.443+0000 7f1a0b386640 1 --2- 172.21.15.46:0/2327876581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a04073ae0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.443+0000 7f1a0b386640 1 --2- 172.21.15.46:0/2327876581 >> v2:172.21.15.46:3300/0 conn(0x7f1a04071030 0x7f1a041587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.443+0000 7f1a0b386640 1 -- 172.21.15.46:0/2327876581 >> 172.21.15.46:0/2327876581 conn(0x7f1a040aba90 msgr2=0x7f1a040abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:18.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.444+0000 7f1a0b386640 1 -- 172.21.15.46:0/2327876581 shutdown_connections 2024-05-09T02:20:18.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.444+0000 7f1a0b386640 1 -- 172.21.15.46:0/2327876581 wait complete. 2024-05-09T02:20:18.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.446+0000 7f1a0b386640 1 Processor -- start 2024-05-09T02:20:18.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.446+0000 7f1a0b386640 1 -- start start 2024-05-09T02:20:18.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a0b386640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 0x7f1a04158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a0b386640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a04071580 0x7f1a041ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a0b386640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a040c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a09122640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 0x7f1a04158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a09122640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 0x7f1a04158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44312/0 (socket says 172.21.15.46:44312) 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a09122640 1 -- 172.21.15.46:0/3758013499 learned_addr learned my addr 172.21.15.46:0/3758013499 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a08921640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a04071580 0x7f1a041ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a09923640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a040c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a040c53e0 con 0x7f1a04071030 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a040c5100 con 0x7f1a04071580 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.449+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a04070a90 con 0x7f1a04157c20 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a08921640 1 -- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 msgr2=0x7f1a040c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a08921640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a040c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a08921640 1 -- 172.21.15.46:0/3758013499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 msgr2=0x7f1a04158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a08921640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 0x7f1a04158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a08921640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a041edd00 con 0x7f1a04071580 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a09122640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 0x7f1a04158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a08921640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a04071580 0x7f1a041ee780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c3f0 tx=0x7f19f400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4017070 con 0x7f1a04071580 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f40035f0 con 0x7f1a04071580 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a040c7260 con 0x7f1a04071580 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.450+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f40039e0 con 0x7f1a04071580 2024-05-09T02:20:18.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.451+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a041edf80 con 0x7f1a04071580 2024-05-09T02:20:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.452+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a040a9550 con 0x7f1a04071580 2024-05-09T02:20:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.453+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f19f401a070 con 0x7f1a04071580 2024-05-09T02:20:18.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.454+0000 7f19f9ffb640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f19e80762d0 0x7f19e80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.454+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f19f4096d00 con 0x7f1a04071580 2024-05-09T02:20:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.454+0000 7f1a09122640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f19e80762d0 0x7f19e80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.454+0000 7f1a09122640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f19e80762d0 0x7f19e80787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a00006a90 tx=0x7f1a00009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:18.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.464+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1a040a9550 con 0x7f1a04071580 2024-05-09T02:20:18.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.744+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17280c3ef0 con 0x7f17280af580 2024-05-09T02:20:18.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.745+0000 7f171dffb640 1 -- 172.21.15.46:0/1500000634 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f1724068340 con 0x7f17280af580 2024-05-09T02:20:18.747 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:18.748 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f170c076470 msgr2=0x7f170c078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f170c076470 0x7f170c078980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1728076bf0 tx=0x7f1718008040 comp rx=0 tx=0).stop 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 msgr2=0x7f17280c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 0x7f17280c8f10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1724001b80 tx=0x7f1724014420 comp rx=0 tx=0).stop 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 shutdown_connections 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f170c076470 0x7f170c078980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1728156080 0x7f172814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17280c4750 0x7f1728150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 --2- 172.21.15.46:0/1500000634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17280af580 0x7f17280c8f10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 >> 172.21.15.46:0/1500000634 conn(0x7f17280c6770 msgr2=0x7f1728152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 shutdown_connections 2024-05-09T02:20:18.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.748+0000 7f172f75e640 1 -- 172.21.15.46:0/1500000634 wait complete. 2024-05-09T02:20:18.767 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-05-09T02:20:18.767 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T02:20:18.768 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:20:18.822 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T02:20:18.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.932+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a0406a330 con 0x7f1a04071580 2024-05-09T02:20:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.933+0000 7f19f9ffb640 1 -- 172.21.15.46:0/3758013499 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f1a041edd00 con 0x7f1a04071580 2024-05-09T02:20:18.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:18.936 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:18.936 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f19e80762d0 msgr2=0x7f19e80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f19e80762d0 0x7f19e80787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a00006a90 tx=0x7f1a00009190 comp rx=0 tx=0).stop 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a04071580 msgr2=0x7f1a041ee780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a04071580 0x7f1a041ee780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c3f0 tx=0x7f19f400c7f0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 shutdown_connections 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f19e80762d0 0x7f19e80787e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a04157c20 0x7f1a040c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a04071580 0x7f1a041ee780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 --2- 172.21.15.46:0/3758013499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a04071030 0x7f1a04158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 >> 172.21.15.46:0/3758013499 conn(0x7f1a040aba90 msgr2=0x7f1a040c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 shutdown_connections 2024-05-09T02:20:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:18.936+0000 7f1a0b386640 1 -- 172.21.15.46:0/3758013499 wait complete. 2024-05-09T02:20:18.955 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:20:19.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.039+0000 7f3c8440c640 1 Processor -- start 2024-05-09T02:20:19.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.039+0000 7f3c8440c640 1 -- start start 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c8440c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c0a95c0 0x7f3c7c073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c8440c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c7c155340 0x7f3c7c151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c8440c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c7c0c4090 con 0x7f3c7c074a90 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c819a7640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3c7c074a90 0x7f3c7c0c8020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:53124/0 (socket says 172.21.15.46:53124) 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c819a7640 1 -- 172.21.15.46:0/3018104165 learned_addr learned my addr 172.21.15.46:0/3018104165 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c829a9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c7c155340 0x7f3c7c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.041+0000 7f3c821a8640 1 --2- 172.21.15.46:0/3018104165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c0a95c0 0x7f3c7c073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f3c7c154880 con 0x7f3c7c155340 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7c154b60 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c821a8640 1 -- 172.21.15.46:0/3018104165 >> v2:172.21.15.46:3300/0 conn(0x7f3c7c155340 msgr2=0x7f3c7c151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c811a6640 1 -- 172.21.15.46:0/3018104165 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817692534 0 0) 0x7f3c7c0c4090 con 0x7f3c7c074a90 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c821a8640 1 --2- 172.21.15.46:0/3018104165 >> v2:172.21.15.46:3300/0 conn(0x7f3c7c155340 0x7f3c7c151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c821a8640 1 -- 172.21.15.46:0/3018104165 >> v1:172.21.15.107:6789/0 conn(0x7f3c7c074a90 legacy=0x7f3c7c0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c821a8640 1 -- 172.21.15.46:0/3018104165 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c154e40 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.042+0000 7f3c829a9640 1 --2- 172.21.15.46:0/3018104165 >> v2:172.21.15.46:3300/0 conn(0x7f3c7c155340 0x7f3c7c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:19.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.043+0000 7f3c821a8640 1 --2- 172.21.15.46:0/3018104165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c0a95c0 0x7f3c7c073cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097a0 tx=0x7f3c7802c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45702b8478b374a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.043+0000 7f3c811a6640 1 -- 172.21.15.46:0/3018104165 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78039070 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.043+0000 7f3c811a6640 1 -- 172.21.15.46:0/3018104165 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c78034440 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.043+0000 7f3c811a6640 1 -- 172.21.15.46:0/3018104165 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78034810 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c0a95c0 msgr2=0x7f3c7c073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 --2- 172.21.15.46:0/3018104165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c0a95c0 0x7f3c7c073cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097a0 tx=0x7f3c7802c270 comp rx=0 tx=0).stop 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 shutdown_connections 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 --2- 172.21.15.46:0/3018104165 >> v2:172.21.15.46:3300/0 conn(0x7f3c7c155340 0x7f3c7c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 --2- 172.21.15.46:0/3018104165 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c0a95c0 0x7f3c7c073cd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 >> 172.21.15.46:0/3018104165 conn(0x7f3c7c06de00 msgr2=0x7f3c7c0aba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 shutdown_connections 2024-05-09T02:20:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.045+0000 7f3c8440c640 1 -- 172.21.15.46:0/3018104165 wait complete. 2024-05-09T02:20:19.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.048+0000 7f3c8440c640 1 Processor -- start 2024-05-09T02:20:19.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.048+0000 7f3c8440c640 1 -- start start 2024-05-09T02:20:19.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c8440c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c7c074a90 0x7f3c7c0aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c8440c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 0x7f3c7c1e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c8440c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c155340 0x7f3c7c1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 0x7f3c7c1e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c821a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c7c074a90 0x7f3c7c0aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 0x7f3c7c1e9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44334/0 (socket says 172.21.15.46:44334) 2024-05-09T02:20:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c821a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c7c074a90 0x7f3c7c0aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49270/0 (socket says 172.21.15.46:49270) 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 -- 172.21.15.46:0/1077577404 learned_addr learned my addr 172.21.15.46:0/1077577404 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c0c7be0 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c0c8730 con 0x7f3c7c074a90 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7c0c7d60 con 0x7f3c7c155340 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c829a9640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c155340 0x7f3c7c1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 -- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c155340 msgr2=0x7f3c7c1449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c155340 0x7f3c7c1449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 -- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c7c074a90 msgr2=0x7f3c7c0aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c7c074a90 0x7f3c7c0aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.050+0000 7f3c819a7640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c151150 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.051+0000 7f3c819a7640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 0x7f3c7c1e9730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00c370 tx=0x7f3c6c00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:19.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.051+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c017070 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.051+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c6c005ce0 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.051+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c007310 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.051+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7c14d340 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.051+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7c14d900 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.053+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7c0767e0 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.054+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3c6c01a070 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.055+0000 7f3c72ffd640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3c60076300 0x7f3c60078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:19.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.055+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f3c6c096af0 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.055+0000 7f3c821a8640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3c60076300 0x7f3c60078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:19.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.056+0000 7f3c821a8640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3c60076300 0x7f3c60078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c78036000 tx=0x7f3c78030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:19.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.064+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3c7c0767e0 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.526+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c7c06a330 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.526+0000 7f3c72ffd640 1 -- 172.21.15.46:0/1077577404 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f3c6c05fb00 con 0x7f3c7c0a95c0 2024-05-09T02:20:19.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:19.529 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:19.530 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3c60076300 msgr2=0x7f3c60078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:19.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3c60076300 0x7f3c60078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c78036000 tx=0x7f3c78030000 comp rx=0 tx=0).stop 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 msgr2=0x7f3c7c1e9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 0x7f3c7c1e9730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00c370 tx=0x7f3c6c00c770 comp rx=0 tx=0).stop 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 shutdown_connections 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3c60076300 0x7f3c60078810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3c7c155340 0x7f3c7c1449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c0a95c0 0x7f3c7c1e9730 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 --2- 172.21.15.46:0/1077577404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c7c074a90 0x7f3c7c0aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.528+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 >> 172.21.15.46:0/1077577404 conn(0x7f3c7c06de00 msgr2=0x7f3c7c14a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.529+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 shutdown_connections 2024-05-09T02:20:19.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:19.529+0000 7f3c8440c640 1 -- 172.21.15.46:0/1077577404 wait complete. 2024-05-09T02:20:19.544 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T02:20:20.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:21.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.125+0000 7f416ad84640 1 Processor -- start 2024-05-09T02:20:21.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.125+0000 7f416ad84640 1 -- start start 2024-05-09T02:20:21.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f416ad84640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f41640c9630 0x7f4164155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f416ad84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4164158010 0x7f4164158420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f416ad84640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41640c46e0 con 0x7f41640c9060 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f416ad84640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f41640c5720 con 0x7f41640c9630 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f416ad84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41641559b0 con 0x7f4164158010 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f4168b20640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f41640c9060 0x7f41640c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:53126/0 (socket says 172.21.15.46:53126) 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f4168b20640 1 -- 172.21.15.46:0/3031275350 learned_addr learned my addr 172.21.15.46:0/3031275350 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f4163fff640 1 --2- 172.21.15.46:0/3031275350 >> v2:172.21.15.107:3300/0 conn(0x7f41640c9630 0x7f4164155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.127+0000 7f4169321640 1 --2- 172.21.15.46:0/3031275350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4164158010 0x7f4164158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f41637fe640 1 -- 172.21.15.46:0/3031275350 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393812420 0 0) 0x7f41640c46e0 con 0x7f41640c9060 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f41637fe640 1 -- 172.21.15.46:0/3031275350 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4154003520 con 0x7f41640c9060 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f4169321640 1 -- 172.21.15.46:0/3031275350 >> v2:172.21.15.107:3300/0 conn(0x7f41640c9630 msgr2=0x7f4164155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f4169321640 1 --2- 172.21.15.46:0/3031275350 >> v2:172.21.15.107:3300/0 conn(0x7f41640c9630 0x7f4164155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f4169321640 1 -- 172.21.15.46:0/3031275350 >> v1:172.21.15.107:6789/0 conn(0x7f41640c9060 legacy=0x7f41640c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f4169321640 1 -- 172.21.15.46:0/3031275350 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41640c49c0 con 0x7f4164158010 2024-05-09T02:20:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.128+0000 7f4163fff640 1 --2- 172.21.15.46:0/3031275350 >> v2:172.21.15.107:3300/0 conn(0x7f41640c9630 0x7f4164155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.129+0000 7f4169321640 1 --2- 172.21.15.46:0/3031275350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4164158010 0x7f4164158420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f415c009d90 tx=0x7f415c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4d87da86f0e0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.129+0000 7f41637fe640 1 -- 172.21.15.46:0/3031275350 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c031600 con 0x7f4164158010 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.129+0000 7f41637fe640 1 -- 172.21.15.46:0/3031275350 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c0317a0 con 0x7f4164158010 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.129+0000 7f41637fe640 1 -- 172.21.15.46:0/3031275350 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c031b50 con 0x7f4164158010 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 -- 172.21.15.46:0/3031275350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4164158010 msgr2=0x7f4164158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 --2- 172.21.15.46:0/3031275350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4164158010 0x7f4164158420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f415c009d90 tx=0x7f415c02a5d0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 -- 172.21.15.46:0/3031275350 shutdown_connections 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 --2- 172.21.15.46:0/3031275350 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4164158010 0x7f4164158420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 --2- 172.21.15.46:0/3031275350 >> v2:172.21.15.107:3300/0 conn(0x7f41640c9630 0x7f4164155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 -- 172.21.15.46:0/3031275350 >> 172.21.15.46:0/3031275350 conn(0x7f416406d7d0 msgr2=0x7f416406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 -- 172.21.15.46:0/3031275350 shutdown_connections 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.130+0000 7f416ad84640 1 -- 172.21.15.46:0/3031275350 wait complete. 2024-05-09T02:20:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.132+0000 7f416ad84640 1 Processor -- start 2024-05-09T02:20:21.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.132+0000 7f416ad84640 1 -- start start 2024-05-09T02:20:21.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f416ad84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 0x7f41641472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f416ad84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 0x7f41640aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f416ad84640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4164158010 0x7f41641ede40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f416ad84640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f41640c6e80 con 0x7f4164158010 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f416ad84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41640c53b0 con 0x7f41640c9630 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f416ad84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41640c7000 con 0x7f41640c9060 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f4168b20640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 0x7f41641472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f4163fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 0x7f41640aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f4168b20640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 0x7f41641472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:53686/0 (socket says 172.21.15.46:53686) 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f4163fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 0x7f41640aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49282/0 (socket says 172.21.15.46:49282) 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f4168b20640 1 -- 172.21.15.46:0/353330389 learned_addr learned my addr 172.21.15.46:0/353330389 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.133+0000 7f4169321640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4164158010 0x7f41641ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4163fff640 1 -- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 msgr2=0x7f41641472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4163fff640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 0x7f41641472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4163fff640 1 -- 172.21.15.46:0/353330389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4164158010 msgr2=0x7f41641ede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4163fff640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4164158010 0x7f41641ede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4163fff640 1 -- 172.21.15.46:0/353330389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41640acd00 con 0x7f41640c9630 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4168b20640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 0x7f41641472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f4163fff640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 0x7f41640aaef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f415000e840 tx=0x7f415000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150017070 con 0x7f41640c9630 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415000c940 con 0x7f41640c9630 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415000cd30 con 0x7f41640c9630 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41641f1950 con 0x7f41640c9630 2024-05-09T02:20:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.134+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41640ad800 con 0x7f41640c9630 2024-05-09T02:20:21.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.136+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416406a330 con 0x7f41640c9630 2024-05-09T02:20:21.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.136+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f415001a070 con 0x7f41640c9630 2024-05-09T02:20:21.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.137+0000 7f41617fa640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4148076300 0x7f4148078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.137+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f4150097b60 con 0x7f41640c9630 2024-05-09T02:20:21.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.138+0000 7f4168b20640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4148076300 0x7f4148078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.138+0000 7f4168b20640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4148076300 0x7f4148078810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4158005880 tx=0x7f4158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:21.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.146+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4150060a20 con 0x7f41640c9630 2024-05-09T02:20:21.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:21.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.613+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4164147870 con 0x7f41640c9630 2024-05-09T02:20:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.614+0000 7f41617fa640 1 -- 172.21.15.46:0/353330389 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f4150064d20 con 0x7f41640c9630 2024-05-09T02:20:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4148076300 msgr2=0x7f4148078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4148076300 0x7f4148078810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4158005880 tx=0x7f4158009040 comp rx=0 tx=0).stop 2024-05-09T02:20:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 msgr2=0x7f41640aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 0x7f41640aaef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f415000e840 tx=0x7f415000ed00 comp rx=0 tx=0).stop 2024-05-09T02:20:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 shutdown_connections 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4148076300 0x7f4148078810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4164158010 0x7f41641ede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41640c9630 0x7f41640aaef0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 --2- 172.21.15.46:0/353330389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41640c9060 0x7f41641472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 >> 172.21.15.46:0/353330389 conn(0x7f416406d7d0 msgr2=0x7f416406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 shutdown_connections 2024-05-09T02:20:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.618+0000 7f416ad84640 1 -- 172.21.15.46:0/353330389 wait complete. 2024-05-09T02:20:21.639 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:20:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.666+0000 7fbd774b8640 1 Processor -- start 2024-05-09T02:20:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.666+0000 7fbd774b8640 1 -- start start 2024-05-09T02:20:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd774b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd700c5f10 0x7fbd700c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd774b8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 0x7fbd701581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd774b8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd701552d0 con 0x7fbd70154ec0 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd774b8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fbd700c6320 con 0x7fbd70157dc0 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd774b8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbd70157950 con 0x7fbd700c5f10 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd75a55640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 0x7fbd701581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd75254640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd700c5f10 0x7fbd700c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd75254640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd700c5f10 0x7fbd700c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49288/0 (socket says 172.21.15.46:49288) 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd74a53640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbd70154ec0 0x7fbd700c9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:53136/0 (socket says 172.21.15.46:53136) 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd75a55640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 0x7fbd701581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44364/0 (socket says 172.21.15.46:44364) 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.668+0000 7fbd75254640 1 -- 172.21.15.46:0/847670188 learned_addr learned my addr 172.21.15.46:0/847670188 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.669+0000 7fbd75254640 1 -- 172.21.15.46:0/847670188 >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 msgr2=0x7fbd701581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.669+0000 7fbd75254640 1 --2- 172.21.15.46:0/847670188 >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 0x7fbd701581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.669+0000 7fbd75254640 1 -- 172.21.15.46:0/847670188 >> v1:172.21.15.107:6789/0 conn(0x7fbd70154ec0 legacy=0x7fbd700c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.669+0000 7fbd67fff640 1 -- 172.21.15.46:0/847670188 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868473453 0 0) 0x7fbd701552d0 con 0x7fbd70154ec0 2024-05-09T02:20:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.669+0000 7fbd75254640 1 -- 172.21.15.46:0/847670188 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7015af40 con 0x7fbd700c5f10 2024-05-09T02:20:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.669+0000 7fbd75a55640 1 --2- 172.21.15.46:0/847670188 >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 0x7fbd701581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.670+0000 7fbd75254640 1 --2- 172.21.15.46:0/847670188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd700c5f10 0x7fbd700c9950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ad870 tx=0x7fbd6c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688d196feccf5ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:21.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.670+0000 7fbd67fff640 1 -- 172.21.15.46:0/847670188 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c037070 con 0x7fbd700c5f10 2024-05-09T02:20:21.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.670+0000 7fbd67fff640 1 -- 172.21.15.46:0/847670188 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c032440 con 0x7fbd700c5f10 2024-05-09T02:20:21.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.670+0000 7fbd67fff640 1 -- 172.21.15.46:0/847670188 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c032810 con 0x7fbd700c5f10 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.671+0000 7fbd774b8640 1 -- 172.21.15.46:0/847670188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd700c5f10 msgr2=0x7fbd700c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.671+0000 7fbd774b8640 1 --2- 172.21.15.46:0/847670188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd700c5f10 0x7fbd700c9950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ad870 tx=0x7fbd6c02a270 comp rx=0 tx=0).stop 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.671+0000 7fbd774b8640 1 -- 172.21.15.46:0/847670188 shutdown_connections 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.671+0000 7fbd774b8640 1 --2- 172.21.15.46:0/847670188 >> v2:172.21.15.46:3300/0 conn(0x7fbd70157dc0 0x7fbd701581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.671+0000 7fbd774b8640 1 --2- 172.21.15.46:0/847670188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd700c5f10 0x7fbd700c9950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.671+0000 7fbd774b8640 1 -- 172.21.15.46:0/847670188 >> 172.21.15.46:0/847670188 conn(0x7fbd70069040 msgr2=0x7fbd700ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.672+0000 7fbd774b8640 1 -- 172.21.15.46:0/847670188 shutdown_connections 2024-05-09T02:20:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.672+0000 7fbd774b8640 1 -- 172.21.15.46:0/847670188 wait complete. 2024-05-09T02:20:21.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.674+0000 7fbd774b8640 1 Processor -- start 2024-05-09T02:20:21.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.674+0000 7fbd774b8640 1 -- start start 2024-05-09T02:20:21.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.676+0000 7fbd774b8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd700c5f10 0x7fbd700aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.676+0000 7fbd774b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 0x7fbd7014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.676+0000 7fbd774b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 0x7fbd70158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd774b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbd700c7cb0 con 0x7fbd70154ec0 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd774b8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd700c77b0 con 0x7fbd70157dc0 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd774b8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd700c7f90 con 0x7fbd700c5f10 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 0x7fbd7014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd75a55640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 0x7fbd70158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 0x7fbd7014e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44372/0 (socket says 172.21.15.46:44372) 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 -- 172.21.15.46:0/3690271311 learned_addr learned my addr 172.21.15.46:0/3690271311 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd75a55640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 0x7fbd70158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49294/0 (socket says 172.21.15.46:49294) 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd75254640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd700c5f10 0x7fbd700aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 -- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd700c5f10 msgr2=0x7fbd700aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd700c5f10 0x7fbd700aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 -- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 msgr2=0x7fbd70158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 0x7fbd70158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 -- 172.21.15.46:0/3690271311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd701ee2d0 con 0x7fbd70154ec0 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd75a55640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 0x7fbd70158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.677+0000 7fbd74a53640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 0x7fbd7014e2a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbd60001ac0 tx=0x7fbd60012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.678+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd600072e0 con 0x7fbd70154ec0 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.678+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd600074a0 con 0x7fbd70154ec0 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.678+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60012350 con 0x7fbd70154ec0 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.678+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd70159b60 con 0x7fbd70154ec0 2024-05-09T02:20:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.679+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd700ada40 con 0x7fbd70154ec0 2024-05-09T02:20:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.679+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7006f960 con 0x7fbd70154ec0 2024-05-09T02:20:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.681+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd600124f0 con 0x7fbd70154ec0 2024-05-09T02:20:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.681+0000 7fbd65ffb640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd54076320 0x7fbd54078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.682+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fbd6009f810 con 0x7fbd70154ec0 2024-05-09T02:20:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.682+0000 7fbd75254640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd54076320 0x7fbd54078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.682+0000 7fbd75254640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd54076320 0x7fbd54078830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c034000 tx=0x7fbd6c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:21.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.690+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd60068ec0 con 0x7fbd70154ec0 2024-05-09T02:20:21.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.921+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd700ae640 con 0x7fbd70154ec0 2024-05-09T02:20:21.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.922+0000 7fbd65ffb640 1 -- 172.21.15.46:0/3690271311 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7fbd600687c0 con 0x7fbd70154ec0 2024-05-09T02:20:21.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:21.926 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd54076320 msgr2=0x7fbd54078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd54076320 0x7fbd54078830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c034000 tx=0x7fbd6c02e000 comp rx=0 tx=0).stop 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 msgr2=0x7fbd7014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 0x7fbd7014e2a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbd60001ac0 tx=0x7fbd60012f80 comp rx=0 tx=0).stop 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 shutdown_connections 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbd54076320 0x7fbd54078830 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd70157dc0 0x7fbd70158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd70154ec0 0x7fbd7014e2a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 --2- 172.21.15.46:0/3690271311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd700c5f10 0x7fbd700aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:21.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 >> 172.21.15.46:0/3690271311 conn(0x7fbd70069040 msgr2=0x7fbd700723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:21.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 shutdown_connections 2024-05-09T02:20:21.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:21.926+0000 7fbd774b8640 1 -- 172.21.15.46:0/3690271311 wait complete. 2024-05-09T02:20:21.944 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T02:20:23.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:23.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.814+0000 7f7f7d2e9640 1 Processor -- start 2024-05-09T02:20:23.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.814+0000 7f7f7d2e9640 1 -- start start 2024-05-09T02:20:23.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.816+0000 7f7f7d2e9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f780c9060 0x7f7f78155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:23.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.816+0000 7f7f7d2e9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f78158010 0x7f7f78158420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:23.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.816+0000 7f7f7d2e9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f780c46e0 con 0x7f7f780c9630 2024-05-09T02:20:23.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.816+0000 7f7f7d2e9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7f780c5720 con 0x7f7f78158010 2024-05-09T02:20:23.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.816+0000 7f7f7d2e9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7f781559b0 con 0x7f7f780c9060 2024-05-09T02:20:23.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f76ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f780c9060 0x7f7f78155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:23.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f767fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7f780c9630 0x7f7f780c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:53142/0 (socket says 172.21.15.46:53142) 2024-05-09T02:20:23.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f767fc640 1 -- 172.21.15.46:0/1364468254 learned_addr learned my addr 172.21.15.46:0/1364468254 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:23.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f777fe640 1 --2- 172.21.15.46:0/1364468254 >> v2:172.21.15.107:3300/0 conn(0x7f7f78158010 0x7f7f78158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:23.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f75ffb640 1 -- 172.21.15.46:0/1364468254 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540828615 0 0) 0x7f7f780c46e0 con 0x7f7f780c9630 2024-05-09T02:20:23.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f75ffb640 1 -- 172.21.15.46:0/1364468254 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f60003520 con 0x7f7f780c9630 2024-05-09T02:20:23.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f76ffd640 1 -- 172.21.15.46:0/1364468254 >> v2:172.21.15.107:3300/0 conn(0x7f7f78158010 msgr2=0x7f7f78158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:23.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f76ffd640 1 --2- 172.21.15.46:0/1364468254 >> v2:172.21.15.107:3300/0 conn(0x7f7f78158010 0x7f7f78158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:23.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f76ffd640 1 -- 172.21.15.46:0/1364468254 >> v1:172.21.15.107:6789/0 conn(0x7f7f780c9630 legacy=0x7f7f780c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:23.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f76ffd640 1 -- 172.21.15.46:0/1364468254 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f780c49c0 con 0x7f7f780c9060 2024-05-09T02:20:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.817+0000 7f7f777fe640 1 --2- 172.21.15.46:0/1364468254 >> v2:172.21.15.107:3300/0 conn(0x7f7f78158010 0x7f7f78158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.818+0000 7f7f76ffd640 1 --2- 172.21.15.46:0/1364468254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f780c9060 0x7f7f78155470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f680097a0 tx=0x7f7f6802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ea74964f6f0f23 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.819+0000 7f7f75ffb640 1 -- 172.21.15.46:0/1364468254 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68037070 con 0x7f7f780c9060 2024-05-09T02:20:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.819+0000 7f7f75ffb640 1 -- 172.21.15.46:0/1364468254 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6802ae50 con 0x7f7f780c9060 2024-05-09T02:20:23.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.819+0000 7f7f75ffb640 1 -- 172.21.15.46:0/1364468254 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68032660 con 0x7f7f780c9060 2024-05-09T02:20:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/1364468254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f780c9060 msgr2=0x7f7f78155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/1364468254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f780c9060 0x7f7f78155470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f680097a0 tx=0x7f7f6802a100 comp rx=0 tx=0).stop 2024-05-09T02:20:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/1364468254 shutdown_connections 2024-05-09T02:20:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/1364468254 >> v2:172.21.15.107:3300/0 conn(0x7f7f78158010 0x7f7f78158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/1364468254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f780c9060 0x7f7f78155470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:23.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/1364468254 >> 172.21.15.46:0/1364468254 conn(0x7f7f7806d7d0 msgr2=0x7f7f7806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:23.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/1364468254 shutdown_connections 2024-05-09T02:20:23.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.820+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/1364468254 wait complete. 2024-05-09T02:20:23.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.823+0000 7f7f7d2e9640 1 Processor -- start 2024-05-09T02:20:23.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.823+0000 7f7f7d2e9640 1 -- start start 2024-05-09T02:20:23.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f7d2e9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f780c9060 0x7f7f780c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:23.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f7d2e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 0x7f7f780bed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f7d2e9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f78158010 0x7f7f7814df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f7d2e9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780c6e80 con 0x7f7f780c9060 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f7d2e9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780c53b0 con 0x7f7f780c9630 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f7d2e9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7f780c7000 con 0x7f7f78158010 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f767fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 0x7f7f780bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f777fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f78158010 0x7f7f7814df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f767fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 0x7f7f780bed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49318/0 (socket says 172.21.15.46:49318) 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f767fc640 1 -- 172.21.15.46:0/809399247 learned_addr learned my addr 172.21.15.46:0/809399247 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.825+0000 7f7f76ffd640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f780c9060 0x7f7f780c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f767fc640 1 -- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f78158010 msgr2=0x7f7f7814df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f767fc640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f78158010 0x7f7f7814df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:23.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f767fc640 1 -- 172.21.15.46:0/809399247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f780c9060 msgr2=0x7f7f780c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f767fc640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f780c9060 0x7f7f780c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f767fc640 1 -- 172.21.15.46:0/809399247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f78159f60 con 0x7f7f780c9630 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f777fe640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f78158010 0x7f7f7814df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f76ffd640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f780c9060 0x7f7f780c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f767fc640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 0x7f7f780bed00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c3c0 tx=0x7f7f6c00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c017070 con 0x7f7f780c9630 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c005da0 con 0x7f7f780c9630 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0072d0 con 0x7f7f780c9630 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.826+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f780c0f20 con 0x7f7f780c9630 2024-05-09T02:20:23.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.827+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f780c2d70 con 0x7f7f780c9630 2024-05-09T02:20:23.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.828+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7806a330 con 0x7f7f780c9630 2024-05-09T02:20:23.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.829+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f6c01a070 con 0x7f7f780c9630 2024-05-09T02:20:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.830+0000 7f7f5f7fe640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f64076300 0x7f7f64078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.830+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f7f6c096c30 con 0x7f7f780c9630 2024-05-09T02:20:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.830+0000 7f7f76ffd640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f64076300 0x7f7f64078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.831+0000 7f7f76ffd640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f64076300 0x7f7f64078810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7f68034000 tx=0x7f7f6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:23.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:23.839+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7f6c05faf0 con 0x7f7f780c9630 2024-05-09T02:20:23.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:24.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.121+0000 7f5669b3c640 1 Processor -- start 2024-05-09T02:20:24.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.121+0000 7f5669b3c640 1 -- start start 2024-05-09T02:20:24.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f5669b3c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5664155160 0x7f56640c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f5662ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f56640c84a0 0x7f56640c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57760/0 (socket says 172.21.15.46:57760) 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f5662ffd640 1 -- 172.21.15.46:0/2959660019 learned_addr learned my addr 172.21.15.46:0/2959660019 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f56637fe640 1 --2- 172.21.15.46:0/2959660019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5664155160 0x7f56640c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5664158ae0 con 0x7f56640c84a0 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5664155570 con 0x7f566415b3a0 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.123+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5664157ed0 con 0x7f5664155160 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.124+0000 7f56627fc640 1 -- 172.21.15.46:0/2959660019 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941267934 0 0) 0x7f5664158ae0 con 0x7f56640c84a0 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.124+0000 7f56627fc640 1 -- 172.21.15.46:0/2959660019 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f564c003520 con 0x7f56640c84a0 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.124+0000 7f56637fe640 1 -- 172.21.15.46:0/2959660019 >> v1:172.21.15.107:6789/0 conn(0x7f566415b3a0 legacy=0x7f566415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.124+0000 7f56637fe640 1 -- 172.21.15.46:0/2959660019 >> v1:172.21.15.46:6789/0 conn(0x7f56640c84a0 legacy=0x7f56640c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.124+0000 7f56637fe640 1 -- 172.21.15.46:0/2959660019 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56641581b0 con 0x7f5664155160 2024-05-09T02:20:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.125+0000 7f56637fe640 1 --2- 172.21.15.46:0/2959660019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5664155160 0x7f56640c7f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5654009750 tx=0x7f5654029ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b19c4e3c5355c6c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.125+0000 7f56627fc640 1 -- 172.21.15.46:0/2959660019 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654037070 con 0x7f5664155160 2024-05-09T02:20:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.125+0000 7f56627fc640 1 -- 172.21.15.46:0/2959660019 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565402abd0 con 0x7f5664155160 2024-05-09T02:20:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.125+0000 7f56627fc640 1 -- 172.21.15.46:0/2959660019 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654032440 con 0x7f5664155160 2024-05-09T02:20:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.126+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5664155160 msgr2=0x7f56640c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.126+0000 7f5669b3c640 1 --2- 172.21.15.46:0/2959660019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5664155160 0x7f56640c7f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5654009750 tx=0x7f5654029ec0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.127+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 shutdown_connections 2024-05-09T02:20:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.127+0000 7f5669b3c640 1 --2- 172.21.15.46:0/2959660019 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5664155160 0x7f56640c7f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.127+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 >> 172.21.15.46:0/2959660019 conn(0x7f56640aebe0 msgr2=0x7f56640aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.127+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 shutdown_connections 2024-05-09T02:20:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.127+0000 7f5669b3c640 1 -- 172.21.15.46:0/2959660019 wait complete. 2024-05-09T02:20:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.129+0000 7f5669b3c640 1 Processor -- start 2024-05-09T02:20:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.130+0000 7f5669b3c640 1 -- start start 2024-05-09T02:20:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5669b3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 0x7f566414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5669b3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5664155160 0x7f56641f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f56637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 0x7f566414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f56637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 0x7f566414bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44380/0 (socket says 172.21.15.46:44380) 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5662ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5664155160 0x7f56641f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5662ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5664155160 0x7f56641f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49334/0 (socket says 172.21.15.46:49334) 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5669b3c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f566415b3a0 0x7f5664150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f56637fe640 1 -- 172.21.15.46:0/428230986 learned_addr learned my addr 172.21.15.46:0/428230986 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5669b3c640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5664157b30 con 0x7f56640c84a0 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5669b3c640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5664158770 con 0x7f5664155160 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5669b3c640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5664157cb0 con 0x7f566415b3a0 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.132+0000 7f5663fff640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f566415b3a0 0x7f5664150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5663fff640 1 -- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5664155160 msgr2=0x7f56641f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5663fff640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5664155160 0x7f56641f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5663fff640 1 -- 172.21.15.46:0/428230986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 msgr2=0x7f566414bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5663fff640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 0x7f566414bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5663fff640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5664154a60 con 0x7f566415b3a0 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f56637fe640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 0x7f566414bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5663fff640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f566415b3a0 0x7f5664150b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c7f0 tx=0x7f565c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c017070 con 0x7f566415b3a0 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c003da0 con 0x7f566415b3a0 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c0052b0 con 0x7f566415b3a0 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5669b3c640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5664148650 con 0x7f566415b3a0 2024-05-09T02:20:24.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.133+0000 7f5669b3c640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f566414a210 con 0x7f566415b3a0 2024-05-09T02:20:24.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.135+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566406a330 con 0x7f566415b3a0 2024-05-09T02:20:24.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.136+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f565c01a070 con 0x7f566415b3a0 2024-05-09T02:20:24.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.137+0000 7f564bfff640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5650076300 0x7f5650078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:24.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.137+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f565c096fd0 con 0x7f566415b3a0 2024-05-09T02:20:24.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.137+0000 7f56637fe640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5650076300 0x7f5650078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:24.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.138+0000 7f56637fe640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5650076300 0x7f5650078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f565402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:24.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.146+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f565c05fe90 con 0x7f566415b3a0 2024-05-09T02:20:24.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.312+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f780c8430 con 0x7f7f780c9630 2024-05-09T02:20:24.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.313+0000 7f7f5f7fe640 1 -- 172.21.15.46:0/809399247 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f7f6c063df0 con 0x7f7f780c9630 2024-05-09T02:20:24.316 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:24.316 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:24.316 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f64076300 msgr2=0x7f7f64078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f64076300 0x7f7f64078810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7f68034000 tx=0x7f7f6802e000 comp rx=0 tx=0).stop 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 msgr2=0x7f7f780bed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 0x7f7f780bed00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c3c0 tx=0x7f7f6c00c7c0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 shutdown_connections 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7f64076300 0x7f7f64078810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7f78158010 0x7f7f7814df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f780c9630 0x7f7f780bed00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 --2- 172.21.15.46:0/809399247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f780c9060 0x7f7f780c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 >> 172.21.15.46:0/809399247 conn(0x7f7f7806d7d0 msgr2=0x7f7f7806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:24.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 shutdown_connections 2024-05-09T02:20:24.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.316+0000 7f7f7d2e9640 1 -- 172.21.15.46:0/809399247 wait complete. 2024-05-09T02:20:24.335 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:20:24.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.617+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56640c7220 con 0x7f566415b3a0 2024-05-09T02:20:24.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.617+0000 7f564bfff640 1 -- 172.21.15.46:0/428230986 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f565c064190 con 0x7f566415b3a0 2024-05-09T02:20:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:24.620 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:24.621 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.620+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5650076300 msgr2=0x7f5650078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.620+0000 7f5649ffb640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5650076300 0x7f5650078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f565402e000 comp rx=0 tx=0).stop 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f566415b3a0 msgr2=0x7f5664150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f566415b3a0 0x7f5664150b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c7f0 tx=0x7f565c00ccb0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 shutdown_connections 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5650076300 0x7f5650078810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f566415b3a0 0x7f5664150b70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5664155160 0x7f56641f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 --2- 172.21.15.46:0/428230986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56640c84a0 0x7f566414bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 >> 172.21.15.46:0/428230986 conn(0x7f56640aebe0 msgr2=0x7f566414ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 shutdown_connections 2024-05-09T02:20:24.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:24.621+0000 7f5649ffb640 1 -- 172.21.15.46:0/428230986 wait complete. 2024-05-09T02:20:24.639 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T02:20:26.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.452+0000 7fb3c4bd5640 1 Processor -- start 2024-05-09T02:20:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.452+0000 7fb3c4bd5640 1 -- start start 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3c4bd5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb3c00ae8c0 0x7fb3c00aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3c4bd5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00af210 0x7fb3c00c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3c4bd5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c0071a80 con 0x7fb3c00715a0 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3c4bd5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c00706f0 con 0x7fb3c00ae8c0 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3c4bd5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c0070f90 con 0x7fb3c00af210 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3be59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb3c00715a0 0x7fb3c014ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59126/0 (socket says 172.21.15.46:59126) 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3be59c640 1 -- 172.21.15.46:0/2372713419 learned_addr learned my addr 172.21.15.46:0/2372713419 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3bed9d640 1 --2- 172.21.15.46:0/2372713419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00af210 0x7fb3c00c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.454+0000 7fb3bdd9b640 1 --2- 172.21.15.46:0/2372713419 >> v2:172.21.15.107:3300/0 conn(0x7fb3c00ae8c0 0x7fb3c00aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bd59a640 1 -- 172.21.15.46:0/2372713419 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422882600 0 0) 0x7fb3c0071a80 con 0x7fb3c00715a0 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bd59a640 1 -- 172.21.15.46:0/2372713419 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3a8003520 con 0x7fb3c00715a0 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bed9d640 1 -- 172.21.15.46:0/2372713419 >> v2:172.21.15.107:3300/0 conn(0x7fb3c00ae8c0 msgr2=0x7fb3c00aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bed9d640 1 --2- 172.21.15.46:0/2372713419 >> v2:172.21.15.107:3300/0 conn(0x7fb3c00ae8c0 0x7fb3c00aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bed9d640 1 -- 172.21.15.46:0/2372713419 >> v1:172.21.15.46:6789/0 conn(0x7fb3c00715a0 legacy=0x7fb3c014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bed9d640 1 -- 172.21.15.46:0/2372713419 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c0070940 con 0x7fb3c00af210 2024-05-09T02:20:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.455+0000 7fb3bdd9b640 1 --2- 172.21.15.46:0/2372713419 >> v2:172.21.15.107:3300/0 conn(0x7fb3c00ae8c0 0x7fb3c00aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:26.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.456+0000 7fb3bed9d640 1 --2- 172.21.15.46:0/2372713419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00af210 0x7fb3c00c4060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800aea0 tx=0x7fb3b802c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b76e9caea295c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.456+0000 7fb3bd59a640 1 -- 172.21.15.46:0/2372713419 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8039070 con 0x7fb3c00af210 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.456+0000 7fb3bd59a640 1 -- 172.21.15.46:0/2372713419 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b8034660 con 0x7fb3c00af210 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.456+0000 7fb3bd59a640 1 -- 172.21.15.46:0/2372713419 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8034a30 con 0x7fb3c00af210 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/2372713419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00af210 msgr2=0x7fb3c00c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/2372713419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00af210 0x7fb3c00c4060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800aea0 tx=0x7fb3b802c8b0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/2372713419 shutdown_connections 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/2372713419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00af210 0x7fb3c00c4060 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/2372713419 >> v2:172.21.15.107:3300/0 conn(0x7fb3c00ae8c0 0x7fb3c00aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/2372713419 >> 172.21.15.46:0/2372713419 conn(0x7fb3c0074220 msgr2=0x7fb3c006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:26.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/2372713419 shutdown_connections 2024-05-09T02:20:26.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.457+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/2372713419 wait complete. 2024-05-09T02:20:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.460+0000 7fb3c4bd5640 1 Processor -- start 2024-05-09T02:20:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.460+0000 7fb3c4bd5640 1 -- start start 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.462+0000 7fb3c4bd5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 0x7fb3c0157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3c4bd5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3c00ae8c0 0x7fb3c0155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3c4bd5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3c00af210 0x7fb3c014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3c4bd5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c00687f0 con 0x7fb3c00af210 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3c4bd5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c00ab060 con 0x7fb3c00ae8c0 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3c4bd5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c0068970 con 0x7fb3c00715a0 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 0x7fb3c0157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 0x7fb3c0157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56740/0 (socket says 172.21.15.46:56740) 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 -- 172.21.15.46:0/4093838158 learned_addr learned my addr 172.21.15.46:0/4093838158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3bed9d640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3c00af210 0x7fb3c014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3bdd9b640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3c00ae8c0 0x7fb3c0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 -- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3c00ae8c0 msgr2=0x7fb3c0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3c00ae8c0 0x7fb3c0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 -- 172.21.15.46:0/4093838158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3c00af210 msgr2=0x7fb3c014fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3c00af210 0x7fb3c014fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 -- 172.21.15.46:0/4093838158 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c0152010 con 0x7fb3c00715a0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.463+0000 7fb3be59c640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 0x7fb3c0157bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c410 tx=0x7fb3b000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.464+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0017070 con 0x7fb3c00715a0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.464+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0005ce0 con 0x7fb3c00715a0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.464+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00072f0 con 0x7fb3c00715a0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.464+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c01ea580 con 0x7fb3c00715a0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.464+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c00c3090 con 0x7fb3c00715a0 2024-05-09T02:20:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.465+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c0068da0 con 0x7fb3c00715a0 2024-05-09T02:20:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.466+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb3b001a070 con 0x7fb3c00715a0 2024-05-09T02:20:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.467+0000 7fb3aeffd640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3a00762d0 0x7fb3a00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.467+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fb3b00971c0 con 0x7fb3c00715a0 2024-05-09T02:20:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.467+0000 7fb3bdd9b640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3a00762d0 0x7fb3a00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.468+0000 7fb3bdd9b640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3a00762d0 0x7fb3a00787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0152360 tx=0x7fb3b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.474+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb3c0068da0 con 0x7fb3c00715a0 2024-05-09T02:20:26.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.755+0000 7fd6aaa30640 1 Processor -- start 2024-05-09T02:20:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.755+0000 7fd6aaa30640 1 -- start start 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.756+0000 7fd6aaa30640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd6a4155160 0x7fd6a40c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.756+0000 7fd6aaa30640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.756+0000 7fd6aaa30640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a4158ae0 con 0x7fd6a40c84a0 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.756+0000 7fd6aaa30640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a4155570 con 0x7fd6a4155160 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.756+0000 7fd6aaa30640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a4157ed0 con 0x7fd6a415b3a0 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a8fcd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a37fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd6a40c84a0 0x7fd6a40c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:53762/0 (socket says 172.21.15.46:53762) 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a37fe640 1 -- 172.21.15.46:0/1181925106 learned_addr learned my addr 172.21.15.46:0/1181925106 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd6a4155160 0x7fd6a40c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a3fff640 1 -- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 msgr2=0x7fd6a415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a3fff640 1 --2- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a3fff640 1 -- 172.21.15.46:0/1181925106 >> v1:172.21.15.107:6789/0 conn(0x7fd6a40c84a0 legacy=0x7fd6a40c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a2ffd640 1 -- 172.21.15.46:0/1181925106 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128410703 0 0) 0x7fd6a4158ae0 con 0x7fd6a40c84a0 2024-05-09T02:20:26.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a3fff640 1 -- 172.21.15.46:0/1181925106 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a41581b0 con 0x7fd6a4155160 2024-05-09T02:20:26.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.757+0000 7fd6a8fcd640 1 --2- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:26.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.758+0000 7fd6a3fff640 1 --2- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a40c7f60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6940097a0 tx=0x7fd69402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2de8e50372b6b80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:26.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.758+0000 7fd6a2ffd640 1 -- 172.21.15.46:0/1181925106 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694037070 con 0x7fd6a4155160 2024-05-09T02:20:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6a2ffd640 1 -- 172.21.15.46:0/1181925106 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69402adb0 con 0x7fd6a4155160 2024-05-09T02:20:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6a2ffd640 1 -- 172.21.15.46:0/1181925106 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694032660 con 0x7fd6a4155160 2024-05-09T02:20:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 -- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 msgr2=0x7fd6a40c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 --2- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a40c7f60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6940097a0 tx=0x7fd69402a060 comp rx=0 tx=0).stop 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 -- 172.21.15.46:0/1181925106 shutdown_connections 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 --2- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 --2- 172.21.15.46:0/1181925106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a40c7f60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 -- 172.21.15.46:0/1181925106 >> 172.21.15.46:0/1181925106 conn(0x7fd6a40aebe0 msgr2=0x7fd6a40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 -- 172.21.15.46:0/1181925106 shutdown_connections 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.759+0000 7fd6aaa30640 1 -- 172.21.15.46:0/1181925106 wait complete. 2024-05-09T02:20:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.761+0000 7fd6aaa30640 1 Processor -- start 2024-05-09T02:20:26.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.761+0000 7fd6aaa30640 1 -- start start 2024-05-09T02:20:26.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6aaa30640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a40c84a0 0x7fd6a4148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6aaa30640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6aaa30640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a4149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6aaa30640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4157b30 con 0x7fd6a40c84a0 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6aaa30640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4158770 con 0x7fd6a4155160 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6aaa30640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a4157cb0 con 0x7fd6a415b3a0 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a415a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:48946/0 (socket says 172.21.15.46:48946) 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 -- 172.21.15.46:0/2910059060 learned_addr learned my addr 172.21.15.46:0/2910059060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a8fcd640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a4149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a3fff640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a40c84a0 0x7fd6a4148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 -- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 msgr2=0x7fd6a4149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a4149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 -- 172.21.15.46:0/2910059060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a40c84a0 msgr2=0x7fd6a4148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a40c84a0 0x7fd6a4148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 -- 172.21.15.46:0/2910059060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a415ac10 con 0x7fd6a4155160 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a3fff640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a40c84a0 0x7fd6a4148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.763+0000 7fd6a37fe640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a415a6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd698001ac0 tx=0x7fd698014420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.764+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698014b30 con 0x7fd6a4155160 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.764+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd698014cf0 con 0x7fd6a4155160 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.764+0000 7fd6aaa30640 1 -- 172.21.15.46:0/2910059060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a4159a60 con 0x7fd6a4155160 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.764+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698007310 con 0x7fd6a4155160 2024-05-09T02:20:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.764+0000 7fd6aaa30640 1 -- 172.21.15.46:0/2910059060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41496a0 con 0x7fd6a4155160 2024-05-09T02:20:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.765+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a406a330 con 0x7fd6a4155160 2024-05-09T02:20:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.766+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd6980074b0 con 0x7fd6a4155160 2024-05-09T02:20:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.767+0000 7fd6a0ff9640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd6900762d0 0x7fd6900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.767+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fd69809faf0 con 0x7fd6a4155160 2024-05-09T02:20:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.767+0000 7fd6a3fff640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd6900762d0 0x7fd6900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.767+0000 7fd6a3fff640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd6900762d0 0x7fd6900787e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd694034000 tx=0x7fd69402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.775+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd698069090 con 0x7fd6a4155160 2024-05-09T02:20:26.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.825+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3c006a330 con 0x7fb3c00715a0 2024-05-09T02:20:26.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.826+0000 7fb3aeffd640 1 -- 172.21.15.46:0/4093838158 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7fb3b0021020 con 0x7fb3c00715a0 2024-05-09T02:20:26.829 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:26.829 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:26.829 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:26.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3a00762d0 msgr2=0x7fb3a00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3a00762d0 0x7fb3a00787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0152360 tx=0x7fb3b4008040 comp rx=0 tx=0).stop 2024-05-09T02:20:26.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 msgr2=0x7fb3c0157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:26.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 0x7fb3c0157bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c410 tx=0x7fb3b000c8d0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 shutdown_connections 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3a00762d0 0x7fb3a00787e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3c00af210 0x7fb3c014fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3c00ae8c0 0x7fb3c0155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 --2- 172.21.15.46:0/4093838158 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3c00715a0 0x7fb3c0157bc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 >> 172.21.15.46:0/4093838158 conn(0x7fb3c0074220 msgr2=0x7fb3c00ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 shutdown_connections 2024-05-09T02:20:26.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:26.828+0000 7fb3c4bd5640 1 -- 172.21.15.46:0/4093838158 wait complete. 2024-05-09T02:20:26.843 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:20:27.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.081+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6a4157910 con 0x7fd6a4155160 2024-05-09T02:20:27.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.082+0000 7fd6a0ff9640 1 -- 172.21.15.46:0/2910059060 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7fd698068990 con 0x7fd6a4155160 2024-05-09T02:20:27.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:27.086 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:27.087 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd6900762d0 msgr2=0x7fd6900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd6900762d0 0x7fd6900787e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd694034000 tx=0x7fd69402e000 comp rx=0 tx=0).stop 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 msgr2=0x7fd6a415a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a415a6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd698001ac0 tx=0x7fd698014420 comp rx=0 tx=0).stop 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 shutdown_connections 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd6900762d0 0x7fd6900787e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6a415b3a0 0x7fd6a4149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6a4155160 0x7fd6a415a6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 --2- 172.21.15.46:0/2910059060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a40c84a0 0x7fd6a4148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 >> 172.21.15.46:0/2910059060 conn(0x7fd6a40aebe0 msgr2=0x7fd6a40cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:27.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 shutdown_connections 2024-05-09T02:20:27.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:27.084+0000 7fd68a7fc640 1 -- 172.21.15.46:0/2910059060 wait complete. 2024-05-09T02:20:27.099 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T02:20:28.844 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:29.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.018+0000 7fde8d9d5640 1 Processor -- start 2024-05-09T02:20:29.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.018+0000 7fde8d9d5640 1 -- start start 2024-05-09T02:20:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde8d9d5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fde88156080 0x7fde88156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde8d9d5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde880c4750 0x7fde880c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde8d9d5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde88073f60 con 0x7fde880af580 2024-05-09T02:20:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde8d9d5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fde880c5af0 con 0x7fde880c4750 2024-05-09T02:20:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde8d9d5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fde88071170 con 0x7fde88156080 2024-05-09T02:20:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde86ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fde880af580 0x7fde880abdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59130/0 (socket says 172.21.15.46:59130) 2024-05-09T02:20:29.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde86ffd640 1 -- 172.21.15.46:0/2435511028 learned_addr learned my addr 172.21.15.46:0/2435511028 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:29.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde877fe640 1 --2- 172.21.15.46:0/2435511028 >> v2:172.21.15.46:3300/0 conn(0x7fde880c4750 0x7fde880c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde867fc640 1 --2- 172.21.15.46:0/2435511028 >> v2:172.21.15.107:3300/0 conn(0x7fde88156080 0x7fde88156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.020+0000 7fde85ffb640 1 -- 172.21.15.46:0/2435511028 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472689249 0 0) 0x7fde88073f60 con 0x7fde880af580 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.021+0000 7fde85ffb640 1 -- 172.21.15.46:0/2435511028 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde70003520 con 0x7fde880af580 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.021+0000 7fde877fe640 1 -- 172.21.15.46:0/2435511028 >> v2:172.21.15.107:3300/0 conn(0x7fde88156080 msgr2=0x7fde88156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.021+0000 7fde877fe640 1 --2- 172.21.15.46:0/2435511028 >> v2:172.21.15.107:3300/0 conn(0x7fde88156080 0x7fde88156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.021+0000 7fde877fe640 1 -- 172.21.15.46:0/2435511028 >> v1:172.21.15.46:6789/0 conn(0x7fde880af580 legacy=0x7fde880abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.021+0000 7fde877fe640 1 -- 172.21.15.46:0/2435511028 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde880713c0 con 0x7fde880c4750 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.022+0000 7fde877fe640 1 --2- 172.21.15.46:0/2435511028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde880c4750 0x7fde880c4b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fde8806d760 tx=0x7fde8002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39dc0ae45361570 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.022+0000 7fde85ffb640 1 -- 172.21.15.46:0/2435511028 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80007740 con 0x7fde880c4750 2024-05-09T02:20:29.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.022+0000 7fde85ffb640 1 -- 172.21.15.46:0/2435511028 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde800078e0 con 0x7fde880c4750 2024-05-09T02:20:29.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.022+0000 7fde85ffb640 1 -- 172.21.15.46:0/2435511028 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80007cb0 con 0x7fde880c4750 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 -- 172.21.15.46:0/2435511028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde880c4750 msgr2=0x7fde880c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/2435511028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde880c4750 0x7fde880c4b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fde8806d760 tx=0x7fde8002a610 comp rx=0 tx=0).stop 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 -- 172.21.15.46:0/2435511028 shutdown_connections 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/2435511028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde880c4750 0x7fde880c4b60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/2435511028 >> v2:172.21.15.107:3300/0 conn(0x7fde88156080 0x7fde88156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 -- 172.21.15.46:0/2435511028 >> 172.21.15.46:0/2435511028 conn(0x7fde880c6770 msgr2=0x7fde880c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 -- 172.21.15.46:0/2435511028 shutdown_connections 2024-05-09T02:20:29.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.023+0000 7fde8d9d5640 1 -- 172.21.15.46:0/2435511028 wait complete. 2024-05-09T02:20:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.026+0000 7fde8d9d5640 1 Processor -- start 2024-05-09T02:20:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.026+0000 7fde8d9d5640 1 -- start start 2024-05-09T02:20:29.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde8d9d5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde880af580 0x7fde880c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde8d9d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 0x7fde880ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde8d9d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde88156080 0x7fde881585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde8d9d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde88071980 con 0x7fde88156080 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde86ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde880af580 0x7fde880c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde867fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 0x7fde880ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde867fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 0x7fde880ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:48958/0 (socket says 172.21.15.46:48958) 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde86ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde880af580 0x7fde880c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56776/0 (socket says 172.21.15.46:56776) 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde867fc640 1 -- 172.21.15.46:0/3195165037 learned_addr learned my addr 172.21.15.46:0/3195165037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde877fe640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde88156080 0x7fde881585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde88070b20 con 0x7fde880c4750 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.029+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde880af990 con 0x7fde880af580 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde867fc640 1 -- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde880af580 msgr2=0x7fde880c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde867fc640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde880af580 0x7fde880c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde867fc640 1 -- 172.21.15.46:0/3195165037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde88156080 msgr2=0x7fde881585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde867fc640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde88156080 0x7fde881585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde867fc640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde880ad4e0 con 0x7fde880c4750 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde877fe640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde88156080 0x7fde881585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde867fc640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 0x7fde880ae090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00e870 tx=0x7fde7c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.030+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c017070 con 0x7fde880c4750 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.031+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c00ee60 con 0x7fde880c4750 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.031+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde881ed6d0 con 0x7fde880c4750 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.031+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00cb80 con 0x7fde880c4750 2024-05-09T02:20:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.031+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881edc90 con 0x7fde880c4750 2024-05-09T02:20:29.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.032+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde88152f00 con 0x7fde880c4750 2024-05-09T02:20:29.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.033+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde7c01a070 con 0x7fde880c4750 2024-05-09T02:20:29.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.034+0000 7fde6ffff640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde74076300 0x7fde74078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.034+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fde7c097bf0 con 0x7fde880c4750 2024-05-09T02:20:29.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.034+0000 7fde86ffd640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde74076300 0x7fde74078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.035+0000 7fde86ffd640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde74076300 0x7fde74078810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fde78005880 tx=0x7fde78006aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:29.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.044+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde88152f00 con 0x7fde880c4750 2024-05-09T02:20:29.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:29.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.219+0000 7f7efcfa0640 1 Processor -- start 2024-05-09T02:20:29.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.220+0000 7f7efcfa0640 1 -- start start 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7efcfa0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7ef81586d0 0x7f7ef80c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7efcfa0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7ef80abe80 0x7f7ef8151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7ef77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7ef81586d0 0x7f7ef80c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7ef77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7ef81586d0 0x7f7ef80c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58100/0 (socket says 172.21.15.46:58100) 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7efcfa0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef80c60d0 con 0x7f7ef80aba70 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7ef77fe640 1 -- 172.21.15.46:0/1448607168 learned_addr learned my addr 172.21.15.46:0/1448607168 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef80c63b0 con 0x7f7ef81586d0 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef8158240 con 0x7f7ef80abe80 2024-05-09T02:20:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.221+0000 7f7ef7fff640 1 --2- 172.21.15.46:0/1448607168 >> v2:172.21.15.107:3300/0 conn(0x7f7ef80abe80 0x7f7ef8151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef67fc640 1 -- 172.21.15.46:0/1448607168 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027413569 0 0) 0x7f7ef80c60d0 con 0x7f7ef80aba70 2024-05-09T02:20:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef67fc640 1 -- 172.21.15.46:0/1448607168 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ee0003520 con 0x7f7ef80aba70 2024-05-09T02:20:29.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef77fe640 1 -- 172.21.15.46:0/1448607168 >> v2:172.21.15.107:3300/0 conn(0x7f7ef80abe80 msgr2=0x7f7ef8151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef77fe640 1 --2- 172.21.15.46:0/1448607168 >> v2:172.21.15.107:3300/0 conn(0x7f7ef80abe80 0x7f7ef8151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef77fe640 1 -- 172.21.15.46:0/1448607168 >> v1:172.21.15.107:6789/0 conn(0x7f7ef80aba70 legacy=0x7f7ef8070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef77fe640 1 -- 172.21.15.46:0/1448607168 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef8157bf0 con 0x7f7ef81586d0 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.222+0000 7f7ef7fff640 1 --2- 172.21.15.46:0/1448607168 >> v2:172.21.15.107:3300/0 conn(0x7f7ef80abe80 0x7f7ef8151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.223+0000 7f7ef77fe640 1 --2- 172.21.15.46:0/1448607168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef80c4fe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7ef81581b0 tx=0x7f7ee802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6937a037e147c1a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.223+0000 7f7ef67fc640 1 -- 172.21.15.46:0/1448607168 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8037070 con 0x7f7ef81586d0 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.223+0000 7f7ef67fc640 1 -- 172.21.15.46:0/1448607168 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee8032440 con 0x7f7ef81586d0 2024-05-09T02:20:29.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.223+0000 7f7ef67fc640 1 -- 172.21.15.46:0/1448607168 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80327f0 con 0x7f7ef81586d0 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 msgr2=0x7f7ef80c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/1448607168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef80c4fe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7ef81581b0 tx=0x7f7ee802a160 comp rx=0 tx=0).stop 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 shutdown_connections 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/1448607168 >> v2:172.21.15.107:3300/0 conn(0x7f7ef80abe80 0x7f7ef8151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/1448607168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef80c4fe0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 >> 172.21.15.46:0/1448607168 conn(0x7f7ef80c6560 msgr2=0x7f7ef80c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 shutdown_connections 2024-05-09T02:20:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.224+0000 7f7efcfa0640 1 -- 172.21.15.46:0/1448607168 wait complete. 2024-05-09T02:20:29.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.227+0000 7f7efcfa0640 1 Processor -- start 2024-05-09T02:20:29.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.227+0000 7f7efcfa0640 1 -- start start 2024-05-09T02:20:29.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7efcfa0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 0x7f7ef814c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7efcfa0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7efcfa0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8161750 0x7f7ef8143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7efcfa0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80ac4c0 con 0x7f7ef81586d0 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7efcfa0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8070f50 con 0x7f7ef8161750 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7efcfa0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef80c5cf0 con 0x7f7ef80aba70 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7ef77fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 0x7f7ef814c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7ef77fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 0x7f7ef814c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56790/0 (socket says 172.21.15.46:56790) 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7ef77fe640 1 -- 172.21.15.46:0/3482010254 learned_addr learned my addr 172.21.15.46:0/3482010254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.229+0000 7f7ef7fff640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8161750 0x7f7ef8143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef6ffd640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef77fe640 1 -- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8161750 msgr2=0x7f7ef8143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef77fe640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8161750 0x7f7ef8143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef77fe640 1 -- 172.21.15.46:0/3482010254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 msgr2=0x7f7ef814a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef77fe640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef814a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef77fe640 1 -- 172.21.15.46:0/3482010254 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef8160f90 con 0x7f7ef80aba70 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef6ffd640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef814a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7ef77fe640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 0x7f7ef814c320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8035040 tx=0x7f7ee80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8041020 con 0x7f7ef80aba70 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee8030970 con 0x7f7ef80aba70 2024-05-09T02:20:29.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.230+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8037040 con 0x7f7ef80aba70 2024-05-09T02:20:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.232+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef81f1b40 con 0x7f7ef80aba70 2024-05-09T02:20:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.232+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef81f1e20 con 0x7f7ef80aba70 2024-05-09T02:20:29.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.232+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef8050870 con 0x7f7ef80aba70 2024-05-09T02:20:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.234+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ee8044020 con 0x7f7ef80aba70 2024-05-09T02:20:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.235+0000 7f7edffff640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7ee4076300 0x7f7ee4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.235+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f7ee80b86c0 con 0x7f7ef80aba70 2024-05-09T02:20:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.235+0000 7f7ef6ffd640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7ee4076300 0x7f7ee4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:29.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.236+0000 7f7ef6ffd640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7ee4076300 0x7f7ee4078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8142a30 tx=0x7f7eec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.242+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ee804b070 con 0x7f7ef80aba70 2024-05-09T02:20:29.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.472+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ef80afdf0 con 0x7f7ef80aba70 2024-05-09T02:20:29.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.473+0000 7f7edffff640 1 -- 172.21.15.46:0/3482010254 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7f7ee8081c20 con 0x7f7ef80aba70 2024-05-09T02:20:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:29.477 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:29.477 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7ee4076300 msgr2=0x7f7ee4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7ee4076300 0x7f7ee4078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8142a30 tx=0x7f7eec009040 comp rx=0 tx=0).stop 2024-05-09T02:20:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 msgr2=0x7f7ef814c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 0x7f7ef814c320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8035040 tx=0x7f7ee80046c0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 shutdown_connections 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7ee4076300 0x7f7ee4078810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ef8161750 0x7f7ef8143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef81586d0 0x7f7ef814a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 --2- 172.21.15.46:0/3482010254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ef80aba70 0x7f7ef814c320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 >> 172.21.15.46:0/3482010254 conn(0x7f7ef80c6560 msgr2=0x7f7ef814f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.475+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 shutdown_connections 2024-05-09T02:20:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.476+0000 7f7efcfa0640 1 -- 172.21.15.46:0/3482010254 wait complete. 2024-05-09T02:20:29.490 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T02:20:29.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.515+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde8806a330 con 0x7fde880c4750 2024-05-09T02:20:29.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.516+0000 7fde6ffff640 1 -- 172.21.15.46:0/3195165037 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6493 (secure 0 0 0) 0x7fde880ad4e0 con 0x7fde880c4750 2024-05-09T02:20:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:29.518 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:19:07.894919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6835/687229870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":687229870},{"type":"v1","addr":"172.21.15.46:6835","nonce":687229870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:19:57.899058+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.107:6837/3709209674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3709209674},{"type":"v1","addr":"172.21.15.107:6837","nonce":3709209674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4888,"qdb_cluster":[4888]},"id":2}]} 2024-05-09T02:20:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T02:20:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde74076300 msgr2=0x7fde74078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde74076300 0x7fde74078810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fde78005880 tx=0x7fde78006aa0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 msgr2=0x7fde880ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 0x7fde880ae090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00e870 tx=0x7fde7c00ed30 comp rx=0 tx=0).stop 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 shutdown_connections 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde74076300 0x7fde74078810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde88156080 0x7fde881585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde880c4750 0x7fde880ae090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 --2- 172.21.15.46:0/3195165037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde880af580 0x7fde880c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.518+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 >> 172.21.15.46:0/3195165037 conn(0x7fde880c6770 msgr2=0x7fde881597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.519+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 shutdown_connections 2024-05-09T02:20:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:29.519+0000 7fde8d9d5640 1 -- 172.21.15.46:0/3195165037 wait complete. 2024-05-09T02:20:29.537 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-09T02:20:31.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:31.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.659+0000 7fa72c1e8640 1 Processor -- start 2024-05-09T02:20:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.659+0000 7fa72c1e8640 1 -- start start 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.661+0000 7fa72c1e8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7240c9060 0x7fa724155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa72c1e8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7240c46e0 con 0x7fa724158010 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa72c1e8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7240c49c0 con 0x7fa7240c9630 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa72c1e8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7240c5720 con 0x7fa7240c9060 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa72a785640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa724158010 0x7fa724158420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59136/0 (socket says 172.21.15.46:59136) 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa72a785640 1 -- 172.21.15.46:0/1737955433 learned_addr learned my addr 172.21.15.46:0/1737955433 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa729f84640 1 --2- 172.21.15.46:0/1737955433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7240c9060 0x7fa724155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa729f84640 1 -- 172.21.15.46:0/1737955433 >> v1:172.21.15.107:6789/0 conn(0x7fa7240c9630 legacy=0x7fa7240c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa729f84640 1 -- 172.21.15.46:0/1737955433 >> v1:172.21.15.46:6789/0 conn(0x7fa724158010 legacy=0x7fa724158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.662+0000 7fa729f84640 1 -- 172.21.15.46:0/1737955433 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7240c4ca0 con 0x7fa7240c9060 2024-05-09T02:20:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.663+0000 7fa728f82640 1 -- 172.21.15.46:0/1737955433 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816709013 0 0) 0x7fa7240c46e0 con 0x7fa724158010 2024-05-09T02:20:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.663+0000 7fa729f84640 1 --2- 172.21.15.46:0/1737955433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7240c9060 0x7fa724155470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097d0 tx=0x7fa72002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f088cea18aea0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.664+0000 7fa728f82640 1 -- 172.21.15.46:0/1737955433 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720037070 con 0x7fa7240c9060 2024-05-09T02:20:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.664+0000 7fa728f82640 1 -- 172.21.15.46:0/1737955433 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720032440 con 0x7fa7240c9060 2024-05-09T02:20:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.664+0000 7fa728f82640 1 -- 172.21.15.46:0/1737955433 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720032810 con 0x7fa7240c9060 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 -- 172.21.15.46:0/1737955433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7240c9060 msgr2=0x7fa724155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/1737955433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7240c9060 0x7fa724155470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097d0 tx=0x7fa72002a180 comp rx=0 tx=0).stop 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 -- 172.21.15.46:0/1737955433 shutdown_connections 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/1737955433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7240c9060 0x7fa724155470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 -- 172.21.15.46:0/1737955433 >> 172.21.15.46:0/1737955433 conn(0x7fa72406d7d0 msgr2=0x7fa72406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 -- 172.21.15.46:0/1737955433 shutdown_connections 2024-05-09T02:20:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.665+0000 7fa72c1e8640 1 -- 172.21.15.46:0/1737955433 wait complete. 2024-05-09T02:20:31.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.668+0000 7fa72c1e8640 1 Processor -- start 2024-05-09T02:20:31.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.668+0000 7fa72c1e8640 1 -- start start 2024-05-09T02:20:31.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa72c1e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 0x7fa7240c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa72c1e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7240c9630 0x7fa724163070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa729783640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7240c9630 0x7fa724163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa729f84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 0x7fa7240c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa729f84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 0x7fa7240c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:48988/0 (socket says 172.21.15.46:48988) 2024-05-09T02:20:31.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa729783640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7240c9630 0x7fa724163070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58116/0 (socket says 172.21.15.46:58116) 2024-05-09T02:20:31.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.670+0000 7fa72c1e8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa724158010 0x7fa7240ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa72c1e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa7240c6e80 con 0x7fa7240c9630 2024-05-09T02:20:31.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa72c1e8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7241559b0 con 0x7fa7240c9060 2024-05-09T02:20:31.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa72c1e8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7240c7000 con 0x7fa724158010 2024-05-09T02:20:31.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 -- 172.21.15.46:0/3692267172 learned_addr learned my addr 172.21.15.46:0/3692267172 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:31.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa72a785640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa724158010 0x7fa7240ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 -- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa724158010 msgr2=0x7fa7240ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa724158010 0x7fa7240ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 -- 172.21.15.46:0/3692267172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7240c9630 msgr2=0x7fa724163070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7240c9630 0x7fa724163070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 -- 172.21.15.46:0/3692267172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7240c38f0 con 0x7fa7240c9060 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa72a785640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa724158010 0x7fa7240ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.671+0000 7fa729f84640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 0x7fa7240c33b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7200098c0 tx=0x7fa7200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.672+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720042020 con 0x7fa7240c9060 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.672+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720030ab0 con 0x7fa7240c9060 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.672+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa724161d10 con 0x7fa7240c9060 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.672+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720037040 con 0x7fa7240c9060 2024-05-09T02:20:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.672+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa724152740 con 0x7fa7240c9060 2024-05-09T02:20:31.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.673+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72406a330 con 0x7fa7240c9060 2024-05-09T02:20:31.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.674+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa720045020 con 0x7fa7240c9060 2024-05-09T02:20:31.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.675+0000 7fa71a7fc640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa708076300 0x7fa708078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.675+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fa7200b8780 con 0x7fa7240c9060 2024-05-09T02:20:31.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.676+0000 7fa729783640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa708076300 0x7fa708078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.676+0000 7fa729783640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa708076300 0x7fa708078810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa724152af0 tx=0x7fa714009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.680+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa72004c030 con 0x7fa7240c9060 2024-05-09T02:20:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.704+0000 7f19c05c7640 1 Processor -- start 2024-05-09T02:20:31.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.704+0000 7f19c05c7640 1 -- start start 2024-05-09T02:20:31.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19c05c7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19b8070b30 0x7f19b80722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19c05c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 0x7f19b8072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19c05c7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 0x7f19b8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19be363640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19b8070b30 0x7f19b80722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19bdb62640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 0x7f19b8072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19bdb62640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 0x7f19b8072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56820/0 (socket says 172.21.15.46:56820) 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19beb64640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 0x7f19b8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19be363640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19b8070b30 0x7f19b80722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:48990/0 (socket says 172.21.15.46:48990) 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19beb64640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 0x7f19b8155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58122/0 (socket says 172.21.15.46:58122) 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19bdb62640 1 -- 172.21.15.46:0/575955988 learned_addr learned my addr 172.21.15.46:0/575955988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f19b8159d00 con 0x7f19b8152ea0 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f19b8156c30 con 0x7f19b8070b30 2024-05-09T02:20:31.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.707+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f19b80c83b0 con 0x7f19b80c4e80 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.708+0000 7f19bdb62640 1 -- 172.21.15.46:0/575955988 >> v2:172.21.15.107:3300/0 conn(0x7f19b8070b30 msgr2=0x7f19b80722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.708+0000 7f19bdb62640 1 --2- 172.21.15.46:0/575955988 >> v2:172.21.15.107:3300/0 conn(0x7f19b8070b30 0x7f19b80722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.708+0000 7f19bdb62640 1 -- 172.21.15.46:0/575955988 >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 msgr2=0x7f19b8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.708+0000 7f19bdb62640 1 --2- 172.21.15.46:0/575955988 >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 0x7f19b8155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.708+0000 7f19bdb62640 1 -- 172.21.15.46:0/575955988 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b8155740 con 0x7f19b80c4e80 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.708+0000 7f19beb64640 1 --2- 172.21.15.46:0/575955988 >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 0x7f19b8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.709+0000 7f19bdb62640 1 --2- 172.21.15.46:0/575955988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 0x7f19b8072800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19a8013db0 tx=0x7f19a8032870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b7bc5e5481df62 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.709+0000 7f19bd361640 1 -- 172.21.15.46:0/575955988 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a803f070 con 0x7f19b80c4e80 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.709+0000 7f19bd361640 1 -- 172.21.15.46:0/575955988 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a803a620 con 0x7f19b80c4e80 2024-05-09T02:20:31.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.709+0000 7f19bd361640 1 -- 172.21.15.46:0/575955988 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a803a9f0 con 0x7f19b80c4e80 2024-05-09T02:20:31.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.710+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 msgr2=0x7f19b8072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.710+0000 7f19c05c7640 1 --2- 172.21.15.46:0/575955988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 0x7f19b8072800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19a8013db0 tx=0x7f19a8032870 comp rx=0 tx=0).stop 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 shutdown_connections 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 --2- 172.21.15.46:0/575955988 >> v2:172.21.15.46:3300/0 conn(0x7f19b8152ea0 0x7f19b8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 --2- 172.21.15.46:0/575955988 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b80c4e80 0x7f19b8072800 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 --2- 172.21.15.46:0/575955988 >> v2:172.21.15.107:3300/0 conn(0x7f19b8070b30 0x7f19b80722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 >> 172.21.15.46:0/575955988 conn(0x7f19b8069040 msgr2=0x7f19b80ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 shutdown_connections 2024-05-09T02:20:31.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.714+0000 7f19c05c7640 1 -- 172.21.15.46:0/575955988 wait complete. 2024-05-09T02:20:31.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.716+0000 7f19c05c7640 1 Processor -- start 2024-05-09T02:20:31.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.717+0000 7f19c05c7640 1 -- start start 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.718+0000 7f19c05c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19b8070b30 0x7f19b80c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19c05c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19b80c4e80 0x7f19b814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19c05c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b8152ea0 0x7f19b81e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19c05c7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f19b8159a20 con 0x7f19b80c4e80 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19c05c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80ca600 con 0x7f19b8070b30 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19c05c7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f19b80ca8a0 con 0x7f19b8152ea0 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19be363640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19b8070b30 0x7f19b80c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19be363640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19b8070b30 0x7f19b80c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49002/0 (socket says 172.21.15.46:49002) 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19be363640 1 -- 172.21.15.46:0/750044657 learned_addr learned my addr 172.21.15.46:0/750044657 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19bdb62640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19b80c4e80 0x7f19b814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19beb64640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b8152ea0 0x7f19b81e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19beb64640 1 -- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19b8070b30 msgr2=0x7f19b80c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19beb64640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19b8070b30 0x7f19b80c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19beb64640 1 -- 172.21.15.46:0/750044657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19b80c4e80 msgr2=0x7f19b814d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19beb64640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19b80c4e80 0x7f19b814d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.719+0000 7f19beb64640 1 -- 172.21.15.46:0/750044657 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b80c5e20 con 0x7f19b8152ea0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.720+0000 7f19beb64640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b8152ea0 0x7f19b81e9410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19b80707a0 tx=0x7f19b000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.720+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0018020 con 0x7f19b8152ea0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.720+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b0014480 con 0x7f19b8152ea0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.720+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0014870 con 0x7f19b8152ea0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.720+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b80c7390 con 0x7f19b8152ea0 2024-05-09T02:20:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.720+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b81ed430 con 0x7f19b8152ea0 2024-05-09T02:20:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.721+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b806a330 con 0x7f19b8152ea0 2024-05-09T02:20:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.722+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f19b001b020 con 0x7f19b8152ea0 2024-05-09T02:20:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.723+0000 7f19aeffd640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f199c0762d0 0x7f199c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.723+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f19b00985e0 con 0x7f19b8152ea0 2024-05-09T02:20:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.723+0000 7f19be363640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f199c0762d0 0x7f199c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.724+0000 7f19be363640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f199c0762d0 0x7f199c0787e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19b4007ad0 tx=0x7f19b400f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:31.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:31.728+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f19b0022020 con 0x7f19b8152ea0 2024-05-09T02:20:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.174+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7240c7450 con 0x7fa7240c9060 2024-05-09T02:20:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.175+0000 7fa71a7fc640 1 -- 172.21.15.46:0/3692267172 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4831 (secure 0 0 0) 0x7fa720081600 con 0x7fa7240c9060 2024-05-09T02:20:32.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:32.178 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:30.916132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:30.916016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:20:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-05-09T02:20:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa708076300 msgr2=0x7fa708078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa708076300 0x7fa708078810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa724152af0 tx=0x7fa714009040 comp rx=0 tx=0).stop 2024-05-09T02:20:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 msgr2=0x7fa7240c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 0x7fa7240c33b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7200098c0 tx=0x7fa7200046c0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 shutdown_connections 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa708076300 0x7fa708078810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa724158010 0x7fa7240ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7240c9630 0x7fa724163070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 --2- 172.21.15.46:0/3692267172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7240c9060 0x7fa7240c33b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.178+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 >> 172.21.15.46:0/3692267172 conn(0x7fa72406d7d0 msgr2=0x7fa724074200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.179+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 shutdown_connections 2024-05-09T02:20:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.179+0000 7fa72c1e8640 1 -- 172.21.15.46:0/3692267172 wait complete. 2024-05-09T02:20:32.198 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-05-09T02:20:32.198 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T02:20:32.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.224+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19b80ab130 con 0x7f19b8152ea0 2024-05-09T02:20:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.224+0000 7f19aeffd640 1 -- 172.21.15.46:0/750044657 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4831 (secure 0 0 0) 0x7f19b0010040 con 0x7f19b8152ea0 2024-05-09T02:20:32.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:32.228 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:30.916132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:30.916016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:20:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f199c0762d0 msgr2=0x7f199c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f199c0762d0 0x7f199c0787e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19b4007ad0 tx=0x7f19b400f040 comp rx=0 tx=0).stop 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b8152ea0 msgr2=0x7f19b81e9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b8152ea0 0x7f19b81e9410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19b80707a0 tx=0x7f19b000ef90 comp rx=0 tx=0).stop 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 shutdown_connections 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f199c0762d0 0x7f199c0787e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19b8152ea0 0x7f19b81e9410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19b80c4e80 0x7f19b814d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 --2- 172.21.15.46:0/750044657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19b8070b30 0x7f19b80c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.227+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 >> 172.21.15.46:0/750044657 conn(0x7f19b8069040 msgr2=0x7f19b80cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.228+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 shutdown_connections 2024-05-09T02:20:32.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.228+0000 7f19c05c7640 1 -- 172.21.15.46:0/750044657 wait complete. 2024-05-09T02:20:32.244 INFO:tasks.mds_thrash.fs.[b]:mds.b down, removed from mdsmap 2024-05-09T02:20:32.244 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T02:20:32.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:32.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.322+0000 7f2b887b2640 1 Processor -- start 2024-05-09T02:20:32.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.322+0000 7f2b887b2640 1 -- start start 2024-05-09T02:20:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b887b2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2b80156300 0x7f2b8014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b86d4f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2b80156300 0x7f2b8014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b86d4f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2b80156300 0x7f2b8014f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58144/0 (socket says 172.21.15.46:58144) 2024-05-09T02:20:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b86d4f640 1 -- 172.21.15.46:0/4049375525 learned_addr learned my addr 172.21.15.46:0/4049375525 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b80071120 con 0x7f2b800c3f60 2024-05-09T02:20:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b800713c0 con 0x7f2b800c46e0 2024-05-09T02:20:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f2b800c7be0 con 0x7f2b80156300 2024-05-09T02:20:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b8554c640 1 -- 172.21.15.46:0/4049375525 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335197817 0 0) 0x7f2b80071120 con 0x7f2b800c3f60 2024-05-09T02:20:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.324+0000 7f2b8554c640 1 -- 172.21.15.46:0/4049375525 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b6c003520 con 0x7f2b800c3f60 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.325+0000 7f2b86d4f640 1 -- 172.21.15.46:0/4049375525 >> v1:172.21.15.107:6789/0 conn(0x7f2b800c46e0 legacy=0x7f2b80073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.325+0000 7f2b86d4f640 1 -- 172.21.15.46:0/4049375525 >> v1:172.21.15.46:6789/0 conn(0x7f2b800c3f60 legacy=0x7f2b80155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.325+0000 7f2b86d4f640 1 -- 172.21.15.46:0/4049375525 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b800716a0 con 0x7f2b80156300 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.326+0000 7f2b86d4f640 1 --2- 172.21.15.46:0/4049375525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 0x7f2b8014f7b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800f370 tx=0x7f2b7802ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b078fac26b4cc5ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.326+0000 7f2b8554c640 1 -- 172.21.15.46:0/4049375525 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78037020 con 0x7f2b80156300 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.326+0000 7f2b8554c640 1 -- 172.21.15.46:0/4049375525 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7800d4e0 con 0x7f2b80156300 2024-05-09T02:20:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.326+0000 7f2b8554c640 1 -- 172.21.15.46:0/4049375525 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800ba20 con 0x7f2b80156300 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.327+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 msgr2=0x7f2b8014f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.327+0000 7f2b887b2640 1 --2- 172.21.15.46:0/4049375525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 0x7f2b8014f7b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800f370 tx=0x7f2b7802ea60 comp rx=0 tx=0).stop 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.327+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 shutdown_connections 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.327+0000 7f2b887b2640 1 --2- 172.21.15.46:0/4049375525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 0x7f2b8014f7b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.327+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 >> 172.21.15.46:0/4049375525 conn(0x7f2b800aba90 msgr2=0x7f2b800abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.327+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 shutdown_connections 2024-05-09T02:20:32.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.328+0000 7f2b887b2640 1 -- 172.21.15.46:0/4049375525 wait complete. 2024-05-09T02:20:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.329+0000 7f2b887b2640 1 Processor -- start 2024-05-09T02:20:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.329+0000 7f2b887b2640 1 -- start start 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.330+0000 7f2b887b2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b800c3f60 0x7f2b80146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.330+0000 7f2b887b2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 0x7f2b8014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b887b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 0x7f2b800a8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b887b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b800a9860 con 0x7f2b80156300 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b887b2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80156710 con 0x7f2b800c46e0 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b887b2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b800c4370 con 0x7f2b800c3f60 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 0x7f2b8014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 0x7f2b8014a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:49014/0 (socket says 172.21.15.46:49014) 2024-05-09T02:20:32.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 -- 172.21.15.46:0/2076766104 learned_addr learned my addr 172.21.15.46:0/2076766104 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 -- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b800c3f60 msgr2=0x7f2b80146c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b800c3f60 0x7f2b80146c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 -- 172.21.15.46:0/2076766104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 msgr2=0x7f2b800a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 0x7f2b800a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.331+0000 7f2b85d4d640 1 -- 172.21.15.46:0/2076766104 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b80149760 con 0x7f2b800c46e0 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.332+0000 7f2b85d4d640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 0x7f2b8014a070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c3c0 tx=0x7f2b7000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.332+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70017070 con 0x7f2b800c46e0 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.332+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b700052d0 con 0x7f2b800c46e0 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.332+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70003830 con 0x7f2b800c46e0 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.332+0000 7f2b887b2640 1 -- 172.21.15.46:0/2076766104 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b80149a40 con 0x7f2b800c46e0 2024-05-09T02:20:32.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.332+0000 7f2b887b2640 1 -- 172.21.15.46:0/2076766104 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b80147a90 con 0x7f2b800c46e0 2024-05-09T02:20:32.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.333+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8006a330 con 0x7f2b800c46e0 2024-05-09T02:20:32.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.334+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b7001a070 con 0x7f2b800c46e0 2024-05-09T02:20:32.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.335+0000 7f2b76ffd640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2b640762d0 0x7f2b640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.335+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f2b70096e50 con 0x7f2b800c46e0 2024-05-09T02:20:32.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.335+0000 7f2b8654e640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2b640762d0 0x7f2b640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.336+0000 7f2b8654e640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2b640762d0 0x7f2b640787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000f60 tx=0x7f2b7c0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:32.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.344+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b70060250 con 0x7f2b800c46e0 2024-05-09T02:20:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.403+0000 7f3bf7639640 1 Processor -- start 2024-05-09T02:20:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.403+0000 7f3bf7639640 1 -- start start 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf7639640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3bf0155160 0x7f3bf00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf7639640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf00c84a0 0x7f3bf00c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf7639640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf0158ae0 con 0x7f3bf00c9c00 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf5bd6640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3bf00c9c00 0x7f3bf015b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59150/0 (socket says 172.21.15.46:59150) 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf5bd6640 1 -- 172.21.15.46:0/504430948 learned_addr learned my addr 172.21.15.46:0/504430948 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf53d5640 1 --2- 172.21.15.46:0/504430948 >> v2:172.21.15.107:3300/0 conn(0x7f3bf0155160 0x7f3bf00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf0155570 con 0x7f3bf0155160 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf0157ed0 con 0x7f3bf00c84a0 2024-05-09T02:20:32.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154271068 0 0) 0x7f3bf0158ae0 con 0x7f3bf00c9c00 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.405+0000 7f3bf4bd4640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf00c84a0 0x7f3bf00c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bdc003520 con 0x7f3bf00c9c00 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2952845610 0 0) 0x7f3bdc003520 con 0x7f3bf00c9c00 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf00c84a0 msgr2=0x7f3bf00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf00c84a0 0x7f3bf00c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 >> v2:172.21.15.107:3300/0 conn(0x7f3bf0155160 msgr2=0x7f3bf00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 --2- 172.21.15.46:0/504430948 >> v2:172.21.15.107:3300/0 conn(0x7f3bf0155160 0x7f3bf00c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf01581b0 con 0x7f3bf00c9c00 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f3be8001a70 con 0x7f3bf00c9c00 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 >> v1:172.21.15.46:6789/0 conn(0x7f3bf00c9c00 legacy=0x7f3bf015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bdc003a50 0x7f3bdc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc004800 0x7f3bdc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bdc005210 0x7f3bdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0155570 con 0x7f3bdc004800 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0157ed0 con 0x7f3bdc003a50 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc0149d0 con 0x7f3bdc005210 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.406+0000 7f3bf5bd6640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bdc005210 0x7f3bdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.407+0000 7f3bf4bd4640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc004800 0x7f3bdc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.407+0000 7f3bf5bd6640 1 -- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bdc003a50 msgr2=0x7f3bdc003ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.407+0000 7f3bf5bd6640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bdc003a50 0x7f3bdc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.407+0000 7f3bf5bd6640 1 -- 172.21.15.46:0/504430948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc004800 msgr2=0x7f3bdc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.407+0000 7f3bf5bd6640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc004800 0x7f3bdc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.407+0000 7f3bf5bd6640 1 -- 172.21.15.46:0/504430948 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc003520 con 0x7f3bdc005210 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.408+0000 7f3bf5bd6640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bdc005210 0x7f3bdc00b9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00c73f0 tx=0x7f3bdc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4db5131f9f21fbe9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.408+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be800a450 con 0x7f3bdc005210 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.408+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be802f070 con 0x7f3bdc005210 2024-05-09T02:20:32.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.408+0000 7f3be7fff640 1 -- 172.21.15.46:0/504430948 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be802bb70 con 0x7f3bdc005210 2024-05-09T02:20:32.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.409+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bdc005210 msgr2=0x7f3bdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.409+0000 7f3bf7639640 1 --2- 172.21.15.46:0/504430948 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bdc005210 0x7f3bdc00b9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00c73f0 tx=0x7f3bdc005830 comp rx=0 tx=0).stop 2024-05-09T02:20:32.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.409+0000 7f3bf5bd6640 1 -- 172.21.15.46:0/504430948 reap_dead start 2024-05-09T02:20:32.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.409+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 shutdown_connections 2024-05-09T02:20:32.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.409+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 >> 172.21.15.46:0/504430948 conn(0x7f3bf00aebe0 msgr2=0x7f3bf00aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:32.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.411+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 shutdown_connections 2024-05-09T02:20:32.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.411+0000 7f3bf7639640 1 -- 172.21.15.46:0/504430948 wait complete. 2024-05-09T02:20:32.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.413+0000 7f3bf7639640 1 Processor -- start 2024-05-09T02:20:32.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.413+0000 7f3bf7639640 1 -- start start 2024-05-09T02:20:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf7639640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 0x7f3bf014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf7639640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf01472d0 0x7f3bf01476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf7639640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf0156be0 0x7f3bf0156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf7639640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0157b30 con 0x7f3bdc005210 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf7639640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0158770 con 0x7f3bf0156be0 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf7639640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf0157cb0 con 0x7f3bf01472d0 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf53d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 0x7f3bf014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf53d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 0x7f3bf014e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58156/0 (socket says 172.21.15.46:58156) 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf53d5640 1 -- 172.21.15.46:0/211300258 learned_addr learned my addr 172.21.15.46:0/211300258 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf4bd4640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf01472d0 0x7f3bf01476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf5bd6640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf0156be0 0x7f3bf0156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.414+0000 7f3bf53d5640 1 -- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf01472d0 msgr2=0x7f3bf01476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf53d5640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf01472d0 0x7f3bf01476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf53d5640 1 -- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf0156be0 msgr2=0x7f3bf0156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf53d5640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf0156be0 0x7f3bf0156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf53d5640 1 -- 172.21.15.46:0/211300258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf01514a0 con 0x7f3bdc005210 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf53d5640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 0x7f3bf014e840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00e7f0 tx=0x7f3bec00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec017070 con 0x7f3bdc005210 2024-05-09T02:20:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec00c730 con 0x7f3bdc005210 2024-05-09T02:20:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00cb00 con 0x7f3bdc005210 2024-05-09T02:20:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf00ac920 con 0x7f3bdc005210 2024-05-09T02:20:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.415+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf0147d50 con 0x7f3bdc005210 2024-05-09T02:20:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.417+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf006a330 con 0x7f3bdc005210 2024-05-09T02:20:32.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.418+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3bec01a070 con 0x7f3bdc005210 2024-05-09T02:20:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.419+0000 7f3be5ffb640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3bd4076350 0x7f3bd4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.419+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f3bec097a30 con 0x7f3bdc005210 2024-05-09T02:20:32.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.419+0000 7f3bf4bd4640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3bd4076350 0x7f3bd4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.420+0000 7f3bf4bd4640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3bd4076350 0x7f3bd4078860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0148830 tx=0x7f3be0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.425+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3bec0609b0 con 0x7f3bdc005210 2024-05-09T02:20:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.655+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bf0146c50 con 0x7f3bdc005210 2024-05-09T02:20:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.656+0000 7f3be5ffb640 1 -- 172.21.15.46:0/211300258 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4831 (secure 0 0 0) 0x7f3bec064cb0 con 0x7f3bdc005210 2024-05-09T02:20:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:32.659 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:30.916132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:30.916016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:20:32.660 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-05-09T02:20:32.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3bd4076350 msgr2=0x7f3bd4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3bd4076350 0x7f3bd4078860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0148830 tx=0x7f3be0009190 comp rx=0 tx=0).stop 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 msgr2=0x7f3bf014e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 0x7f3bf014e840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00e7f0 tx=0x7f3bec00ebf0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 shutdown_connections 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3bd4076350 0x7f3bd4078860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bf0156be0 0x7f3bf0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bf01472d0 0x7f3bf01476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 --2- 172.21.15.46:0/211300258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bdc005210 0x7f3bf014e840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 >> 172.21.15.46:0/211300258 conn(0x7f3bf00aebe0 msgr2=0x7f3bf00c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 shutdown_connections 2024-05-09T02:20:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.658+0000 7f3bf7639640 1 -- 172.21.15.46:0/211300258 wait complete. 2024-05-09T02:20:32.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.663+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b800c90b0 con 0x7f2b800c46e0 2024-05-09T02:20:32.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.663+0000 7f2b76ffd640 1 -- 172.21.15.46:0/2076766104 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+4831 (secure 0 0 0) 0x7f2b70068240 con 0x7f2b800c46e0 2024-05-09T02:20:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:32.667 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:30.916132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:30.916016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:20:32.667 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-05-09T02:20:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2b640762d0 msgr2=0x7f2b640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2b640762d0 0x7f2b640787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000f60 tx=0x7f2b7c0079b0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 msgr2=0x7f2b8014a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 0x7f2b8014a070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c3c0 tx=0x7f2b7000c880 comp rx=0 tx=0).stop 2024-05-09T02:20:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 shutdown_connections 2024-05-09T02:20:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2b640762d0 0x7f2b640787e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b80156300 0x7f2b800a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b800c46e0 0x7f2b8014a070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 --2- 172.21.15.46:0/2076766104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b800c3f60 0x7f2b80146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:32.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 >> 172.21.15.46:0/2076766104 conn(0x7f2b800aba90 msgr2=0x7f2b80075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:32.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 shutdown_connections 2024-05-09T02:20:32.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:32.666+0000 7f2b74ff9640 1 -- 172.21.15.46:0/2076766104 wait complete. 2024-05-09T02:20:32.674 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:13.523096+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4232": { "addr": "172.21.15.107:6836/1968918469", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6834", "nonce": 1968918469, "type": "v2" }, { "addr": "172.21.15.107:6836", "nonce": 1968918469, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4232, "incarnation": 26, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 38 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T02:20:30.916132+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4232 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:22.572836+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4969": { "addr": "172.21.15.46:6833/3794663718", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6832", "nonce": 3794663718, "type": "v2" }, { "addr": "172.21.15.46:6833", "nonce": 3794663718, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4969, "incarnation": 25, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T02:20:30.916016+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4969 } } } ], "standbys": [] } 2024-05-09T02:20:32.681 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:13.523096+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4232": { "addr": "172.21.15.107:6836/1968918469", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6834", "nonce": 1968918469, "type": "v2" }, { "addr": "172.21.15.107:6836", "nonce": 1968918469, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4232, "incarnation": 26, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 38 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T02:20:30.916132+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4232 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:22.572836+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4969": { "addr": "172.21.15.46:6833/3794663718", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6832", "nonce": 3794663718, "type": "v2" }, { "addr": "172.21.15.46:6833", "nonce": 3794663718, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4969, "incarnation": 25, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T02:20:30.916016+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4969 } } } ], "standbys": [] } 2024-05-09T02:20:33.446 INFO:tasks.workunit.client.1.smithi107.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T02:20:33.446 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.446 INFO:tasks.workunit.client.1.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T02:20:33.446 INFO:tasks.workunit.client.1.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T02:20:33.446 INFO:tasks.workunit.client.1.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: git switch -c 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr:Or undo this operation with: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: git switch - 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-05-09T02:20:33.447 INFO:tasks.workunit.client.1.smithi107.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T02:20:33.452 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-09T02:20:33.554 INFO:tasks.workunit.client.1.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T02:20:33.556 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T02:20:33.557 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T02:20:34.121 INFO:tasks.ceph.mds.d.smithi107.stderr:2024-05-09T02:20:34.118+0000 7f2328760640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:20:34.146 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T02:20:34.201 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T02:20:34.243 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T02:20:34.244 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T02:20:34.245 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T02:20:34.284 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T02:20:34.287 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:20:34.287 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-09T02:20:34.303 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.1... 2024-05-09T02:20:34.304 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-09T02:20:34.304 DEBUG:teuthology.orchestra.run.smithi107:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/iozone.sh 2024-05-09T02:20:34.372 INFO:tasks.workunit.client.1.smithi107.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T02:20:34.467 INFO:tasks.workunit.client.1.smithi107.stdout: Iozone: Performance Test of File I/O 2024-05-09T02:20:34.467 INFO:tasks.workunit.client.1.smithi107.stdout: Version $Revision: 3.494 $ 2024-05-09T02:20:34.467 INFO:tasks.workunit.client.1.smithi107.stdout: Compiled for 64 bit mode. 2024-05-09T02:20:34.467 INFO:tasks.workunit.client.1.smithi107.stdout: Build: linux-AMD64 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Run began: Thu May 9 02:20:34 2024 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:20:34.468 INFO:tasks.workunit.client.1.smithi107.stdout: Include close in write timing 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Include fsync in write timing 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: File size set to 1048576 kB 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Record Size 16 kB 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Output is in kBytes/sec 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T02:20:34.469 INFO:tasks.workunit.client.1.smithi107.stdout: Processor cache line size set to 32 bytes. 2024-05-09T02:20:34.470 INFO:tasks.workunit.client.1.smithi107.stdout: File stride size set to 17 * record size. 2024-05-09T02:20:34.470 INFO:tasks.workunit.client.1.smithi107.stdout: Throughput test with 1 process 2024-05-09T02:20:34.470 INFO:tasks.workunit.client.1.smithi107.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-09T02:20:34.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:34.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:34.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.799+0000 7fc72e734640 1 Processor -- start 2024-05-09T02:20:34.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.799+0000 7fc72e734640 1 -- start start 2024-05-09T02:20:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72e734640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc728068c50 0x7fc72815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72e734640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc7281519a0 0x7fc728073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72e734640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72e734640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc7280c52d0 con 0x7fc728068c50 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72e734640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc7280c3bf0 con 0x7fc7281519a0 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72e734640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc72806f060 con 0x7fc7280742b0 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc728068c50 0x7fc72815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc728068c50 0x7fc72815b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58162/0 (socket says 172.21.15.46:58162) 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc7277fe640 1 --2- 172.21.15.46:0/1161022279 >> v2:172.21.15.107:3300/0 conn(0x7fc7281519a0 0x7fc728073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc72ccd1640 1 --2- 172.21.15.46:0/1161022279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 -- 172.21.15.46:0/1161022279 learned_addr learned my addr 172.21.15.46:0/1161022279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:34.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 -- 172.21.15.46:0/1161022279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 msgr2=0x7fc728157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 --2- 172.21.15.46:0/1161022279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 -- 172.21.15.46:0/1161022279 >> v2:172.21.15.107:3300/0 conn(0x7fc7281519a0 msgr2=0x7fc728073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 --2- 172.21.15.46:0/1161022279 >> v2:172.21.15.107:3300/0 conn(0x7fc7281519a0 0x7fc728073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.801+0000 7fc727fff640 1 -- 172.21.15.46:0/1161022279 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7281579e0 con 0x7fc728068c50 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.802+0000 7fc727fff640 1 --2- 172.21.15.46:0/1161022279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc728068c50 0x7fc72815b9e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc728071540 tx=0x7fc71802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cc1a1cbe5fcf2d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.802+0000 7fc726ffd640 1 -- 172.21.15.46:0/1161022279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718037070 con 0x7fc728068c50 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.802+0000 7fc726ffd640 1 -- 172.21.15.46:0/1161022279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718032440 con 0x7fc728068c50 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.802+0000 7fc726ffd640 1 -- 172.21.15.46:0/1161022279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718032810 con 0x7fc728068c50 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 -- 172.21.15.46:0/1161022279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc728068c50 msgr2=0x7fc72815b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 --2- 172.21.15.46:0/1161022279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc728068c50 0x7fc72815b9e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc728071540 tx=0x7fc71802a1e0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 -- 172.21.15.46:0/1161022279 shutdown_connections 2024-05-09T02:20:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 --2- 172.21.15.46:0/1161022279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 --2- 172.21.15.46:0/1161022279 >> v2:172.21.15.107:3300/0 conn(0x7fc7281519a0 0x7fc728073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 --2- 172.21.15.46:0/1161022279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc728068c50 0x7fc72815b9e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 -- 172.21.15.46:0/1161022279 >> 172.21.15.46:0/1161022279 conn(0x7fc728073250 msgr2=0x7fc728073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 -- 172.21.15.46:0/1161022279 shutdown_connections 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.803+0000 7fc72e734640 1 -- 172.21.15.46:0/1161022279 wait complete. 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.805+0000 7fc72e734640 1 Processor -- start 2024-05-09T02:20:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.805+0000 7fc72e734640 1 -- start start 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.806+0000 7fc72e734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc728068c50 0x7fc72814cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.806+0000 7fc72e734640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72e734640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7281519a0 0x7fc728159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72e734640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc7280c5b00 con 0x7fc7281519a0 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72e734640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7280c5820 con 0x7fc728068c50 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72e734640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc728151db0 con 0x7fc7280742b0 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72ccd1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7281519a0 0x7fc728159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc728068c50 0x7fc72814cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72ccd1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7281519a0 0x7fc728159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58164/0 (socket says 172.21.15.46:58164) 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc7277fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc72ccd1640 1 -- 172.21.15.46:0/3480925510 learned_addr learned my addr 172.21.15.46:0/3480925510 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 -- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 msgr2=0x7fc728158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 -- 172.21.15.46:0/3480925510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7281519a0 msgr2=0x7fc728159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7281519a0 0x7fc728159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 -- 172.21.15.46:0/3480925510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72814d4a0 con 0x7fc728068c50 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.807+0000 7fc727fff640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc728068c50 0x7fc72814cf60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc718031000 tx=0x7fc7180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.808+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718041020 con 0x7fc728068c50 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.808+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71803d660 con 0x7fc728068c50 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.808+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718037040 con 0x7fc728068c50 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.808+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72814bf20 con 0x7fc728068c50 2024-05-09T02:20:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.808+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7281575b0 con 0x7fc728068c50 2024-05-09T02:20:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.809+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72814c440 con 0x7fc728068c50 2024-05-09T02:20:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.810+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc718044020 con 0x7fc728068c50 2024-05-09T02:20:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.810+0000 7fc724ff9640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7140762d0 0x7fc7140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.810+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fc7180b7ec0 con 0x7fc728068c50 2024-05-09T02:20:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.810+0000 7fc7277fe640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7140762d0 0x7fc7140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.811+0000 7fc7277fe640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7140762d0 0x7fc7140787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc72814a780 tx=0x7fc71c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.816+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc71804b030 con 0x7fc728068c50 2024-05-09T02:20:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.840+0000 7f1754338640 1 Processor -- start 2024-05-09T02:20:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.840+0000 7f1754338640 1 -- start start 2024-05-09T02:20:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f1754338640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174c0aa410 0x7f174c155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f1754338640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f174c1580b0 0x7f174c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f1754338640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174c071510 con 0x7f174c0c6150 2024-05-09T02:20:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f1754338640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f174c0aa820 con 0x7f174c0aa410 2024-05-09T02:20:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f1754338640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f174c0ac900 con 0x7f174c1580b0 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174c0aa410 0x7f174c155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174c0aa410 0x7f174c155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58178/0 (socket says 172.21.15.46:58178) 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 -- 172.21.15.46:0/2651200905 learned_addr learned my addr 172.21.15.46:0/2651200905 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17528d5640 1 --2- 172.21.15.46:0/2651200905 >> v2:172.21.15.107:3300/0 conn(0x7f174c1580b0 0x7f174c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 -- 172.21.15.46:0/2651200905 >> v2:172.21.15.107:3300/0 conn(0x7f174c1580b0 msgr2=0x7f174c1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 --2- 172.21.15.46:0/2651200905 >> v2:172.21.15.107:3300/0 conn(0x7f174c1580b0 0x7f174c1584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 -- 172.21.15.46:0/2651200905 >> v1:172.21.15.107:6789/0 conn(0x7f174c0c6150 legacy=0x7f174c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.842+0000 7f17518d3640 1 -- 172.21.15.46:0/2651200905 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0abfd0 con 0x7f174c0aa410 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.843+0000 7f17518d3640 1 --2- 172.21.15.46:0/2651200905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c155260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f174c0738a0 tx=0x7f174002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728bb67b1ac56e4b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.843+0000 7f17510d2640 1 -- 172.21.15.46:0/2651200905 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740037070 con 0x7f174c0aa410 2024-05-09T02:20:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.843+0000 7f17510d2640 1 -- 172.21.15.46:0/2651200905 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740032440 con 0x7f174c0aa410 2024-05-09T02:20:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.843+0000 7f17510d2640 1 -- 172.21.15.46:0/2651200905 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740032810 con 0x7f174c0aa410 2024-05-09T02:20:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 -- 172.21.15.46:0/2651200905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 msgr2=0x7f174c155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 --2- 172.21.15.46:0/2651200905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c155260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f174c0738a0 tx=0x7f174002a270 comp rx=0 tx=0).stop 2024-05-09T02:20:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 -- 172.21.15.46:0/2651200905 shutdown_connections 2024-05-09T02:20:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 --2- 172.21.15.46:0/2651200905 >> v2:172.21.15.107:3300/0 conn(0x7f174c1580b0 0x7f174c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 --2- 172.21.15.46:0/2651200905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c155260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 -- 172.21.15.46:0/2651200905 >> 172.21.15.46:0/2651200905 conn(0x7f174c0c6770 msgr2=0x7f174c0c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 -- 172.21.15.46:0/2651200905 shutdown_connections 2024-05-09T02:20:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.844+0000 7f1754338640 1 -- 172.21.15.46:0/2651200905 wait complete. 2024-05-09T02:20:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.846+0000 7f1754338640 1 Processor -- start 2024-05-09T02:20:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.846+0000 7f1754338640 1 -- start start 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f1754338640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f1754338640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f174c0c6150 0x7f174c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f1754338640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f174c1580b0 0x7f174c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f1754338640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f174c0abca0 con 0x7f174c0aa410 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f1754338640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f174c0ac590 con 0x7f174c0c6150 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f1754338640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f174c071180 con 0x7f174c1580b0 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f17520d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f17520d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c0af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58180/0 (socket says 172.21.15.46:58180) 2024-05-09T02:20:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f17518d3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f174c0c6150 0x7f174c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f17528d5640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f174c1580b0 0x7f174c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.847+0000 7f17520d4640 1 -- 172.21.15.46:0/3253605314 learned_addr learned my addr 172.21.15.46:0/3253605314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17520d4640 1 -- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f174c1580b0 msgr2=0x7f174c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17520d4640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f174c1580b0 0x7f174c1500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17520d4640 1 -- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f174c0c6150 msgr2=0x7f174c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17520d4640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f174c0c6150 0x7f174c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17520d4640 1 -- 172.21.15.46:0/3253605314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c14a300 con 0x7f174c0aa410 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17518d3640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f174c0c6150 0x7f174c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17528d5640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f174c1580b0 0x7f174c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f17520d4640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c0af840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f174800c3a0 tx=0x7f174800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:34.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748017070 con 0x7f174c0aa410 2024-05-09T02:20:34.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c14a5e0 con 0x7f174c0aa410 2024-05-09T02:20:34.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17480052d0 con 0x7f174c0aa410 2024-05-09T02:20:34.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748003830 con 0x7f174c0aa410 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.848+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c153bb0 con 0x7f174c0aa410 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.849+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174c0affc0 con 0x7f174c0aa410 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.850+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f174801a070 con 0x7f174c0aa410 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.850+0000 7f173effd640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f17300762d0 0x7f17300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.851+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f1748096f50 con 0x7f174c0aa410 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.851+0000 7f17518d3640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f17300762d0 0x7f17300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:34.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.851+0000 7f17518d3640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f17300762d0 0x7f17300787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1740034000 tx=0x7f174002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:34.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:34.855+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f174c071510 con 0x7f174c0aa410 2024-05-09T02:20:35.009 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-05-09T02:20:35.007+0000 7fa751a62640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:20:35.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.097+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f174c06a330 con 0x7f174c0aa410 2024-05-09T02:20:35.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.098+0000 7f173effd640 1 -- 172.21.15.46:0/3253605314 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+4845 (secure 0 0 0) 0x7f1748068280 con 0x7f174c0aa410 2024-05-09T02:20:35.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:35.101 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:20:35.101 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-05-09T02:20:35.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f17300762d0 msgr2=0x7f17300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:35.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f17300762d0 0x7f17300787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1740034000 tx=0x7f174002e000 comp rx=0 tx=0).stop 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 msgr2=0x7f174c0af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c0af840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f174800c3a0 tx=0x7f174800c860 comp rx=0 tx=0).stop 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 shutdown_connections 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f17300762d0 0x7f17300787e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f174c1580b0 0x7f174c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f174c0c6150 0x7f174c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 --2- 172.21.15.46:0/3253605314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c0aa410 0x7f174c0af840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.100+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 >> 172.21.15.46:0/3253605314 conn(0x7f174c0c6770 msgr2=0x7f174c155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.101+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 shutdown_connections 2024-05-09T02:20:35.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.101+0000 7f1754338640 1 -- 172.21.15.46:0/3253605314 wait complete. 2024-05-09T02:20:35.118 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=4278 2024-05-09T02:20:35.118 INFO:tasks.mds_thrash.fs.[a]:waiting for 5 secs before reviving mds.a 2024-05-09T02:20:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.170+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc72806a330 con 0x7fc728068c50 2024-05-09T02:20:35.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.171+0000 7fc724ff9640 1 -- 172.21.15.46:0/3480925510 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+4845 (secure 0 0 0) 0x7fc718080d60 con 0x7fc728068c50 2024-05-09T02:20:35.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:35.174 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:20:35.174 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7140762d0 msgr2=0x7fc7140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7140762d0 0x7fc7140787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc72814a780 tx=0x7fc71c009190 comp rx=0 tx=0).stop 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc728068c50 msgr2=0x7fc72814cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc728068c50 0x7fc72814cf60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc718031000 tx=0x7fc7180046c0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 shutdown_connections 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7140762d0 0x7fc7140787e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7281519a0 0x7fc728159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7280742b0 0x7fc728158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 --2- 172.21.15.46:0/3480925510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc728068c50 0x7fc72814cf60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:35.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 >> 172.21.15.46:0/3480925510 conn(0x7fc728073250 msgr2=0x7fc728073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:35.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 shutdown_connections 2024-05-09T02:20:35.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:35.173+0000 7fc72e734640 1 -- 172.21.15.46:0/3480925510 wait complete. 2024-05-09T02:20:35.187 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=4888 2024-05-09T02:20:35.187 INFO:tasks.mds_thrash.fs.[b]:waiting for 2 secs before reviving mds.b 2024-05-09T02:20:35.492 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 83% (10213/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T02:20:36.216 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T02:20:36.216 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.216 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T02:20:36.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T02:20:36.218 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T02:20:36.223 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T02:20:36.255 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T02:20:36.257 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T02:20:36.257 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T02:20:36.867 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T02:20:36.922 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T02:20:36.965 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T02:20:36.966 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T02:20:36.966 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T02:20:37.011 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T02:20:37.015 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:20:37.015 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T02:20:37.073 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-09T02:20:37.076 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-09T02:20:37.076 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-09T02:20:37.141 INFO:tasks.workunit.client.0.smithi046.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T02:20:37.188 INFO:tasks.mds_thrash.fs.[b]:reviving mds.b 2024-05-09T02:20:37.188 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T02:20:37.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T02:20:37.191 INFO:tasks.ceph.mds.b:Started 2024-05-09T02:20:37.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Iozone: Performance Test of File I/O 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Version $Revision: 3.494 $ 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Compiled for 64 bit mode. 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Build: linux-AMD64 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T02:20:37.223 INFO:tasks.workunit.client.0.smithi046.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Run began: Thu May 9 02:20:37 2024 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Include close in write timing 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Include fsync in write timing 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: File size set to 1048576 kB 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Record Size 16 kB 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Output is in kBytes/sec 2024-05-09T02:20:37.224 INFO:tasks.workunit.client.0.smithi046.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T02:20:37.225 INFO:tasks.workunit.client.0.smithi046.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T02:20:37.225 INFO:tasks.workunit.client.0.smithi046.stdout: Processor cache line size set to 32 bytes. 2024-05-09T02:20:37.225 INFO:tasks.workunit.client.0.smithi046.stdout: File stride size set to 17 * record size. 2024-05-09T02:20:37.225 INFO:tasks.workunit.client.0.smithi046.stdout: Throughput test with 1 process 2024-05-09T02:20:37.225 INFO:tasks.workunit.client.0.smithi046.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-09T02:20:37.282 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-09T02:20:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.319+0000 7f7b6eee0640 1 Processor -- start 2024-05-09T02:20:37.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.319+0000 7f7b6eee0640 1 -- start start 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.320+0000 7f7b6eee0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680aaa00 0x7f7b68071590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.320+0000 7f7b6eee0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b680ab1c0 0x7f7b681519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.320+0000 7f7b6eee0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b68071b70 con 0x7f7b680ab5d0 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.320+0000 7f7b6eee0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f7b681585c0 con 0x7f7b680ab1c0 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.320+0000 7f7b6eee0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7b68157c90 con 0x7f7b680aaa00 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b680ab1c0 0x7f7b681519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7b680ab1c0 0x7f7b681519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58946/0 (socket says 172.21.15.46:58946) 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b6d47d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7b680ab5d0 0x7f7b680acfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:35466/0 (socket says 172.21.15.46:35466) 2024-05-09T02:20:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b6cc7c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680aaa00 0x7f7b68071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 -- 172.21.15.46:0/123408915 learned_addr learned my addr 172.21.15.46:0/123408915 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 -- 172.21.15.46:0/123408915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680aaa00 msgr2=0x7f7b68071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b677fe640 1 -- 172.21.15.46:0/123408915 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412416144 0 0) 0x7f7b68071b70 con 0x7f7b680ab5d0 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 --2- 172.21.15.46:0/123408915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680aaa00 0x7f7b68071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 -- 172.21.15.46:0/123408915 >> v1:172.21.15.107:6789/0 conn(0x7f7b680ab5d0 legacy=0x7f7b680acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b67fff640 1 -- 172.21.15.46:0/123408915 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b68157f70 con 0x7f7b680ab1c0 2024-05-09T02:20:37.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.321+0000 7f7b6cc7c640 1 --2- 172.21.15.46:0/123408915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680aaa00 0x7f7b68071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:37.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.322+0000 7f7b67fff640 1 --2- 172.21.15.46:0/123408915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680ab1c0 0x7f7b681519a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009870 tx=0x7f7b5402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c403602e667412 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:37.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.322+0000 7f7b677fe640 1 -- 172.21.15.46:0/123408915 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54037070 con 0x7f7b680ab1c0 2024-05-09T02:20:37.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.323+0000 7f7b677fe640 1 -- 172.21.15.46:0/123408915 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b54032440 con 0x7f7b680ab1c0 2024-05-09T02:20:37.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.323+0000 7f7b677fe640 1 -- 172.21.15.46:0/123408915 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54032810 con 0x7f7b680ab1c0 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 -- 172.21.15.46:0/123408915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680ab1c0 msgr2=0x7f7b681519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/123408915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680ab1c0 0x7f7b681519a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009870 tx=0x7f7b5402a1c0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 -- 172.21.15.46:0/123408915 shutdown_connections 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/123408915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680ab1c0 0x7f7b681519a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/123408915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680aaa00 0x7f7b68071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 -- 172.21.15.46:0/123408915 >> 172.21.15.46:0/123408915 conn(0x7f7b68074220 msgr2=0x7f7b6806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 -- 172.21.15.46:0/123408915 shutdown_connections 2024-05-09T02:20:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.324+0000 7f7b6eee0640 1 -- 172.21.15.46:0/123408915 wait complete. 2024-05-09T02:20:37.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.326+0000 7f7b6eee0640 1 Processor -- start 2024-05-09T02:20:37.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.326+0000 7f7b6eee0640 1 -- start start 2024-05-09T02:20:37.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6eee0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 0x7f7b68157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:37.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6eee0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680ab1c0 0x7f7b681ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:37.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6eee0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b681edcb0 0x7f7b681f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:37.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6eee0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7b680c59d0 con 0x7f7b680aaa00 2024-05-09T02:20:37.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6eee0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68158a50 con 0x7f7b681edcb0 2024-05-09T02:20:37.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6eee0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7b680c5b50 con 0x7f7b680ab1c0 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6cc7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 0x7f7b68157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6cc7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 0x7f7b68157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58952/0 (socket says 172.21.15.46:58952) 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6cc7c640 1 -- 172.21.15.46:0/2533744174 learned_addr learned my addr 172.21.15.46:0/2533744174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b67fff640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680ab1c0 0x7f7b681ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.328+0000 7f7b6d47d640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b681edcb0 0x7f7b681f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6cc7c640 1 -- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680ab1c0 msgr2=0x7f7b681ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6cc7c640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680ab1c0 0x7f7b681ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6cc7c640 1 -- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b681edcb0 msgr2=0x7f7b681f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6cc7c640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b681edcb0 0x7f7b681f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6cc7c640 1 -- 172.21.15.46:0/2533744174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6806f510 con 0x7f7b680aaa00 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6cc7c640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 0x7f7b68157210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00e940 tx=0x7f7b5c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c017070 con 0x7f7b680aaa00 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b5c00ca00 con 0x7f7b680aaa00 2024-05-09T02:20:37.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b680c7240 con 0x7f7b680aaa00 2024-05-09T02:20:37.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00cdd0 con 0x7f7b680aaa00 2024-05-09T02:20:37.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.329+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b680c2b10 con 0x7f7b680aaa00 2024-05-09T02:20:37.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.331+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b681ee170 con 0x7f7b680aaa00 2024-05-09T02:20:37.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.331+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b5c01a070 con 0x7f7b680aaa00 2024-05-09T02:20:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.332+0000 7f7b657fa640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7b4c0762d0 0x7f7b4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.332+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f7b5c097cd0 con 0x7f7b680aaa00 2024-05-09T02:20:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.332+0000 7f7b67fff640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7b4c0762d0 0x7f7b4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:37.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.333+0000 7f7b67fff640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7b4c0762d0 0x7f7b4c0787e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:37.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.339+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7b5c060ae0 con 0x7f7b680aaa00 2024-05-09T02:20:37.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.654+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b6806a330 con 0x7f7b680aaa00 2024-05-09T02:20:37.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.655+0000 7f7b657fa640 1 -- 172.21.15.46:0/2533744174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+4845 (secure 0 0 0) 0x7f7b5c064de0 con 0x7f7b680aaa00 2024-05-09T02:20:37.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:37.658 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:20:37.658 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-05-09T02:20:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7b4c0762d0 msgr2=0x7f7b4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7b4c0762d0 0x7f7b4c0787e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b5402e000 comp rx=0 tx=0).stop 2024-05-09T02:20:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 msgr2=0x7f7b68157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 0x7f7b68157210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00e940 tx=0x7f7b5c00ee00 comp rx=0 tx=0).stop 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 shutdown_connections 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7b4c0762d0 0x7f7b4c0787e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b681edcb0 0x7f7b681f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b680ab1c0 0x7f7b681ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 --2- 172.21.15.46:0/2533744174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b680aaa00 0x7f7b68157210 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 >> 172.21.15.46:0/2533744174 conn(0x7f7b68074220 msgr2=0x7f7b680c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 shutdown_connections 2024-05-09T02:20:37.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:37.657+0000 7f7b6eee0640 1 -- 172.21.15.46:0/2533744174 wait complete. 2024-05-09T02:20:37.672 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-05-09T02:20:39.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:39.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.801+0000 7f05bc62b640 1 Processor -- start 2024-05-09T02:20:39.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.801+0000 7f05bc62b640 1 -- start start 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.802+0000 7f05bc62b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05b40c4670 0x7f05b406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.802+0000 7f05bc62b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f05b41582a0 0x7f05b4162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.802+0000 7f05bc62b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b415b2a0 con 0x7f05b406cc00 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.802+0000 7f05bc62b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f05b415c020 con 0x7f05b40c4670 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.802+0000 7f05bc62b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f05b40c4de0 con 0x7f05b41582a0 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05b40c4670 0x7f05b406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05b40c4670 0x7f05b406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58966/0 (socket says 172.21.15.46:58966) 2024-05-09T02:20:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 -- 172.21.15.46:0/1169954391 learned_addr learned my addr 172.21.15.46:0/1169954391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05babc8640 1 --2- 172.21.15.46:0/1169954391 >> v2:172.21.15.107:3300/0 conn(0x7f05b41582a0 0x7f05b4162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 -- 172.21.15.46:0/1169954391 >> v2:172.21.15.107:3300/0 conn(0x7f05b41582a0 msgr2=0x7f05b4162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 --2- 172.21.15.46:0/1169954391 >> v2:172.21.15.107:3300/0 conn(0x7f05b41582a0 0x7f05b4162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 -- 172.21.15.46:0/1169954391 >> v1:172.21.15.107:6789/0 conn(0x7f05b406cc00 legacy=0x7f05b4157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.803+0000 7f05ba3c7640 1 -- 172.21.15.46:0/1169954391 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b4073e00 con 0x7f05b40c4670 2024-05-09T02:20:39.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.804+0000 7f05ba3c7640 1 --2- 172.21.15.46:0/1169954391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b406c6c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05b406e870 tx=0x7f05b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b99335c7ff0c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.804+0000 7f05b93c5640 1 -- 172.21.15.46:0/1169954391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0037070 con 0x7f05b40c4670 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.804+0000 7f05b93c5640 1 -- 172.21.15.46:0/1169954391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0032440 con 0x7f05b40c4670 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.804+0000 7f05b93c5640 1 -- 172.21.15.46:0/1169954391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0032810 con 0x7f05b40c4670 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 -- 172.21.15.46:0/1169954391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 msgr2=0x7f05b406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 --2- 172.21.15.46:0/1169954391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b406c6c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05b406e870 tx=0x7f05b002a270 comp rx=0 tx=0).stop 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 -- 172.21.15.46:0/1169954391 shutdown_connections 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 --2- 172.21.15.46:0/1169954391 >> v2:172.21.15.107:3300/0 conn(0x7f05b41582a0 0x7f05b4162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 --2- 172.21.15.46:0/1169954391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b406c6c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 -- 172.21.15.46:0/1169954391 >> 172.21.15.46:0/1169954391 conn(0x7f05b40c6770 msgr2=0x7f05b40c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 -- 172.21.15.46:0/1169954391 shutdown_connections 2024-05-09T02:20:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.805+0000 7f05bc62b640 1 -- 172.21.15.46:0/1169954391 wait complete. 2024-05-09T02:20:39.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.808+0000 7f05bc62b640 1 Processor -- start 2024-05-09T02:20:39.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.808+0000 7f05bc62b640 1 -- start start 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05bc62b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 0x7f05b41e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05bc62b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b40c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05bc62b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05b41582a0 0x7f05b415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05bc62b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f05b415b820 con 0x7f05b40c4670 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05bc62b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05b415bb90 con 0x7f05b406cc00 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05bc62b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05b41586b0 con 0x7f05b41582a0 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 0x7f05b41e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 0x7f05b41e10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:45484/0 (socket says 172.21.15.46:45484) 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 -- 172.21.15.46:0/2787933965 learned_addr learned my addr 172.21.15.46:0/2787933965 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:39.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05b9bc6640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b40c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05babc8640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05b41582a0 0x7f05b415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 -- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05b41582a0 msgr2=0x7f05b415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05b41582a0 0x7f05b415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 -- 172.21.15.46:0/2787933965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 msgr2=0x7f05b40c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b40c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.809+0000 7f05ba3c7640 1 -- 172.21.15.46:0/2787933965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b40c87c0 con 0x7f05b406cc00 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.810+0000 7f05ba3c7640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 0x7f05b41e10a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f05b002a2b0 tx=0x7f05b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.810+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0037040 con 0x7f05b406cc00 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.810+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0042070 con 0x7f05b406cc00 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.810+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b40c7a00 con 0x7f05b406cc00 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.810+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0030880 con 0x7f05b406cc00 2024-05-09T02:20:39.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.810+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b40c7fc0 con 0x7f05b406cc00 2024-05-09T02:20:39.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.811+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b406a330 con 0x7f05b406cc00 2024-05-09T02:20:39.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.812+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05b0030a20 con 0x7f05b406cc00 2024-05-09T02:20:39.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.813+0000 7f05aaffd640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05980762d0 0x7f05980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.813+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f05b00b8230 con 0x7f05b406cc00 2024-05-09T02:20:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.813+0000 7f05b9bc6640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05980762d0 0x7f05980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:39.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.813+0000 7f05b9bc6640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05980762d0 0x7f05980787e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f05b41e3b80 tx=0x7f05a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:39.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:39.818+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05b0081040 con 0x7f05b406cc00 2024-05-09T02:20:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.087+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05b4074060 con 0x7f05b406cc00 2024-05-09T02:20:40.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.088+0000 7f05aaffd640 1 -- 172.21.15.46:0/2787933965 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5669 (secure 0 0 0) 0x7f05b0085340 con 0x7f05b406cc00 2024-05-09T02:20:40.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:40.091 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:20:40.091 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05980762d0 msgr2=0x7f05980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05980762d0 0x7f05980787e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f05b41e3b80 tx=0x7f05a4009040 comp rx=0 tx=0).stop 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 msgr2=0x7f05b41e10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 0x7f05b41e10a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f05b002a2b0 tx=0x7f05b00046c0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 shutdown_connections 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f05980762d0 0x7f05980787e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05b41582a0 0x7f05b415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b40c4670 0x7f05b40c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 --2- 172.21.15.46:0/2787933965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05b406cc00 0x7f05b41e10a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 >> 172.21.15.46:0/2787933965 conn(0x7f05b40c6770 msgr2=0x7f05b414a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:40.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 shutdown_connections 2024-05-09T02:20:40.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.091+0000 7f05bc62b640 1 -- 172.21.15.46:0/2787933965 wait complete. 2024-05-09T02:20:40.107 INFO:tasks.mds_thrash.fs.[b]:mds.b reported in up:standby state 2024-05-09T02:20:40.107 INFO:tasks.mds_thrash.fs.[b]:waiting for 104 secs before thrashing 2024-05-09T02:20:40.118 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-05-09T02:20:40.119 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T02:20:40.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T02:20:40.121 INFO:tasks.ceph.mds.a:Started 2024-05-09T02:20:40.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:40.227 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-05-09T02:20:40.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.261+0000 7f42896e9640 1 Processor -- start 2024-05-09T02:20:40.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.261+0000 7f42896e9640 1 -- start start 2024-05-09T02:20:40.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42896e9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42840726f0 0x7f42840c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:40.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42896e9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f42840c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42896e9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42840c4da0 con 0x7f4284151c50 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42896e9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f42840c8b40 con 0x7f42840726f0 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42896e9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42840c8e20 con 0x7f42840c92b0 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f4282ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4284151c50 0x7f42840c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55376/0 (socket says 172.21.15.46:55376) 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f4282ffd640 1 -- 172.21.15.46:0/3191353901 learned_addr learned my addr 172.21.15.46:0/3191353901 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42837fe640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f42840c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42827fc640 1 --2- 172.21.15.46:0/3191353901 >> v2:172.21.15.107:3300/0 conn(0x7f42840726f0 0x7f42840c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f4281ffb640 1 -- 172.21.15.46:0/3191353901 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249015383 0 0) 0x7f42840c4da0 con 0x7f4284151c50 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f4281ffb640 1 -- 172.21.15.46:0/3191353901 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f426c003520 con 0x7f4284151c50 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42827fc640 1 -- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 msgr2=0x7f42840c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42827fc640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f42840c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42827fc640 1 -- 172.21.15.46:0/3191353901 >> v1:172.21.15.46:6789/0 conn(0x7f4284151c50 legacy=0x7f42840c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42827fc640 1 -- 172.21.15.46:0/3191353901 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4284158570 con 0x7f42840726f0 2024-05-09T02:20:40.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.263+0000 7f42837fe640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f42840c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.264+0000 7f42827fc640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42840726f0 0x7f42840c46c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5633ebe37ce65d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.264+0000 7f4281ffb640 1 -- 172.21.15.46:0/3191353901 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278037070 con 0x7f42840726f0 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.265+0000 7f4281ffb640 1 -- 172.21.15.46:0/3191353901 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427802adb0 con 0x7f42840726f0 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.265+0000 7f4281ffb640 1 -- 172.21.15.46:0/3191353901 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278032640 con 0x7f42840726f0 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 -- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42840726f0 msgr2=0x7f42840c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42840726f0 0x7f42840c46c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802a060 comp rx=0 tx=0).stop 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 -- 172.21.15.46:0/3191353901 shutdown_connections 2024-05-09T02:20:40.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f42840c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 --2- 172.21.15.46:0/3191353901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42840726f0 0x7f42840c46c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 -- 172.21.15.46:0/3191353901 >> 172.21.15.46:0/3191353901 conn(0x7f42840ac930 msgr2=0x7f42840acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 -- 172.21.15.46:0/3191353901 shutdown_connections 2024-05-09T02:20:40.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.266+0000 7f42896e9640 1 -- 172.21.15.46:0/3191353901 wait complete. 2024-05-09T02:20:40.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.269+0000 7f42896e9640 1 Processor -- start 2024-05-09T02:20:40.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.269+0000 7f42896e9640 1 -- start start 2024-05-09T02:20:40.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f42896e9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 0x7f428415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:40.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f42896e9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f4284159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f42896e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4284151c50 0x7f42840ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f42896e9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4284073520 con 0x7f42840726f0 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f42896e9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42840733a0 con 0x7f4284151c50 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f42896e9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42840c9c00 con 0x7f42840c92b0 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f4282ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 0x7f428415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.270+0000 7f4282ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 0x7f428415a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59008/0 (socket says 172.21.15.46:59008) 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 -- 172.21.15.46:0/411891127 learned_addr learned my addr 172.21.15.46:0/411891127 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f42827fc640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f4284159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f42837fe640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4284151c50 0x7f42840ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 -- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 msgr2=0x7f4284159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f4284159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 -- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4284151c50 msgr2=0x7f42840ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4284151c50 0x7f42840ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 -- 172.21.15.46:0/411891127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42840b04f0 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f4282ffd640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 0x7f428415a520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f427400c3c0 tx=0x7f427400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.271+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4274017070 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.272+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4274005ce0 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.272+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42840aea20 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.272+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42740072d0 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.272+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428415bad0 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.273+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428406a330 con 0x7f42840726f0 2024-05-09T02:20:40.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.274+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f427401a070 con 0x7f42840726f0 2024-05-09T02:20:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.274+0000 7f426b7fe640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4270076300 0x7f4270078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.275+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f4274096cf0 con 0x7f42840726f0 2024-05-09T02:20:40.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.275+0000 7f42827fc640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4270076300 0x7f4270078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:40.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.275+0000 7f42827fc640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4270076300 0x7f4270078810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4278034000 tx=0x7f427802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:40.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.279+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f427409b070 con 0x7f42840726f0 2024-05-09T02:20:40.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.552+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4284072f70 con 0x7f42840726f0 2024-05-09T02:20:40.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.553+0000 7f426b7fe640 1 -- 172.21.15.46:0/411891127 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5669 (secure 0 0 0) 0x7f427405fb00 con 0x7f42840726f0 2024-05-09T02:20:40.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:40.556 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:20:40.556 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2024-05-09T02:20:40.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4270076300 msgr2=0x7f4270078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4270076300 0x7f4270078810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4278034000 tx=0x7f427802e000 comp rx=0 tx=0).stop 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 msgr2=0x7f428415a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 0x7f428415a520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f427400c3c0 tx=0x7f427400c880 comp rx=0 tx=0).stop 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 shutdown_connections 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4270076300 0x7f4270078810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4284151c50 0x7f42840ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42840c92b0 0x7f4284159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 --2- 172.21.15.46:0/411891127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42840726f0 0x7f428415a520 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 >> 172.21.15.46:0/411891127 conn(0x7f42840ac930 msgr2=0x7f428406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 shutdown_connections 2024-05-09T02:20:40.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:40.555+0000 7f42896e9640 1 -- 172.21.15.46:0/411891127 wait complete. 2024-05-09T02:20:40.576 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-05-09T02:20:42.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:20:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.721+0000 7f6ffdca7640 1 Processor -- start 2024-05-09T02:20:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.721+0000 7f6ffdca7640 1 -- start start 2024-05-09T02:20:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ffdca7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ff80729e0 0x7f6ff8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ffdca7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80c4e90 0x7f6ff81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ffdca7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff8070cb0 con 0x7f6ff80ca7f0 2024-05-09T02:20:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ffdca7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff80715d0 con 0x7f6ff80729e0 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ffdca7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff8072550 con 0x7f6ff80c4e90 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff6ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6ff80ca7f0 0x7f6ff80c5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55380/0 (socket says 172.21.15.46:55380) 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff6ffd640 1 -- 172.21.15.46:0/1299218961 learned_addr learned my addr 172.21.15.46:0/1299218961 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff7fff640 1 --2- 172.21.15.46:0/1299218961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80c4e90 0x7f6ff81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff77fe640 1 --2- 172.21.15.46:0/1299218961 >> v2:172.21.15.107:3300/0 conn(0x7f6ff80729e0 0x7f6ff8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff67fc640 1 -- 172.21.15.46:0/1299218961 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437718024 0 0) 0x7f6ff8070cb0 con 0x7f6ff80ca7f0 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff67fc640 1 -- 172.21.15.46:0/1299218961 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe0003520 con 0x7f6ff80ca7f0 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff7fff640 1 -- 172.21.15.46:0/1299218961 >> v2:172.21.15.107:3300/0 conn(0x7f6ff80729e0 msgr2=0x7f6ff8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff7fff640 1 --2- 172.21.15.46:0/1299218961 >> v2:172.21.15.107:3300/0 conn(0x7f6ff80729e0 0x7f6ff8152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff7fff640 1 -- 172.21.15.46:0/1299218961 >> v1:172.21.15.46:6789/0 conn(0x7f6ff80ca7f0 legacy=0x7f6ff80c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.723+0000 7f6ff7fff640 1 -- 172.21.15.46:0/1299218961 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff8159950 con 0x7f6ff80c4e90 2024-05-09T02:20:42.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.724+0000 7f6ff77fe640 1 --2- 172.21.15.46:0/1299218961 >> v2:172.21.15.107:3300/0 conn(0x7f6ff80729e0 0x7f6ff8152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.724+0000 7f6ff7fff640 1 --2- 172.21.15.46:0/1299218961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80c4e90 0x7f6ff81557d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009d90 tx=0x7f6ff002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6bde798008d62d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.725+0000 7f6ff67fc640 1 -- 172.21.15.46:0/1299218961 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0031600 con 0x7f6ff80c4e90 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.725+0000 7f6ff67fc640 1 -- 172.21.15.46:0/1299218961 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff00317a0 con 0x7f6ff80c4e90 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.725+0000 7f6ff67fc640 1 -- 172.21.15.46:0/1299218961 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0031b70 con 0x7f6ff80c4e90 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 -- 172.21.15.46:0/1299218961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80c4e90 msgr2=0x7f6ff81557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/1299218961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80c4e90 0x7f6ff81557d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009d90 tx=0x7f6ff002a5d0 comp rx=0 tx=0).stop 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 -- 172.21.15.46:0/1299218961 shutdown_connections 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/1299218961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80c4e90 0x7f6ff81557d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/1299218961 >> v2:172.21.15.107:3300/0 conn(0x7f6ff80729e0 0x7f6ff8152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 -- 172.21.15.46:0/1299218961 >> 172.21.15.46:0/1299218961 conn(0x7f6ff80ac9c0 msgr2=0x7f6ff80acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 -- 172.21.15.46:0/1299218961 shutdown_connections 2024-05-09T02:20:42.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.726+0000 7f6ffdca7640 1 -- 172.21.15.46:0/1299218961 wait complete. 2024-05-09T02:20:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.728+0000 7f6ffdca7640 1 Processor -- start 2024-05-09T02:20:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.728+0000 7f6ffdca7640 1 -- start start 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ffdca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 0x7f6ff8149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ffdca7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ff80c4e90 0x7f6ff8148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ffdca7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80ca7f0 0x7f6ff80ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ffdca7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80c5d40 con 0x7f6ff80c4e90 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ffdca7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8070980 con 0x7f6ff80729e0 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ffdca7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80c5ec0 con 0x7f6ff80ca7f0 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 0x7f6ff8149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 0x7f6ff8149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:45524/0 (socket says 172.21.15.46:45524) 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ff77fe640 1 -- 172.21.15.46:0/728134520 learned_addr learned my addr 172.21.15.46:0/728134520 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ff6ffd640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ff80c4e90 0x7f6ff8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.730+0000 7f6ff7fff640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80ca7f0 0x7f6ff80ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ff77fe640 1 -- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80ca7f0 msgr2=0x7f6ff80ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ff77fe640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80ca7f0 0x7f6ff80ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ff77fe640 1 -- 172.21.15.46:0/728134520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ff80c4e90 msgr2=0x7f6ff8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ff77fe640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ff80c4e90 0x7f6ff8148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ff77fe640 1 -- 172.21.15.46:0/728134520 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff81e2590 con 0x7f6ff80729e0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ff77fe640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 0x7f6ff8149a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800e970 tx=0x7f6fe800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8017070 con 0x7f6ff80729e0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe800ca00 con 0x7f6ff80729e0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff81e2870 con 0x7f6ff80729e0 2024-05-09T02:20:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800cdd0 con 0x7f6ff80729e0 2024-05-09T02:20:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.731+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff81eead0 con 0x7f6ff80729e0 2024-05-09T02:20:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.732+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff806a330 con 0x7f6ff80729e0 2024-05-09T02:20:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.733+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6fe801a070 con 0x7f6ff80729e0 2024-05-09T02:20:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.734+0000 7f6fdffff640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6fe40762d0 0x7f6fe40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:20:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.734+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f6fe8097ca0 con 0x7f6ff80729e0 2024-05-09T02:20:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.734+0000 7f6ff6ffd640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6fe40762d0 0x7f6fe40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:20:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.734+0000 7f6ff6ffd640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6fe40762d0 0x7f6fe40787e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8076780 tx=0x7f6fec006aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:20:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:42.739+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6fe8060aa0 con 0x7f6ff80729e0 2024-05-09T02:20:43.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.027+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ff80ca5d0 con 0x7f6ff80729e0 2024-05-09T02:20:43.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.028+0000 7f6fdffff640 1 -- 172.21.15.46:0/728134520 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7f6fe8064da0 con 0x7f6ff80729e0 2024-05-09T02:20:43.031 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:20:43.031 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:20:43.031 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6fe40762d0 msgr2=0x7f6fe40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6fe40762d0 0x7f6fe40787e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8076780 tx=0x7f6fec006aa0 comp rx=0 tx=0).stop 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 msgr2=0x7f6ff8149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 0x7f6ff8149a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800e970 tx=0x7f6fe800ee30 comp rx=0 tx=0).stop 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 shutdown_connections 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6fe40762d0 0x7f6fe40787e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ff80ca7f0 0x7f6ff80ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ff80c4e90 0x7f6ff8148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 --2- 172.21.15.46:0/728134520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ff80729e0 0x7f6ff8149a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 >> 172.21.15.46:0/728134520 conn(0x7f6ff80ac9c0 msgr2=0x7f6ff80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:20:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 shutdown_connections 2024-05-09T02:20:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:20:43.031+0000 7f6ffdca7640 1 -- 172.21.15.46:0/728134520 wait complete. 2024-05-09T02:20:43.047 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-05-09T02:20:43.047 INFO:tasks.mds_thrash.fs.[a]:waiting for 116 secs before thrashing 2024-05-09T02:20:43.917 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:20:43.917 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 initial writers = 110998.24 kB/sec 2024-05-09T02:20:43.917 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 initial writers = 110995.88 kB/sec 2024-05-09T02:20:43.917 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 110998.24 kB/sec 2024-05-09T02:20:43.917 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 110998.24 kB/sec 2024-05-09T02:20:43.917 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 110998.24 kB/sec 2024-05-09T02:20:43.918 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:20:46.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:20:46.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 initial writers = 96747.49 kB/sec 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 initial writers = 96745.53 kB/sec 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 96747.49 kB/sec 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 96747.49 kB/sec 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 96747.49 kB/sec 2024-05-09T02:20:48.064 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:20:58.504 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:20:58.504 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 rewriters = 125184.73 kB/sec 2024-05-09T02:20:58.504 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 rewriters = 125182.27 kB/sec 2024-05-09T02:20:58.504 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 125184.73 kB/sec 2024-05-09T02:20:58.504 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 125184.73 kB/sec 2024-05-09T02:20:58.505 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 125184.73 kB/sec 2024-05-09T02:20:58.505 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 readers = 7438345.00 kB/sec 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 readers = 7428382.18 kB/sec 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 7438345.00 kB/sec 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 7438345.00 kB/sec 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 7438345.00 kB/sec 2024-05-09T02:21:02.145 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:03.710 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:03.710 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 rewriters = 106974.45 kB/sec 2024-05-09T02:21:03.710 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 rewriters = 106972.33 kB/sec 2024-05-09T02:21:03.711 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 106974.45 kB/sec 2024-05-09T02:21:03.711 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 106974.45 kB/sec 2024-05-09T02:21:03.711 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 106974.45 kB/sec 2024-05-09T02:21:03.711 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:04.358 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:04.358 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 re-readers = 7611779.00 kB/sec 2024-05-09T02:21:04.358 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 re-readers = 7600308.97 kB/sec 2024-05-09T02:21:04.358 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 7611779.00 kB/sec 2024-05-09T02:21:04.358 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 7611779.00 kB/sec 2024-05-09T02:21:04.358 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 7611779.00 kB/sec 2024-05-09T02:21:04.359 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:07.321 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:07.322 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 readers = 7430340.00 kB/sec 2024-05-09T02:21:07.322 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 readers = 7418283.31 kB/sec 2024-05-09T02:21:07.322 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 7430340.00 kB/sec 2024-05-09T02:21:07.322 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 7430340.00 kB/sec 2024-05-09T02:21:07.322 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 7430340.00 kB/sec 2024-05-09T02:21:07.322 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 re-readers = 7084165.00 kB/sec 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 re-readers = 7074410.61 kB/sec 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 7084165.00 kB/sec 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 7084165.00 kB/sec 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 7084165.00 kB/sec 2024-05-09T02:21:09.536 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:10.867 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:10.867 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:10.867 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:10.867 INFO:tasks.workunit.client.1.smithi107.stdout:iozone test complete. 2024-05-09T02:21:10.868 INFO:tasks.workunit.client.1.smithi107.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Iozone: Performance Test of File I/O 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Version $Revision: 3.494 $ 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Compiled for 64 bit mode. 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Build: linux-AMD64 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T02:21:10.935 INFO:tasks.workunit.client.1.smithi107.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Run began: Thu May 9 02:21:10 2024 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Include close in write timing 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Include fsync in write timing 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: File size set to 1048576 kB 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Record Size 1024 kB 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Output is in kBytes/sec 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T02:21:10.936 INFO:tasks.workunit.client.1.smithi107.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T02:21:10.937 INFO:tasks.workunit.client.1.smithi107.stdout: Processor cache line size set to 32 bytes. 2024-05-09T02:21:10.937 INFO:tasks.workunit.client.1.smithi107.stdout: File stride size set to 17 * record size. 2024-05-09T02:21:10.937 INFO:tasks.workunit.client.1.smithi107.stdout: Throughput test with 1 process 2024-05-09T02:21:10.937 INFO:tasks.workunit.client.1.smithi107.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 initial writers = 671202.00 kB/sec 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 initial writers = 671117.03 kB/sec 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 671202.00 kB/sec 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 671202.00 kB/sec 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 671202.00 kB/sec 2024-05-09T02:21:12.528 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:15.937 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:15.938 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:15.938 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:iozone test complete. 2024-05-09T02:21:15.938 INFO:tasks.workunit.client.0.smithi046.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T02:21:16.009 INFO:tasks.workunit.client.0.smithi046.stdout: Iozone: Performance Test of File I/O 2024-05-09T02:21:16.009 INFO:tasks.workunit.client.0.smithi046.stdout: Version $Revision: 3.494 $ 2024-05-09T02:21:16.009 INFO:tasks.workunit.client.0.smithi046.stdout: Compiled for 64 bit mode. 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Build: linux-AMD64 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:16.010 INFO:tasks.workunit.client.0.smithi046.stdout: Run began: Thu May 9 02:21:15 2024 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Include close in write timing 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Include fsync in write timing 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: File size set to 1048576 kB 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Record Size 1024 kB 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Output is in kBytes/sec 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Processor cache line size set to 32 bytes. 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: File stride size set to 17 * record size. 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Throughput test with 1 process 2024-05-09T02:21:16.011 INFO:tasks.workunit.client.0.smithi046.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-09T02:21:16.340 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:16.341 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 rewriters = 754826.88 kB/sec 2024-05-09T02:21:16.341 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 rewriters = 754702.45 kB/sec 2024-05-09T02:21:16.341 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 754826.88 kB/sec 2024-05-09T02:21:16.341 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 754826.88 kB/sec 2024-05-09T02:21:16.341 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 754826.88 kB/sec 2024-05-09T02:21:16.341 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:17.731 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:17.732 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 initial writers = 622121.19 kB/sec 2024-05-09T02:21:17.732 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 initial writers = 622030.84 kB/sec 2024-05-09T02:21:17.732 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 622121.19 kB/sec 2024-05-09T02:21:17.732 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 622121.19 kB/sec 2024-05-09T02:21:17.732 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 622121.19 kB/sec 2024-05-09T02:21:17.732 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:17.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:21:17.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:21:18.784 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:18.785 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 readers = 7613334.00 kB/sec 2024-05-09T02:21:18.785 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 readers = 7601241.61 kB/sec 2024-05-09T02:21:18.785 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 7613334.00 kB/sec 2024-05-09T02:21:18.785 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 7613334.00 kB/sec 2024-05-09T02:21:18.785 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 7613334.00 kB/sec 2024-05-09T02:21:18.785 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:21.115 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:21.116 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 re-readers = 6451862.50 kB/sec 2024-05-09T02:21:21.116 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 re-readers = 6440336.40 kB/sec 2024-05-09T02:21:21.116 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 6451862.50 kB/sec 2024-05-09T02:21:21.116 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 6451862.50 kB/sec 2024-05-09T02:21:21.116 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 6451862.50 kB/sec 2024-05-09T02:21:21.116 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:21.485 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:21.485 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 rewriters = 768710.12 kB/sec 2024-05-09T02:21:21.485 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 rewriters = 768572.71 kB/sec 2024-05-09T02:21:21.486 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 768710.12 kB/sec 2024-05-09T02:21:21.486 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 768710.12 kB/sec 2024-05-09T02:21:21.486 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 768710.12 kB/sec 2024-05-09T02:21:21.486 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:23.914 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:23.914 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 readers = 8019459.50 kB/sec 2024-05-09T02:21:23.914 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 readers = 8006772.49 kB/sec 2024-05-09T02:21:23.914 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 8019459.50 kB/sec 2024-05-09T02:21:23.915 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 8019459.50 kB/sec 2024-05-09T02:21:23.915 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 8019459.50 kB/sec 2024-05-09T02:21:23.915 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 re-readers = 7580149.00 kB/sec 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 re-readers = 7567549.68 kB/sec 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 7580149.00 kB/sec 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 7580149.00 kB/sec 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 7580149.00 kB/sec 2024-05-09T02:21:26.102 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 1048576.00 kB 2024-05-09T02:21:27.533 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:27.533 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:27.533 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:27.533 INFO:tasks.workunit.client.1.smithi107.stdout:iozone test complete. 2024-05-09T02:21:27.534 INFO:tasks.workunit.client.1.smithi107.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T02:21:27.599 INFO:tasks.workunit.client.1.smithi107.stdout: Iozone: Performance Test of File I/O 2024-05-09T02:21:27.599 INFO:tasks.workunit.client.1.smithi107.stdout: Version $Revision: 3.494 $ 2024-05-09T02:21:27.599 INFO:tasks.workunit.client.1.smithi107.stdout: Compiled for 64 bit mode. 2024-05-09T02:21:27.599 INFO:tasks.workunit.client.1.smithi107.stdout: Build: linux-AMD64 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Run began: Thu May 9 02:21:27 2024 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:27.600 INFO:tasks.workunit.client.1.smithi107.stdout: Include close in write timing 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Include fsync in write timing 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: File size set to 10485760 kB 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Record Size 1024 kB 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Output is in kBytes/sec 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Processor cache line size set to 32 bytes. 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: File stride size set to 17 * record size. 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Throughput test with 1 process 2024-05-09T02:21:27.601 INFO:tasks.workunit.client.1.smithi107.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-09T02:21:32.658 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:32.658 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:32.658 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:32.658 INFO:tasks.workunit.client.0.smithi046.stdout:iozone test complete. 2024-05-09T02:21:32.659 INFO:tasks.workunit.client.0.smithi046.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T02:21:32.728 INFO:tasks.workunit.client.0.smithi046.stdout: Iozone: Performance Test of File I/O 2024-05-09T02:21:32.728 INFO:tasks.workunit.client.0.smithi046.stdout: Version $Revision: 3.494 $ 2024-05-09T02:21:32.728 INFO:tasks.workunit.client.0.smithi046.stdout: Compiled for 64 bit mode. 2024-05-09T02:21:32.728 INFO:tasks.workunit.client.0.smithi046.stdout: Build: linux-AMD64 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: Run began: Thu May 9 02:21:32 2024 2024-05-09T02:21:32.729 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Include close in write timing 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Include fsync in write timing 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: File size set to 10485760 kB 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Record Size 1024 kB 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Output is in kBytes/sec 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Processor cache line size set to 32 bytes. 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: File stride size set to 17 * record size. 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Throughput test with 1 process 2024-05-09T02:21:32.730 INFO:tasks.workunit.client.0.smithi046.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-09T02:21:46.311 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:21:46.311 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 initial writers = 561342.94 kB/sec 2024-05-09T02:21:46.311 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 initial writers = 561336.34 kB/sec 2024-05-09T02:21:46.311 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 561342.94 kB/sec 2024-05-09T02:21:46.312 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 561342.94 kB/sec 2024-05-09T02:21:46.312 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 561342.94 kB/sec 2024-05-09T02:21:46.312 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:21:48.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:21:48.108 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 initial writers = 537668.44 kB/sec 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 initial writers = 537661.46 kB/sec 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 537668.44 kB/sec 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 537668.44 kB/sec 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 537668.44 kB/sec 2024-05-09T02:21:52.267 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:08.614 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:22:08.615 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 rewriters = 591378.12 kB/sec 2024-05-09T02:22:08.615 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 rewriters = 591368.93 kB/sec 2024-05-09T02:22:08.615 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 591378.12 kB/sec 2024-05-09T02:22:08.615 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 591378.12 kB/sec 2024-05-09T02:22:08.615 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 591378.12 kB/sec 2024-05-09T02:22:08.615 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:14.193 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:22:14.194 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 rewriters = 596917.44 kB/sec 2024-05-09T02:22:14.194 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 rewriters = 596910.65 kB/sec 2024-05-09T02:22:14.194 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 596917.44 kB/sec 2024-05-09T02:22:14.194 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 596917.44 kB/sec 2024-05-09T02:22:14.194 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 596917.44 kB/sec 2024-05-09T02:22:14.194 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:14.354 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:22:14.354 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 readers = 6561519.00 kB/sec 2024-05-09T02:22:14.354 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 readers = 6560615.90 kB/sec 2024-05-09T02:22:14.355 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 6561519.00 kB/sec 2024-05-09T02:22:14.355 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 6561519.00 kB/sec 2024-05-09T02:22:14.355 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 6561519.00 kB/sec 2024-05-09T02:22:14.355 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:17.959 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:22:17.959 INFO:tasks.workunit.client.1.smithi107.stdout: Children see throughput for 1 re-readers = 7969852.00 kB/sec 2024-05-09T02:22:17.960 INFO:tasks.workunit.client.1.smithi107.stdout: Parent sees throughput for 1 re-readers = 7968520.99 kB/sec 2024-05-09T02:22:17.960 INFO:tasks.workunit.client.1.smithi107.stdout: Min throughput per process = 7969852.00 kB/sec 2024-05-09T02:22:17.960 INFO:tasks.workunit.client.1.smithi107.stdout: Max throughput per process = 7969852.00 kB/sec 2024-05-09T02:22:17.960 INFO:tasks.workunit.client.1.smithi107.stdout: Avg throughput per process = 7969852.00 kB/sec 2024-05-09T02:22:17.960 INFO:tasks.workunit.client.1.smithi107.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:18.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:22:18.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:22:19.323 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:22:19.324 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 readers = 8917434.00 kB/sec 2024-05-09T02:22:19.324 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 readers = 8915287.19 kB/sec 2024-05-09T02:22:19.324 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 8917434.00 kB/sec 2024-05-09T02:22:19.324 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 8917434.00 kB/sec 2024-05-09T02:22:19.324 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 8917434.00 kB/sec 2024-05-09T02:22:19.324 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: Children see throughput for 1 re-readers = 8897638.00 kB/sec 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: Parent sees throughput for 1 re-readers = 8895887.43 kB/sec 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: Min throughput per process = 8897638.00 kB/sec 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: Max throughput per process = 8897638.00 kB/sec 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: Avg throughput per process = 8897638.00 kB/sec 2024-05-09T02:22:22.621 INFO:tasks.workunit.client.0.smithi046.stdout: Min xfer = 10485760.00 kB 2024-05-09T02:22:24.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:24.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.235+0000 7f2c41253640 1 Processor -- start 2024-05-09T02:22:24.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.235+0000 7f2c41253640 1 -- start start 2024-05-09T02:22:24.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.236+0000 7f2c41253640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 0x7f2c3c153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.236+0000 7f2c41253640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 0x7f2c3c06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.236+0000 7f2c41253640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c3c0aa900 con 0x7f2c3c06fef0 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.236+0000 7f2c41253640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2c3c153560 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.236+0000 7f2c41253640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c0c3e50 con 0x7f2c3c0c51a0 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3a59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 0x7f2c3c06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 0x7f2c3c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3b59e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2c3c06fef0 0x7f2c3c155880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:37390/0 (socket says 172.21.15.46:37390) 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3a59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 0x7f2c3c06f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:36338/0 (socket says 172.21.15.46:36338) 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 0x7f2c3c153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:49492/0 (socket says 172.21.15.46:49492) 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3b59e640 1 -- 172.21.15.46:0/365028663 learned_addr learned my addr 172.21.15.46:0/365028663 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c39d9b640 1 -- 172.21.15.46:0/365028663 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298125975 0 0) 0x7f2c3c0aa900 con 0x7f2c3c06fef0 2024-05-09T02:22:24.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c39d9b640 1 -- 172.21.15.46:0/365028663 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c24003520 con 0x7f2c3c06fef0 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3ad9d640 1 -- 172.21.15.46:0/365028663 >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 msgr2=0x7f2c3c06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3ad9d640 1 --2- 172.21.15.46:0/365028663 >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 0x7f2c3c06f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3ad9d640 1 -- 172.21.15.46:0/365028663 >> v1:172.21.15.107:6789/0 conn(0x7f2c3c06fef0 legacy=0x7f2c3c155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3ad9d640 1 -- 172.21.15.46:0/365028663 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c0aa620 con 0x7f2c3c0c51a0 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.237+0000 7f2c3a59c640 1 --2- 172.21.15.46:0/365028663 >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 0x7f2c3c06f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.238+0000 7f2c3ad9d640 1 --2- 172.21.15.46:0/365028663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 0x7f2c3c153020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009d90 tx=0x7f2c2c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac6e2664357f02f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.238+0000 7f2c39d9b640 1 -- 172.21.15.46:0/365028663 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c031600 con 0x7f2c3c0c51a0 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.238+0000 7f2c39d9b640 1 -- 172.21.15.46:0/365028663 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c0317a0 con 0x7f2c3c0c51a0 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.238+0000 7f2c39d9b640 1 -- 172.21.15.46:0/365028663 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c031b70 con 0x7f2c3c0c51a0 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 -- 172.21.15.46:0/365028663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 msgr2=0x7f2c3c153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 --2- 172.21.15.46:0/365028663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 0x7f2c3c153020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009d90 tx=0x7f2c2c02a5d0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 -- 172.21.15.46:0/365028663 shutdown_connections 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 --2- 172.21.15.46:0/365028663 >> v2:172.21.15.107:3300/0 conn(0x7f2c3c0c42e0 0x7f2c3c06f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 --2- 172.21.15.46:0/365028663 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c0c51a0 0x7f2c3c153020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 -- 172.21.15.46:0/365028663 >> 172.21.15.46:0/365028663 conn(0x7f2c3c0c5940 msgr2=0x7f2c3c0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:24.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 -- 172.21.15.46:0/365028663 shutdown_connections 2024-05-09T02:22:24.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.239+0000 7f2c41253640 1 -- 172.21.15.46:0/365028663 wait complete. 2024-05-09T02:22:24.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.241+0000 7f2c41253640 1 Processor -- start 2024-05-09T02:22:24.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.241+0000 7f2c41253640 1 -- start start 2024-05-09T02:22:24.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c41253640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c06fef0 0x7f2c3c1e1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c41253640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 0x7f2c3c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c41253640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c3c0c51a0 0x7f2c3c1edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c41253640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c0aa2b0 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c41253640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c0c3ae0 con 0x7f2c3c0c51a0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c41253640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c155f90 con 0x7f2c3c06fef0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.242+0000 7f2c3a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 0x7f2c3c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 0x7f2c3c0ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58872/0 (socket says 172.21.15.46:58872) 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 -- 172.21.15.46:0/2088193058 learned_addr learned my addr 172.21.15.46:0/2088193058 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3b59e640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c3c0c51a0 0x7f2c3c1edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3ad9d640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c06fef0 0x7f2c3c1e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 -- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c06fef0 msgr2=0x7f2c3c1e1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c06fef0 0x7f2c3c1e1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 -- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c3c0c51a0 msgr2=0x7f2c3c1edbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c3c0c51a0 0x7f2c3c1edbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 -- 172.21.15.46:0/2088193058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c14ffd0 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3b59e640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c3c0c51a0 0x7f2c3c1edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:22:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c3a59c640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 0x7f2c3c0ad090 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000e900 tx=0x7f2c3000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30017070 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3000ca00 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c0745d0 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000cdf0 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.243+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c1ee630 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.244+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c1f17f0 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.245+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c3001a070 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.246+0000 7f2c237fe640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2c280762d0 0x7f2c280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.246+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f2c30097770 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.246+0000 7f2c3ad9d640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2c280762d0 0x7f2c280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.247+0000 7f2c3ad9d640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2c280762d0 0x7f2c280787e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c034000 tx=0x7f2c2c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.250+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c30060660 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.477+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c3c06a330 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.478+0000 7f2c237fe640 1 -- 172.21.15.46:0/2088193058 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7f2c30064960 con 0x7f2c3c0c42e0 2024-05-09T02:22:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:24.481 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:24.482 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2c280762d0 msgr2=0x7f2c280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2c280762d0 0x7f2c280787e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c034000 tx=0x7f2c2c02f000 comp rx=0 tx=0).stop 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 msgr2=0x7f2c3c0ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 0x7f2c3c0ad090 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000e900 tx=0x7f2c3000edc0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 shutdown_connections 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2c280762d0 0x7f2c280787e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c3c0c51a0 0x7f2c3c1edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c3c0c42e0 0x7f2c3c0ad090 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 --2- 172.21.15.46:0/2088193058 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c3c06fef0 0x7f2c3c1e1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 >> 172.21.15.46:0/2088193058 conn(0x7f2c3c0c5940 msgr2=0x7f2c3c06ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 shutdown_connections 2024-05-09T02:22:24.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.480+0000 7f2c41253640 1 -- 172.21.15.46:0/2088193058 wait complete. 2024-05-09T02:22:24.494 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-05-09T02:22:24.495 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T02:22:24.495 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:22:24.506 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T02:22:24.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:24.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.660+0000 7fd222976640 1 Processor -- start 2024-05-09T02:22:24.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.660+0000 7fd222976640 1 -- start start 2024-05-09T02:22:24.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd222976640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd21c0c8ef0 0x7fd21c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd222976640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 0x7fd21c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd222976640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c158490 con 0x7fd21c0c4d60 2024-05-09T02:22:24.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd222976640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0c4600 con 0x7fd21c0c8ef0 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd222976640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0c4040 con 0x7fd21c0c9840 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd21bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd21c0c4d60 0x7fd21c0c7a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58528/0 (socket says 172.21.15.46:58528) 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.661+0000 7fd21bfff640 1 -- 172.21.15.46:0/2856065485 learned_addr learned my addr 172.21.15.46:0/2856065485 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd220f13640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 0x7fd21c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161736433 0 0) 0x7fd21c158490 con 0x7fd21c0c4d60 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21b7fe640 1 --2- 172.21.15.46:0/2856065485 >> v2:172.21.15.107:3300/0 conn(0x7fd21c0c8ef0 0x7fd21c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd204003520 con 0x7fd21c0c4d60 2024-05-09T02:22:24.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2567353482 0 0) 0x7fd204003520 con 0x7fd21c0c4d60 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 msgr2=0x7fd21c071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 0x7fd21c071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 >> v2:172.21.15.107:3300/0 conn(0x7fd21c0c8ef0 msgr2=0x7fd21c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 --2- 172.21.15.46:0/2856065485 >> v2:172.21.15.107:3300/0 conn(0x7fd21c0c8ef0 0x7fd21c0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c158750 con 0x7fd21c0c4d60 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7fd20c0016f0 con 0x7fd21c0c4d60 2024-05-09T02:22:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 >> v1:172.21.15.46:6789/0 conn(0x7fd21c0c4d60 legacy=0x7fd21c0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204003a50 0x7fd204003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 0x7fd204004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd204005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0c4040 con 0x7fd204004d40 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd20400ba70 con 0x7fd204003a50 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd20400bc20 con 0x7fd21c0c9840 2024-05-09T02:22:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd220f13640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd204005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21bfff640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204003a50 0x7fd204003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.662+0000 7fd21b7fe640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 0x7fd204004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd220f13640 1 -- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 msgr2=0x7fd204004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd220f13640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c0c9840 0x7fd204004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd220f13640 1 -- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204003a50 msgr2=0x7fd204003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd220f13640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204003a50 0x7fd204003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd220f13640 1 -- 172.21.15.46:0/2856065485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd204003520 con 0x7fd204004d40 2024-05-09T02:22:24.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd220f13640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd204005150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd214009fc0 tx=0x7fd204005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9df6e4a30091ef3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:24.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214034020 con 0x7fd204004d40 2024-05-09T02:22:24.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2140305f0 con 0x7fd204004d40 2024-05-09T02:22:24.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.663+0000 7fd21affd640 1 -- 172.21.15.46:0/2856065485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214009c10 con 0x7fd204004d40 2024-05-09T02:22:24.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd222976640 1 -- 172.21.15.46:0/2856065485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 msgr2=0x7fd204005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd222976640 1 --2- 172.21.15.46:0/2856065485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd204005150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd214009fc0 tx=0x7fd204005830 comp rx=0 tx=0).stop 2024-05-09T02:22:24.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd220f13640 1 -- 172.21.15.46:0/2856065485 reap_dead start 2024-05-09T02:22:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd222976640 1 -- 172.21.15.46:0/2856065485 shutdown_connections 2024-05-09T02:22:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd222976640 1 -- 172.21.15.46:0/2856065485 >> 172.21.15.46:0/2856065485 conn(0x7fd21c068c70 msgr2=0x7fd21c0ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd222976640 1 -- 172.21.15.46:0/2856065485 shutdown_connections 2024-05-09T02:22:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.664+0000 7fd222976640 1 -- 172.21.15.46:0/2856065485 wait complete. 2024-05-09T02:22:24.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.666+0000 7fd222976640 1 Processor -- start 2024-05-09T02:22:24.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.666+0000 7fd222976640 1 -- start start 2024-05-09T02:22:24.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd222976640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd21c1ee210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd222976640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd21c158d50 0x7fd21c0abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd222976640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c15b600 0x7fd21c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd222976640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c071be0 con 0x7fd204004d40 2024-05-09T02:22:24.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd222976640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0ad7e0 con 0x7fd21c158d50 2024-05-09T02:22:24.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd222976640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c071d60 con 0x7fd21c15b600 2024-05-09T02:22:24.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd21bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd21c1ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd21bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd21c1ee210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58878/0 (socket says 172.21.15.46:58878) 2024-05-09T02:22:24.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.667+0000 7fd21bfff640 1 -- 172.21.15.46:0/2058784558 learned_addr learned my addr 172.21.15.46:0/2058784558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:24.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21b7fe640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd21c158d50 0x7fd21c0abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd220f13640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c15b600 0x7fd21c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21bfff640 1 -- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c15b600 msgr2=0x7fd21c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21bfff640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c15b600 0x7fd21c14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21bfff640 1 -- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd21c158d50 msgr2=0x7fd21c0abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21bfff640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd21c158d50 0x7fd21c0abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21bfff640 1 -- 172.21.15.46:0/2058784558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15a580 con 0x7fd204004d40 2024-05-09T02:22:24.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd220f13640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c15b600 0x7fd21c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:24.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd21bfff640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd21c1ee210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd20c007370 tx=0x7fd20c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:24.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00f9c0 con 0x7fd204004d40 2024-05-09T02:22:24.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c018070 con 0x7fd204004d40 2024-05-09T02:22:24.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c15a860 con 0x7fd204004d40 2024-05-09T02:22:24.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00fdc0 con 0x7fd204004d40 2024-05-09T02:22:24.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.668+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c0ac7b0 con 0x7fd204004d40 2024-05-09T02:22:24.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.669+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c06a330 con 0x7fd204004d40 2024-05-09T02:22:24.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.670+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd20c01d460 con 0x7fd204004d40 2024-05-09T02:22:24.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.670+0000 7fd218ff9640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd208076300 0x7fd208078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:24.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.671+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fd20c097aa0 con 0x7fd204004d40 2024-05-09T02:22:24.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.671+0000 7fd21b7fe640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd208076300 0x7fd208078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:24.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.671+0000 7fd21b7fe640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd208076300 0x7fd208078810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd21c154890 tx=0x7fd210008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:24.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.675+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd20c061050 con 0x7fd204004d40 2024-05-09T02:22:24.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.906+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd21c156560 con 0x7fd204004d40 2024-05-09T02:22:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.906+0000 7fd218ff9640 1 -- 172.21.15.46:0/2058784558 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7fd20c060950 con 0x7fd204004d40 2024-05-09T02:22:24.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:24.908 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd208076300 msgr2=0x7fd208078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd208076300 0x7fd208078810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd21c154890 tx=0x7fd210008040 comp rx=0 tx=0).stop 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 msgr2=0x7fd21c1ee210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd21c1ee210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd20c007370 tx=0x7fd20c007830 comp rx=0 tx=0).stop 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 shutdown_connections 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd208076300 0x7fd208078810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd21c15b600 0x7fd21c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd21c158d50 0x7fd21c0abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 --2- 172.21.15.46:0/2058784558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd204004d40 0x7fd21c1ee210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 >> 172.21.15.46:0/2058784558 conn(0x7fd21c068c70 msgr2=0x7fd21c075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 shutdown_connections 2024-05-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:24.908+0000 7fd222976640 1 -- 172.21.15.46:0/2058784558 wait complete. 2024-05-09T02:22:24.922 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:24.933 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:22:24.933 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:22:24.933 INFO:tasks.workunit.client.1.smithi107.stdout: 2024-05-09T02:22:24.934 INFO:tasks.workunit.client.1.smithi107.stdout:iozone test complete. 2024-05-09T02:22:24.935 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T02:22:24.935 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-09T02:22:26.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:27.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.038+0000 7fe0e999d640 1 Processor -- start 2024-05-09T02:22:27.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.038+0000 7fe0e999d640 1 -- start start 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.039+0000 7fe0e999d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe0e40c96c0 0x7fe0e40c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.039+0000 7fe0e999d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe0e415b3a0 0x7fe0e415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.039+0000 7fe0e999d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e4158ae0 con 0x7fe0e4155160 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.039+0000 7fe0e999d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e4155570 con 0x7fe0e40c96c0 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.039+0000 7fe0e999d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e4157ed0 con 0x7fe0e415b3a0 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e27fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe0e40c96c0 0x7fe0e40c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e2ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe0e4155160 0x7fe0e40c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53548/0 (socket says 172.21.15.46:53548) 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e2ffd640 1 -- 172.21.15.46:0/466037069 learned_addr learned my addr 172.21.15.46:0/466037069 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e37fe640 1 --2- 172.21.15.46:0/466037069 >> v2:172.21.15.107:3300/0 conn(0x7fe0e415b3a0 0x7fe0e415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e27fc640 1 -- 172.21.15.46:0/466037069 >> v2:172.21.15.107:3300/0 conn(0x7fe0e415b3a0 msgr2=0x7fe0e415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:27.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e27fc640 1 --2- 172.21.15.46:0/466037069 >> v2:172.21.15.107:3300/0 conn(0x7fe0e415b3a0 0x7fe0e415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e27fc640 1 -- 172.21.15.46:0/466037069 >> v1:172.21.15.46:6789/0 conn(0x7fe0e4155160 legacy=0x7fe0e40c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:27.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e1ffb640 1 -- 172.21.15.46:0/466037069 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885442161 0 0) 0x7fe0e4158ae0 con 0x7fe0e4155160 2024-05-09T02:22:27.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.040+0000 7fe0e27fc640 1 -- 172.21.15.46:0/466037069 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e41581b0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.041+0000 7fe0e27fc640 1 --2- 172.21.15.46:0/466037069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e40c9ad0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40c3e30 tx=0x7fe0d802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e8e4497624ea1b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.041+0000 7fe0e1ffb640 1 -- 172.21.15.46:0/466037069 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8037070 con 0x7fe0e40c96c0 2024-05-09T02:22:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.041+0000 7fe0e1ffb640 1 -- 172.21.15.46:0/466037069 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d802add0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.041+0000 7fe0e1ffb640 1 -- 172.21.15.46:0/466037069 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8032660 con 0x7fe0e40c96c0 2024-05-09T02:22:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 -- 172.21.15.46:0/466037069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 msgr2=0x7fe0e40c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 --2- 172.21.15.46:0/466037069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e40c9ad0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40c3e30 tx=0x7fe0d802a080 comp rx=0 tx=0).stop 2024-05-09T02:22:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 -- 172.21.15.46:0/466037069 shutdown_connections 2024-05-09T02:22:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 --2- 172.21.15.46:0/466037069 >> v2:172.21.15.107:3300/0 conn(0x7fe0e415b3a0 0x7fe0e415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 --2- 172.21.15.46:0/466037069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e40c9ad0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 -- 172.21.15.46:0/466037069 >> 172.21.15.46:0/466037069 conn(0x7fe0e40aebe0 msgr2=0x7fe0e40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 -- 172.21.15.46:0/466037069 shutdown_connections 2024-05-09T02:22:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.042+0000 7fe0e999d640 1 -- 172.21.15.46:0/466037069 wait complete. 2024-05-09T02:22:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.043+0000 7fe0e999d640 1 Processor -- start 2024-05-09T02:22:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.044+0000 7fe0e999d640 1 -- start start 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e999d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e4150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e999d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0e4155160 0x7fe0e41f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e999d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0e415b3a0 0x7fe0e414def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e999d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40c8670 con 0x7fe0e40c96c0 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e999d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4158770 con 0x7fe0e415b3a0 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e999d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e4157b30 con 0x7fe0e4155160 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e4150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e4150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59680/0 (socket says 172.21.15.46:59680) 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 -- 172.21.15.46:0/2684413091 learned_addr learned my addr 172.21.15.46:0/2684413091 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e37fe640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0e415b3a0 0x7fe0e414def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e27fc640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0e4155160 0x7fe0e41f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 -- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0e4155160 msgr2=0x7fe0e41f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0e4155160 0x7fe0e41f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 -- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0e415b3a0 msgr2=0x7fe0e414def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0e415b3a0 0x7fe0e414def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 -- 172.21.15.46:0/2684413091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e415aed0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e27fc640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0e4155160 0x7fe0e41f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.045+0000 7fe0e2ffd640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e4150950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400c390 tx=0x7fe0d400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.046+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40074e0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.046+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d40047e0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.046+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4004bd0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.046+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e415a910 con 0x7fe0e40c96c0 2024-05-09T02:22:27.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.046+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e41f13c0 con 0x7fe0e40c96c0 2024-05-09T02:22:27.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.047+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e406a330 con 0x7fe0e40c96c0 2024-05-09T02:22:27.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.048+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0d4011070 con 0x7fe0e40c96c0 2024-05-09T02:22:27.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.048+0000 7fe0cbfff640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe0d00762d0 0x7fe0d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:27.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.049+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fe0d4097650 con 0x7fe0e40c96c0 2024-05-09T02:22:27.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.049+0000 7fe0e27fc640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe0d00762d0 0x7fe0d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:27.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.049+0000 7fe0e27fc640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe0d00762d0 0x7fe0d00787e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8034000 tx=0x7fe0d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.053+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe0d4060b40 con 0x7fe0e40c96c0 2024-05-09T02:22:27.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.285+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0e40cb100 con 0x7fe0e40c96c0 2024-05-09T02:22:27.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.286+0000 7fe0cbfff640 1 -- 172.21.15.46:0/2684413091 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7fe0d4060440 con 0x7fe0e40c96c0 2024-05-09T02:22:27.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:27.288 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:27.288 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:27.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe0d00762d0 msgr2=0x7fe0d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:27.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe0d00762d0 0x7fe0d00787e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8034000 tx=0x7fe0d802e000 comp rx=0 tx=0).stop 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 msgr2=0x7fe0e4150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e4150950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400c390 tx=0x7fe0d400c850 comp rx=0 tx=0).stop 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 shutdown_connections 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fe0d00762d0 0x7fe0d00787e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0e415b3a0 0x7fe0e414def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0e4155160 0x7fe0e41f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 --2- 172.21.15.46:0/2684413091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0e40c96c0 0x7fe0e4150950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 >> 172.21.15.46:0/2684413091 conn(0x7fe0e40aebe0 msgr2=0x7fe0e4151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.288+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 shutdown_connections 2024-05-09T02:22:27.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:27.289+0000 7fe0e999d640 1 -- 172.21.15.46:0/2684413091 wait complete. 2024-05-09T02:22:27.303 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:29.304 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:29.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.432+0000 7f86a1292640 1 Processor -- start 2024-05-09T02:22:29.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.432+0000 7f86a1292640 1 -- start start 2024-05-09T02:22:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f86a1292640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f86a1292640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f869c157990 0x7f869c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f86a1292640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869c0b1e60 con 0x7f869c0b17d0 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f86a1292640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f869c15b950 con 0x7f869c157990 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f86a1292640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f869c15bde0 con 0x7f869c0c4800 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869a7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f869c0b17d0 0x7f869c0c8a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53560/0 (socket says 172.21.15.46:53560) 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869a7fc640 1 -- 172.21.15.46:0/3942393522 learned_addr learned my addr 172.21.15.46:0/3942393522 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869affd640 1 --2- 172.21.15.46:0/3942393522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869b7fe640 1 --2- 172.21.15.46:0/3942393522 >> v2:172.21.15.107:3300/0 conn(0x7f869c157990 0x7f869c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f8699ffb640 1 -- 172.21.15.46:0/3942393522 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977687527 0 0) 0x7f869c0b1e60 con 0x7f869c0b17d0 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f8699ffb640 1 -- 172.21.15.46:0/3942393522 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8688003520 con 0x7f869c0b17d0 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869affd640 1 -- 172.21.15.46:0/3942393522 >> v2:172.21.15.107:3300/0 conn(0x7f869c157990 msgr2=0x7f869c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869affd640 1 --2- 172.21.15.46:0/3942393522 >> v2:172.21.15.107:3300/0 conn(0x7f869c157990 0x7f869c157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869affd640 1 -- 172.21.15.46:0/3942393522 >> v1:172.21.15.46:6789/0 conn(0x7f869c0b17d0 legacy=0x7f869c0c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869affd640 1 -- 172.21.15.46:0/3942393522 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c15b020 con 0x7f869c0c4800 2024-05-09T02:22:29.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.434+0000 7f869b7fe640 1 --2- 172.21.15.46:0/3942393522 >> v2:172.21.15.107:3300/0 conn(0x7f869c157990 0x7f869c157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.435+0000 7f869affd640 1 --2- 172.21.15.46:0/3942393522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c154ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f869c15bad0 tx=0x7f868c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1eb82e83213f6e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.435+0000 7f8699ffb640 1 -- 172.21.15.46:0/3942393522 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c037070 con 0x7f869c0c4800 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.435+0000 7f8699ffb640 1 -- 172.21.15.46:0/3942393522 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c02ae50 con 0x7f869c0c4800 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.435+0000 7f8699ffb640 1 -- 172.21.15.46:0/3942393522 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c032660 con 0x7f869c0c4800 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 -- 172.21.15.46:0/3942393522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 msgr2=0x7f869c154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 --2- 172.21.15.46:0/3942393522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c154ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f869c15bad0 tx=0x7f868c02a100 comp rx=0 tx=0).stop 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 -- 172.21.15.46:0/3942393522 shutdown_connections 2024-05-09T02:22:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 --2- 172.21.15.46:0/3942393522 >> v2:172.21.15.107:3300/0 conn(0x7f869c157990 0x7f869c157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 --2- 172.21.15.46:0/3942393522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c154ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 -- 172.21.15.46:0/3942393522 >> 172.21.15.46:0/3942393522 conn(0x7f869c068ec0 msgr2=0x7f869c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 -- 172.21.15.46:0/3942393522 shutdown_connections 2024-05-09T02:22:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.436+0000 7f86a1292640 1 -- 172.21.15.46:0/3942393522 wait complete. 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.438+0000 7f86a1292640 1 Processor -- start 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.438+0000 7f86a1292640 1 -- start start 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f86a1292640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 0x7f869c1f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f86a1292640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f86a1292640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f869c157990 0x7f869c145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f86a1292640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f869c06ee40 con 0x7f869c0b17d0 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f86a1292640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f869c15b5e0 con 0x7f869c157990 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f86a1292640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f869c0b2120 con 0x7f869c0c4800 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f869affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 0x7f869c1f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f869affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 0x7f869c1f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59688/0 (socket says 172.21.15.46:59688) 2024-05-09T02:22:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.439+0000 7f869affd640 1 -- 172.21.15.46:0/833224793 learned_addr learned my addr 172.21.15.46:0/833224793 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869a7fc640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869b7fe640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f869c157990 0x7f869c145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869affd640 1 -- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 msgr2=0x7f869c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869affd640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869affd640 1 -- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f869c157990 msgr2=0x7f869c145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869affd640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f869c157990 0x7f869c145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869affd640 1 -- 172.21.15.46:0/833224793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c1f0ea0 con 0x7f869c0b17d0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869b7fe640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f869c157990 0x7f869c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f869affd640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 0x7f869c1f1910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c041070 con 0x7f869c0b17d0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c03c460 con 0x7f869c0b17d0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869c0cc770 con 0x7f869c0b17d0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c037040 con 0x7f869c0b17d0 2024-05-09T02:22:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.440+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f869c1f13f0 con 0x7f869c0b17d0 2024-05-09T02:22:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.441+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869c06a330 con 0x7f869c0b17d0 2024-05-09T02:22:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.442+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f868c044070 con 0x7f869c0b17d0 2024-05-09T02:22:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.443+0000 7f86937fe640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f867c0762d0 0x7f867c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.443+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f868c0b8800 con 0x7f869c0b17d0 2024-05-09T02:22:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.443+0000 7f869a7fc640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f867c0762d0 0x7f867c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.444+0000 7f869a7fc640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f867c0762d0 0x7f867c0787e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8684007a60 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:29.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.447+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f868c081bb0 con 0x7f869c0b17d0 2024-05-09T02:22:29.484 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:22:29.484 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:22:29.484 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-09T02:22:29.484 INFO:tasks.workunit.client.0.smithi046.stdout:iozone test complete. 2024-05-09T02:22:29.486 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T02:22:29.486 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T02:22:29.518 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-09T02:22:29.519 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T02:22:29.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.683+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f869c0c8830 con 0x7f869c0b17d0 2024-05-09T02:22:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.684+0000 7f86937fe640 1 -- 172.21.15.46:0/833224793 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7f868c0814b0 con 0x7f869c0b17d0 2024-05-09T02:22:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:29.686 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f867c0762d0 msgr2=0x7f867c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f867c0762d0 0x7f867c0787e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8684007a60 tx=0x7f8684009040 comp rx=0 tx=0).stop 2024-05-09T02:22:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 msgr2=0x7f869c1f1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:29.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 0x7f869c1f1910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c0046c0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 shutdown_connections 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f867c0762d0 0x7f867c0787e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f869c157990 0x7f869c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f869c0c4800 0x7f869c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 --2- 172.21.15.46:0/833224793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f869c0b17d0 0x7f869c1f1910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 >> 172.21.15.46:0/833224793 conn(0x7f869c068ec0 msgr2=0x7f869c14fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 shutdown_connections 2024-05-09T02:22:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:29.686+0000 7f86a1292640 1 -- 172.21.15.46:0/833224793 wait complete. 2024-05-09T02:22:29.700 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:29.843 DEBUG:teuthology.parallel:result is None 2024-05-09T02:22:31.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:31.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.819+0000 7f8a5f784640 1 Processor -- start 2024-05-09T02:22:31.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.820+0000 7f8a5f784640 1 -- start start 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5f784640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8a580c8410 0x7f8a581584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5f784640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5806ed30 con 0x7f8a580c1e20 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5f784640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a580c7930 con 0x7f8a58140d40 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5f784640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8a580c8820 con 0x7f8a580c8410 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5dd21640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8a580c1e20 0x7f8a580c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53576/0 (socket says 172.21.15.46:53576) 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5dd21640 1 -- 172.21.15.46:0/77613024 learned_addr learned my addr 172.21.15.46:0/77613024 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5cd1f640 1 --2- 172.21.15.46:0/77613024 >> v2:172.21.15.107:3300/0 conn(0x7f8a580c8410 0x7f8a581584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611027053 0 0) 0x7f8a5806ed30 con 0x7f8a580c1e20 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a44003520 con 0x7f8a580c1e20 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935287302 0 0) 0x7f8a580c7930 con 0x7f8a58140d40 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a5806ed30 con 0x7f8a58140d40 2024-05-09T02:22:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5cd1f640 1 -- 172.21.15.46:0/77613024 >> v1:172.21.15.107:6789/0 conn(0x7f8a58140d40 legacy=0x7f8a5806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:31.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5cd1f640 1 -- 172.21.15.46:0/77613024 >> v1:172.21.15.46:6789/0 conn(0x7f8a580c1e20 legacy=0x7f8a580c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:31.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.821+0000 7f8a5cd1f640 1 -- 172.21.15.46:0/77613024 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a580c7c10 con 0x7f8a580c8410 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.822+0000 7f8a5cd1f640 1 --2- 172.21.15.46:0/77613024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c8410 0x7f8a581584a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097a0 tx=0x7f8a4802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=658d6b8638e85725 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.822+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48037070 con 0x7f8a580c8410 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.822+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a48032440 con 0x7f8a580c8410 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.822+0000 7f8a4ffff640 1 -- 172.21.15.46:0/77613024 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480327f0 con 0x7f8a580c8410 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 -- 172.21.15.46:0/77613024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c8410 msgr2=0x7f8a581584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 --2- 172.21.15.46:0/77613024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c8410 0x7f8a581584a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097a0 tx=0x7f8a4802a1a0 comp rx=0 tx=0).stop 2024-05-09T02:22:31.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 -- 172.21.15.46:0/77613024 shutdown_connections 2024-05-09T02:22:31.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 --2- 172.21.15.46:0/77613024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c8410 0x7f8a581584a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:31.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 -- 172.21.15.46:0/77613024 >> 172.21.15.46:0/77613024 conn(0x7f8a58068e00 msgr2=0x7f8a580c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:31.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 -- 172.21.15.46:0/77613024 shutdown_connections 2024-05-09T02:22:31.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.823+0000 7f8a5f784640 1 -- 172.21.15.46:0/77613024 wait complete. 2024-05-09T02:22:31.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.825+0000 7f8a5f784640 1 Processor -- start 2024-05-09T02:22:31.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.825+0000 7f8a5f784640 1 -- start start 2024-05-09T02:22:31.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5f784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c1e20 0x7f8a581559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:31.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5f784640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a580c8410 0x7f8a581ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:31.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5f784640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 0x7f8a58157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:31.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5f784640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580c92f0 con 0x7f8a58140d40 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5f784640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5806f010 con 0x7f8a580c1e20 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5f784640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8a580c9470 con 0x7f8a580c8410 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5dd21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 0x7f8a58157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5dd21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 0x7f8a58157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59702/0 (socket says 172.21.15.46:59702) 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5dd21640 1 -- 172.21.15.46:0/966362546 learned_addr learned my addr 172.21.15.46:0/966362546 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5d520640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c1e20 0x7f8a581559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.826+0000 7f8a5cd1f640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a580c8410 0x7f8a581ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5dd21640 1 -- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a580c8410 msgr2=0x7f8a581ee250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5dd21640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a580c8410 0x7f8a581ee250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5dd21640 1 -- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c1e20 msgr2=0x7f8a581559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5dd21640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c1e20 0x7f8a581559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5dd21640 1 -- 172.21.15.46:0/966362546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a58157730 con 0x7f8a58140d40 2024-05-09T02:22:31.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5dd21640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 0x7f8a58157e20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000cad0 tx=0x7f8a5000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000ac30 con 0x7f8a58140d40 2024-05-09T02:22:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5000add0 con 0x7f8a58140d40 2024-05-09T02:22:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a58138670 con 0x7f8a58140d40 2024-05-09T02:22:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50012620 con 0x7f8a58140d40 2024-05-09T02:22:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.827+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a581f2060 con 0x7f8a58140d40 2024-05-09T02:22:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.828+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a58157900 con 0x7f8a58140d40 2024-05-09T02:22:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.829+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a500127c0 con 0x7f8a58140d40 2024-05-09T02:22:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.830+0000 7f8a4dffb640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a3c076300 0x7f8a3c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.830+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f8a50097fe0 con 0x7f8a58140d40 2024-05-09T02:22:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.830+0000 7f8a5d520640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a3c076300 0x7f8a3c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.830+0000 7f8a5d520640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a3c076300 0x7f8a3c078810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a54001120 tx=0x7f8a54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:31.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:31.834+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8a50060d80 con 0x7f8a58140d40 2024-05-09T02:22:32.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.066+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a5806a330 con 0x7f8a58140d40 2024-05-09T02:22:32.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.067+0000 7f8a4dffb640 1 -- 172.21.15.46:0/966362546 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7f8a50065080 con 0x7f8a58140d40 2024-05-09T02:22:32.069 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:32.069 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:32.069 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:32.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a3c076300 msgr2=0x7f8a3c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a3c076300 0x7f8a3c078810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a54001120 tx=0x7f8a54009040 comp rx=0 tx=0).stop 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 msgr2=0x7f8a58157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 0x7f8a58157e20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000cad0 tx=0x7f8a5000cf90 comp rx=0 tx=0).stop 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 shutdown_connections 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8a3c076300 0x7f8a3c078810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58140d40 0x7f8a58157e20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a580c8410 0x7f8a581ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 --2- 172.21.15.46:0/966362546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a580c1e20 0x7f8a581559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 >> 172.21.15.46:0/966362546 conn(0x7f8a58068e00 msgr2=0x7f8a5813e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 shutdown_connections 2024-05-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:32.069+0000 7f8a5f784640 1 -- 172.21.15.46:0/966362546 wait complete. 2024-05-09T02:22:32.083 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:34.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.211+0000 7fda866e2640 1 Processor -- start 2024-05-09T02:22:34.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.211+0000 7fda866e2640 1 -- start start 2024-05-09T02:22:34.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.212+0000 7fda866e2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda80155160 0x7fda800c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda866e2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fda800c84a0 0x7fda800c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda866e2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda800c9c00 0x7fda8015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda866e2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fda80158ae0 con 0x7fda800c84a0 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda866e2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fda80155570 con 0x7fda800c9c00 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda866e2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda80157ed0 con 0x7fda80155160 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fda800c84a0 0x7fda800c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fda800c84a0 0x7fda800c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59704/0 (socket says 172.21.15.46:59704) 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 -- 172.21.15.46:0/772642681 learned_addr learned my addr 172.21.15.46:0/772642681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7ffff640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda80155160 0x7fda800c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 -- 172.21.15.46:0/772642681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda80155160 msgr2=0x7fda800c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda80155160 0x7fda800c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda84c7f640 1 --2- 172.21.15.46:0/772642681 >> v2:172.21.15.107:3300/0 conn(0x7fda800c9c00 0x7fda8015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 -- 172.21.15.46:0/772642681 >> v2:172.21.15.107:3300/0 conn(0x7fda800c9c00 msgr2=0x7fda8015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:34.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 --2- 172.21.15.46:0/772642681 >> v2:172.21.15.107:3300/0 conn(0x7fda800c9c00 0x7fda8015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7f7fe640 1 -- 172.21.15.46:0/772642681 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda801581b0 con 0x7fda800c84a0 2024-05-09T02:22:34.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda7ffff640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda80155160 0x7fda800c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:34.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.213+0000 7fda84c7f640 1 --2- 172.21.15.46:0/772642681 >> v2:172.21.15.107:3300/0 conn(0x7fda800c9c00 0x7fda8015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:34.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.214+0000 7fda7f7fe640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda800c96c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda800c73d0 tx=0x7fda7402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e681859ce8ddb54 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.214+0000 7fda7effd640 1 -- 172.21.15.46:0/772642681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74037070 con 0x7fda800c84a0 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.214+0000 7fda7effd640 1 -- 172.21.15.46:0/772642681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7402ae00 con 0x7fda800c84a0 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.214+0000 7fda7effd640 1 -- 172.21.15.46:0/772642681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74032660 con 0x7fda800c84a0 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 -- 172.21.15.46:0/772642681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 msgr2=0x7fda800c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda800c96c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda800c73d0 tx=0x7fda7402a0b0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 -- 172.21.15.46:0/772642681 shutdown_connections 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 --2- 172.21.15.46:0/772642681 >> v2:172.21.15.107:3300/0 conn(0x7fda800c9c00 0x7fda8015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda800c96c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 --2- 172.21.15.46:0/772642681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda80155160 0x7fda800c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 -- 172.21.15.46:0/772642681 >> 172.21.15.46:0/772642681 conn(0x7fda800aebe0 msgr2=0x7fda800aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 -- 172.21.15.46:0/772642681 shutdown_connections 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.215+0000 7fda866e2640 1 -- 172.21.15.46:0/772642681 wait complete. 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.217+0000 7fda866e2640 1 Processor -- start 2024-05-09T02:22:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.217+0000 7fda866e2640 1 -- start start 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda866e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda80153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda866e2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda800c9c00 0x7fda80159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda866e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80155160 0x7fda801461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda866e2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fda80157b30 con 0x7fda800c84a0 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda866e2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fda80158770 con 0x7fda80155160 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda866e2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda80157cb0 con 0x7fda800c9c00 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda80153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda80153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59708/0 (socket says 172.21.15.46:59708) 2024-05-09T02:22:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 -- 172.21.15.46:0/2926131279 learned_addr learned my addr 172.21.15.46:0/2926131279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7f7fe640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda800c9c00 0x7fda80159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda84c7f640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80155160 0x7fda801461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 -- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda800c9c00 msgr2=0x7fda80159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda800c9c00 0x7fda80159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 -- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80155160 msgr2=0x7fda801461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80155160 0x7fda801461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.218+0000 7fda7ffff640 1 -- 172.21.15.46:0/2926131279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8015a3b0 con 0x7fda800c84a0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.219+0000 7fda7ffff640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda80153b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda7000c7f0 tx=0x7fda7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.219+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70015070 con 0x7fda800c84a0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.219+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda70007820 con 0x7fda800c84a0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.219+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8015a690 con 0x7fda800c84a0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.219+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70007bf0 con 0x7fda800c84a0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.219+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda80158e40 con 0x7fda800c84a0 2024-05-09T02:22:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.220+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8006a330 con 0x7fda800c84a0 2024-05-09T02:22:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.221+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda70018070 con 0x7fda800c84a0 2024-05-09T02:22:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.221+0000 7fda7cff9640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fda6c0762d0 0x7fda6c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.222+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fda700978c0 con 0x7fda800c84a0 2024-05-09T02:22:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.222+0000 7fda7f7fe640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fda6c0762d0 0x7fda6c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.222+0000 7fda7f7fe640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fda6c0762d0 0x7fda6c0787e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda74034000 tx=0x7fda7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:34.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.226+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda70060d20 con 0x7fda800c84a0 2024-05-09T02:22:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.454+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda800cb100 con 0x7fda800c84a0 2024-05-09T02:22:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.455+0000 7fda7cff9640 1 -- 172.21.15.46:0/2926131279 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7fda70060620 con 0x7fda800c84a0 2024-05-09T02:22:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:34.457 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fda6c0762d0 msgr2=0x7fda6c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fda6c0762d0 0x7fda6c0787e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda74034000 tx=0x7fda7402e000 comp rx=0 tx=0).stop 2024-05-09T02:22:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 msgr2=0x7fda80153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda80153b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda7000c7f0 tx=0x7fda7000ccb0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 shutdown_connections 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fda6c0762d0 0x7fda6c0787e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80155160 0x7fda801461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda800c9c00 0x7fda80159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 --2- 172.21.15.46:0/2926131279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda800c84a0 0x7fda80153b10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 >> 172.21.15.46:0/2926131279 conn(0x7fda800aebe0 msgr2=0x7fda80157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 shutdown_connections 2024-05-09T02:22:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:34.457+0000 7fda866e2640 1 -- 172.21.15.46:0/2926131279 wait complete. 2024-05-09T02:22:34.471 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:36.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.600+0000 7fd107f66640 1 Processor -- start 2024-05-09T02:22:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.601+0000 7fd107f66640 1 -- start start 2024-05-09T02:22:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd107f66640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 0x7fd1000c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd107f66640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1001553e0 con 0x7fd10015af70 2024-05-09T02:22:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd107f66640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd100158580 con 0x7fd1000c6d70 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd107f66640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1000c2690 con 0x7fd100154fd0 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd106503640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd10015af70 0x7fd10015b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49508/0 (socket says 172.21.15.46:49508) 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd106503640 1 -- 172.21.15.46:0/2162517727 learned_addr learned my addr 172.21.15.46:0/2162517727 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd105501640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 0x7fd1000c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025884536 0 0) 0x7fd0f8001110 con 0x7fd10015af70 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.602+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e8003520 con 0x7fd10015af70 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3480623002 0 0) 0x7fd0e8003520 con 0x7fd10015af70 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 msgr2=0x7fd1000c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 0x7fd1000c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 >> v1:172.21.15.107:6789/0 conn(0x7fd1000c6d70 legacy=0x7fd1000c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd100158860 con 0x7fd10015af70 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7fd0f80018c0 con 0x7fd10015af70 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 >> v1:172.21.15.46:6789/0 conn(0x7fd10015af70 legacy=0x7fd10015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0e8003a30 0x7fd0e8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8004800 0x7fd0e8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 0x7fd0e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1000c2690 con 0x7fd0e8003a30 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8005610 con 0x7fd0e8004800 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e800bf00 con 0x7fd100154fd0 2024-05-09T02:22:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105d02640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0e8003a30 0x7fd0e8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105501640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8004800 0x7fd0e8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd106503640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 0x7fd0e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105d02640 1 -- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 msgr2=0x7fd0e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105d02640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100154fd0 0x7fd0e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105d02640 1 -- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8004800 msgr2=0x7fd0e8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105d02640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8004800 0x7fd0e8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.603+0000 7fd105d02640 1 -- 172.21.15.46:0/2162517727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e8003520 con 0x7fd0e8003a30 2024-05-09T02:22:36.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.604+0000 7fd105d02640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0e8003a30 0x7fd0e8003ea0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0001e60 tx=0x7fd0e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba03620c8029891b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:36.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.604+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0001ab0 con 0x7fd0e8003a30 2024-05-09T02:22:36.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.604+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f002ae40 con 0x7fd0e8003a30 2024-05-09T02:22:36.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.604+0000 7fd104d00640 1 -- 172.21.15.46:0/2162517727 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0003b70 con 0x7fd0e8003a30 2024-05-09T02:22:36.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd107f66640 1 -- 172.21.15.46:0/2162517727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0e8003a30 msgr2=0x7fd0e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd107f66640 1 --2- 172.21.15.46:0/2162517727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0e8003a30 0x7fd0e8003ea0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0001e60 tx=0x7fd0e8005830 comp rx=0 tx=0).stop 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd106503640 1 -- 172.21.15.46:0/2162517727 reap_dead start 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd107f66640 1 -- 172.21.15.46:0/2162517727 shutdown_connections 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd107f66640 1 -- 172.21.15.46:0/2162517727 >> 172.21.15.46:0/2162517727 conn(0x7fd10006e8f0 msgr2=0x7fd10006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd107f66640 1 -- 172.21.15.46:0/2162517727 shutdown_connections 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.605+0000 7fd107f66640 1 -- 172.21.15.46:0/2162517727 wait complete. 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.607+0000 7fd107f66640 1 Processor -- start 2024-05-09T02:22:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.607+0000 7fd107f66640 1 -- start start 2024-05-09T02:22:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd107f66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8003a30 0x7fd10014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd107f66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 0x7fd1001eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd107f66640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100153cf0 0x7fd100154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd107f66640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd10015ba90 con 0x7fd1001f13a0 2024-05-09T02:22:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd107f66640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1000c2320 con 0x7fd0e8003a30 2024-05-09T02:22:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd107f66640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd10015bc10 con 0x7fd100153cf0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd105501640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 0x7fd1001eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd105501640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 0x7fd1001eb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45620/0 (socket says 172.21.15.46:45620) 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd105501640 1 -- 172.21.15.46:0/705821994 learned_addr learned my addr 172.21.15.46:0/705821994 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd105d02640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8003a30 0x7fd10014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.608+0000 7fd106503640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100153cf0 0x7fd100154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd105501640 1 -- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100153cf0 msgr2=0x7fd100154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd105501640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100153cf0 0x7fd100154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd105501640 1 -- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8003a30 msgr2=0x7fd10014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd105501640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8003a30 0x7fd10014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd105501640 1 -- 172.21.15.46:0/705821994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1000caa60 con 0x7fd1001f13a0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd105501640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 0x7fd1001eb490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40119a0 tx=0x7fd0f4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400faf0 con 0x7fd1001f13a0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f400fc90 con 0x7fd1001f13a0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1000cad40 con 0x7fd1001f13a0 2024-05-09T02:22:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4014440 con 0x7fd1001f13a0 2024-05-09T02:22:36.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.609+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1001508e0 con 0x7fd1001f13a0 2024-05-09T02:22:36.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.610+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10006a330 con 0x7fd1001f13a0 2024-05-09T02:22:36.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.611+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd0f4012040 con 0x7fd1001f13a0 2024-05-09T02:22:36.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.612+0000 7fd0fe7fc640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd0ec076300 0x7fd0ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:36.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.612+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fd0f4098050 con 0x7fd1001f13a0 2024-05-09T02:22:36.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.612+0000 7fd105d02640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd0ec076300 0x7fd0ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:36.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.613+0000 7fd105d02640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd0ec076300 0x7fd0ec078810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0032000 tx=0x7fd0f002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:36.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.617+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd0f4019030 con 0x7fd1001f13a0 2024-05-09T02:22:36.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.855+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd100069e80 con 0x7fd1001f13a0 2024-05-09T02:22:36.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.855+0000 7fd0fe7fc640 1 -- 172.21.15.46:0/705821994 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7fd0f4061540 con 0x7fd1001f13a0 2024-05-09T02:22:36.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:36.857 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd0ec076300 msgr2=0x7fd0ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd0ec076300 0x7fd0ec078810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0032000 tx=0x7fd0f002e000 comp rx=0 tx=0).stop 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 msgr2=0x7fd1001eb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 0x7fd1001eb490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40119a0 tx=0x7fd0f4011e60 comp rx=0 tx=0).stop 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 shutdown_connections 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd0ec076300 0x7fd0ec078810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd100153cf0 0x7fd100154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1001f13a0 0x7fd1001eb490 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 --2- 172.21.15.46:0/705821994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e8003a30 0x7fd10014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 >> 172.21.15.46:0/705821994 conn(0x7fd10006e8f0 msgr2=0x7fd1000c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 shutdown_connections 2024-05-09T02:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:36.858+0000 7fd107f66640 1 -- 172.21.15.46:0/705821994 wait complete. 2024-05-09T02:22:36.871 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:38.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:39.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.000+0000 7f2e4dc27640 1 Processor -- start 2024-05-09T02:22:39.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.000+0000 7f2e4dc27640 1 -- start start 2024-05-09T02:22:39.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.001+0000 7f2e4dc27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 0x7f2e4815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.001+0000 7f2e4dc27640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e48158ae0 con 0x7f2e48155160 2024-05-09T02:22:39.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.001+0000 7f2e4dc27640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e48155570 con 0x7f2e480c96c0 2024-05-09T02:22:39.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.001+0000 7f2e4dc27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e48157ed0 con 0x7f2e480c9ad0 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.001+0000 7f2e477fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2e48155160 0x7f2e480c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49510/0 (socket says 172.21.15.46:49510) 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.001+0000 7f2e477fe640 1 -- 172.21.15.46:0/3442092397 learned_addr learned my addr 172.21.15.46:0/3442092397 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e47fff640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 0x7f2e4815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582964257 0 0) 0x7f2e48158ae0 con 0x7f2e48155160 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e30003520 con 0x7f2e48155160 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518588606 0 0) 0x7f2e48155570 con 0x7f2e480c96c0 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e48158ae0 con 0x7f2e480c96c0 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3840888535 0 0) 0x7f2e30003520 con 0x7f2e48155160 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 msgr2=0x7f2e4815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 0x7f2e4815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 >> v1:172.21.15.107:6789/0 conn(0x7f2e480c96c0 legacy=0x7f2e4815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e481581b0 con 0x7f2e48155160 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f2e380016f0 con 0x7f2e48155160 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 >> v1:172.21.15.46:6789/0 conn(0x7f2e48155160 legacy=0x7f2e480c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e30004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30004800 0x7f2e30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 0x7f2e3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48157ed0 con 0x7f2e30003c10 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2e30005600 con 0x7f2e30004800 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3000bf00 con 0x7f2e480c9ad0 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e477fe640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e30004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e47fff640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 0x7f2e3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.002+0000 7f2e46ffd640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30004800 0x7f2e30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e477fe640 1 -- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 msgr2=0x7f2e3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e477fe640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e480c9ad0 0x7f2e3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e477fe640 1 -- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30004800 msgr2=0x7f2e30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e477fe640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30004800 0x7f2e30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e477fe640 1 -- 172.21.15.46:0/3442092397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e30003520 con 0x7f2e30003c10 2024-05-09T02:22:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e477fe640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e30004060 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2e38007fd0 tx=0x7f2e30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5994c6680689f48c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38007ca0 con 0x7f2e30003c10 2024-05-09T02:22:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e38005af0 con 0x7f2e30003c10 2024-05-09T02:22:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.003+0000 7f2e467fc640 1 -- 172.21.15.46:0/3442092397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38007070 con 0x7f2e30003c10 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e4dc27640 1 -- 172.21.15.46:0/3442092397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 msgr2=0x7f2e30004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/3442092397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e30004060 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2e38007fd0 tx=0x7f2e30005830 comp rx=0 tx=0).stop 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e47fff640 1 -- 172.21.15.46:0/3442092397 reap_dead start 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e4dc27640 1 -- 172.21.15.46:0/3442092397 shutdown_connections 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e4dc27640 1 -- 172.21.15.46:0/3442092397 >> 172.21.15.46:0/3442092397 conn(0x7f2e480aebe0 msgr2=0x7f2e480aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e4dc27640 1 -- 172.21.15.46:0/3442092397 shutdown_connections 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.004+0000 7f2e4dc27640 1 -- 172.21.15.46:0/3442092397 wait complete. 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.006+0000 7f2e4dc27640 1 Processor -- start 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.006+0000 7f2e4dc27640 1 -- start start 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.007+0000 7f2e4dc27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e48154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.007+0000 7f2e4dc27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e48153340 0x7f2e48144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.007+0000 7f2e4dc27640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e48159900 0x7f2e48159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.007+0000 7f2e4dc27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2e480c8670 con 0x7f2e30003c10 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.007+0000 7f2e4dc27640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48158770 con 0x7f2e48159900 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.007+0000 7f2e4dc27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e480c9ee0 con 0x7f2e48153340 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e48154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e48154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45626/0 (socket says 172.21.15.46:45626) 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 -- 172.21.15.46:0/2580388775 learned_addr learned my addr 172.21.15.46:0/2580388775 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e47fff640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e48159900 0x7f2e48159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e46ffd640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e48153340 0x7f2e48144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 -- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e48153340 msgr2=0x7f2e48144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e48153340 0x7f2e48144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 -- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e48159900 msgr2=0x7f2e48159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e48159900 0x7f2e48159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 -- 172.21.15.46:0/2580388775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e48145470 con 0x7f2e30003c10 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e46ffd640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e48153340 0x7f2e48144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e477fe640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e48154280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c220 tx=0x7f2e48158380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38042070 con 0x7f2e30003c10 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e380047e0 con 0x7f2e30003c10 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e48158d70 con 0x7f2e30003c10 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38037040 con 0x7f2e30003c10 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.008+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e481ee650 con 0x7f2e30003c10 2024-05-09T02:22:39.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.009+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e48153ec0 con 0x7f2e30003c10 2024-05-09T02:22:39.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.010+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e38004b90 con 0x7f2e30003c10 2024-05-09T02:22:39.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.011+0000 7f2e2ffff640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2e340762d0 0x7f2e340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.011+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f2e380b73f0 con 0x7f2e30003c10 2024-05-09T02:22:39.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.011+0000 7f2e46ffd640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2e340762d0 0x7f2e340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.012+0000 7f2e46ffd640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2e340762d0 0x7f2e340787e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e481e4250 tx=0x7f2e3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.015+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e48145470 con 0x7f2e30003c10 2024-05-09T02:22:39.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:39.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.161+0000 7fc7b7a3b640 1 Processor -- start 2024-05-09T02:22:39.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.161+0000 7fc7b7a3b640 1 -- start start 2024-05-09T02:22:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b7a3b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b0155190 0x7fc7b00c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b7a3b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7b00c3ed0 0x7fc7b015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b7a3b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b00c42e0 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b7a3b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b00c30a0 con 0x7fc7b00c3ed0 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b7a3b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b00c3660 con 0x7fc7b0155190 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b5fd8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7b00c3ed0 0x7fc7b015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b4fd6640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc7b00c3ac0 0x7fc7b015b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49520/0 (socket says 172.21.15.46:49520) 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b5fd8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7b00c3ed0 0x7fc7b015b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45636/0 (socket says 172.21.15.46:45636) 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b4fd6640 1 -- 172.21.15.46:0/1713513280 learned_addr learned my addr 172.21.15.46:0/1713513280 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.162+0000 7fc7b57d7640 1 --2- 172.21.15.46:0/1713513280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b0155190 0x7fc7b00c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7b5fd8640 1 -- 172.21.15.46:0/1713513280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b0155190 msgr2=0x7fc7b00c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7b5fd8640 1 --2- 172.21.15.46:0/1713513280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b0155190 0x7fc7b00c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7b5fd8640 1 -- 172.21.15.46:0/1713513280 >> v1:172.21.15.46:6789/0 conn(0x7fc7b00c3ac0 legacy=0x7fc7b015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7a7fff640 1 -- 172.21.15.46:0/1713513280 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155570122 0 0) 0x7fc7b00c42e0 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7b5fd8640 1 -- 172.21.15.46:0/1713513280 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b015bdf0 con 0x7fc7b00c3ed0 2024-05-09T02:22:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7b5fd8640 1 --2- 172.21.15.46:0/1713513280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ed0 0x7fc7b015b8b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009d90 tx=0x7fc7a802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7dedd3611aaca0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.163+0000 7fc7a7fff640 1 -- 172.21.15.46:0/1713513280 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8007740 con 0x7fc7b00c3ed0 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7a7fff640 1 -- 172.21.15.46:0/1713513280 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a80078e0 con 0x7fc7b00c3ed0 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7a7fff640 1 -- 172.21.15.46:0/1713513280 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8007cb0 con 0x7fc7b00c3ed0 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/1713513280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ed0 msgr2=0x7fc7b015b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/1713513280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ed0 0x7fc7b015b8b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009d90 tx=0x7fc7a802a5f0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/1713513280 shutdown_connections 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/1713513280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ed0 0x7fc7b015b8b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/1713513280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b0155190 0x7fc7b00c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/1713513280 >> 172.21.15.46:0/1713513280 conn(0x7fc7b00c6770 msgr2=0x7fc7b00c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.164+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/1713513280 shutdown_connections 2024-05-09T02:22:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.165+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/1713513280 wait complete. 2024-05-09T02:22:39.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.166+0000 7fc7b7a3b640 1 Processor -- start 2024-05-09T02:22:39.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.166+0000 7fc7b7a3b640 1 -- start start 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.167+0000 7fc7b7a3b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 0x7fc7b0146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.167+0000 7fc7b7a3b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b00c3ed0 0x7fc7b01529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.167+0000 7fc7b7a3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b0155190 0x7fc7b0143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.167+0000 7fc7b7a3b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0074540 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.167+0000 7fc7b7a3b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01555a0 con 0x7fc7b0155190 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.167+0000 7fc7b7a3b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b0074820 con 0x7fc7b00c3ed0 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 0x7fc7b0146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 0x7fc7b0146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45652/0 (socket says 172.21.15.46:45652) 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 -- 172.21.15.46:0/2714983825 learned_addr learned my addr 172.21.15.46:0/2714983825 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b4fd6640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b00c3ed0 0x7fc7b01529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b5fd8640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b0155190 0x7fc7b0143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 -- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b00c3ed0 msgr2=0x7fc7b01529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b00c3ed0 0x7fc7b01529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 -- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b0155190 msgr2=0x7fc7b0143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b0155190 0x7fc7b0143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 -- 172.21.15.46:0/2714983825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b01525a0 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b5fd8640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b0155190 0x7fc7b0143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b57d7640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 0x7fc7b0146900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00e870 tx=0x7fc7ac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac017070 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac00c940 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b0144df0 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.168+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00cd10 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.169+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b0154000 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.170+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b006a330 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.171+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc7ac01a070 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.172+0000 7fc7a5ffb640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7940762d0 0x7fc7940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.172+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fc7ac0979f0 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.172+0000 7fc7b4fd6640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7940762d0 0x7fc7940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.172+0000 7fc7b4fd6640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7940762d0 0x7fc7940787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00afe20 tx=0x7fc7a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.176+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc7ac060e50 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.254+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e4806a330 con 0x7f2e30003c10 2024-05-09T02:22:39.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.254+0000 7f2e2ffff640 1 -- 172.21.15.46:0/2580388775 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7f2e38080370 con 0x7f2e30003c10 2024-05-09T02:22:39.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:39.258 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:39.258 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:39.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2e340762d0 msgr2=0x7f2e340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2e340762d0 0x7f2e340787e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e481e4250 tx=0x7f2e3c009040 comp rx=0 tx=0).stop 2024-05-09T02:22:39.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 msgr2=0x7f2e48154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e48154280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c220 tx=0x7f2e48158380 comp rx=0 tx=0).stop 2024-05-09T02:22:39.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 shutdown_connections 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2e340762d0 0x7f2e340787e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e48159900 0x7f2e48159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e48153340 0x7f2e48144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 --2- 172.21.15.46:0/2580388775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e30003c10 0x7f2e48154280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 >> 172.21.15.46:0/2580388775 conn(0x7f2e480aebe0 msgr2=0x7f2e480c2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 shutdown_connections 2024-05-09T02:22:39.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.257+0000 7f2e4dc27640 1 -- 172.21.15.46:0/2580388775 wait complete. 2024-05-09T02:22:39.272 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-05-09T02:22:39.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.409+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7b0074040 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.410+0000 7fc7a5ffb640 1 -- 172.21.15.46:0/2714983825 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7fc7ac060750 con 0x7fc7b00c3ac0 2024-05-09T02:22:39.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:39.413 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:39.413 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:39.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7940762d0 msgr2=0x7fc7940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7940762d0 0x7fc7940787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00afe20 tx=0x7fc7a0009040 comp rx=0 tx=0).stop 2024-05-09T02:22:39.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 msgr2=0x7fc7b0146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 0x7fc7b0146900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00e870 tx=0x7fc7ac00ed30 comp rx=0 tx=0).stop 2024-05-09T02:22:39.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 shutdown_connections 2024-05-09T02:22:39.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fc7940762d0 0x7fc7940787e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc7b0155190 0x7fc7b0143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7b00c3ed0 0x7fc7b01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 --2- 172.21.15.46:0/2714983825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00c3ac0 0x7fc7b0146900 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 >> 172.21.15.46:0/2714983825 conn(0x7fc7b00c6770 msgr2=0x7fc7b0158690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:39.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 shutdown_connections 2024-05-09T02:22:39.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.412+0000 7fc7b7a3b640 1 -- 172.21.15.46:0/2714983825 wait complete. 2024-05-09T02:22:39.427 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-05-09T02:22:39.427 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T02:22:39.427 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:22:39.440 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T02:22:39.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:39.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.553+0000 7f72d97d6640 1 Processor -- start 2024-05-09T02:22:39.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.553+0000 7f72d97d6640 1 -- start start 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72d97d6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 0x7f72d40c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72d97d6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d41588b0 con 0x7f72d41584a0 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72d97d6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d406ed30 con 0x7f72d40c1e20 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72d97d6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72d406f010 con 0x7f72d4140d40 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72cbfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f72d41584a0 0x7f72d406e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49530/0 (socket says 172.21.15.46:49530) 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72cbfff640 1 -- 172.21.15.46:0/2081657329 learned_addr learned my addr 172.21.15.46:0/2081657329 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72d2ffd640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 0x7f72d40c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.554+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744783904 0 0) 0x7f72d41588b0 con 0x7f72d41584a0 2024-05-09T02:22:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72c0003520 con 0x7f72d41584a0 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1221931609 0 0) 0x7f72c0003520 con 0x7f72d41584a0 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 msgr2=0x7f72d40c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 0x7f72d40c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 >> v1:172.21.15.107:6789/0 conn(0x7f72d40c1e20 legacy=0x7f72d40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d40c7930 con 0x7f72d41584a0 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f72bc0016f0 con 0x7f72d41584a0 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 >> v1:172.21.15.46:6789/0 conn(0x7f72d41584a0 legacy=0x7f72d406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 0x7f72c0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72c0004000 0x7f72c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004d40 0x7f72c00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72d406f010 con 0x7f72c0004000 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f72c000bc80 con 0x7f72c0004d40 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72c000be80 con 0x7f72d4140d40 2024-05-09T02:22:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72cbfff640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72c0004000 0x7f72c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d2ffd640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 0x7f72c0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72d37fe640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004d40 0x7f72c00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72cbfff640 1 -- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 msgr2=0x7f72c0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72cbfff640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d4140d40 0x7f72c0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72cbfff640 1 -- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004d40 msgr2=0x7f72c00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72cbfff640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004d40 0x7f72c00051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.555+0000 7f72cbfff640 1 -- 172.21.15.46:0/2081657329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0003520 con 0x7f72c0004000 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.556+0000 7f72cbfff640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72c0004000 0x7f72c0004800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c240 tx=0x7f72c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e21cf8722f8c4a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.556+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc007ce0 con 0x7f72c0004000 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.556+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc005ad0 con 0x7f72c0004000 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.556+0000 7f72d27fc640 1 -- 172.21.15.46:0/2081657329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc007070 con 0x7f72c0004000 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d97d6640 1 -- 172.21.15.46:0/2081657329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72c0004000 msgr2=0x7f72c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2081657329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72c0004000 0x7f72c0004800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c240 tx=0x7f72c0005830 comp rx=0 tx=0).stop 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d37fe640 1 -- 172.21.15.46:0/2081657329 reap_dead start 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d97d6640 1 -- 172.21.15.46:0/2081657329 shutdown_connections 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d97d6640 1 -- 172.21.15.46:0/2081657329 >> 172.21.15.46:0/2081657329 conn(0x7f72d4068e00 msgr2=0x7f72d40c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d97d6640 1 -- 172.21.15.46:0/2081657329 shutdown_connections 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.557+0000 7f72d97d6640 1 -- 172.21.15.46:0/2081657329 wait complete. 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.559+0000 7f72d97d6640 1 Processor -- start 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.559+0000 7f72d97d6640 1 -- start start 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d97d6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004000 0x7f72d41f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d97d6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d413e7d0 0x7f72d41ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d97d6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 0x7f72d4153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d97d6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72d40c92f0 con 0x7f72d413ebe0 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d97d6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f72d40c7ef0 con 0x7f72c0004000 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d97d6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f72d40c9470 con 0x7f72d413e7d0 2024-05-09T02:22:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 0x7f72d4153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 0x7f72d4153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45660/0 (socket says 172.21.15.46:45660) 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 -- 172.21.15.46:0/2673757486 learned_addr learned my addr 172.21.15.46:0/2673757486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d2ffd640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004000 0x7f72d41f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 -- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d413e7d0 msgr2=0x7f72d41ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72cbfff640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d413e7d0 0x7f72d41ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d413e7d0 0x7f72d41ed880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 -- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004000 msgr2=0x7f72d41f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004000 0x7f72d41f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d37fe640 1 -- 172.21.15.46:0/2673757486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d41f1870 con 0x7f72d413ebe0 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.560+0000 7f72d2ffd640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004000 0x7f72d41f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.561+0000 7f72d37fe640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 0x7f72d4153860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72d40c43c0 tx=0x7f72cc00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.561+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc019070 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.561+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc006e20 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.561+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc003bb0 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.561+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d40c5510 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.561+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d41592b0 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.562+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d406a330 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.562+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f72cc01c070 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.563+0000 7f72cb7fe640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f72b4076300 0x7f72b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.563+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f72cc096eb0 con 0x7f72d413ebe0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.563+0000 7f72d2ffd640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f72b4076300 0x7f72b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.564+0000 7f72d2ffd640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f72b4076300 0x7f72b4078810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72d40b25f0 tx=0x7f72c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:39.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.568+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f72cc060380 con 0x7f72d413ebe0 2024-05-09T02:22:39.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.800+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72d40c89c0 con 0x7f72d413ebe0 2024-05-09T02:22:39.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.801+0000 7f72cb7fe640 1 -- 172.21.15.46:0/2673757486 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6491 (secure 0 0 0) 0x7f72cc05fc80 con 0x7f72d413ebe0 2024-05-09T02:22:39.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:39.804 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:20:32.920438+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4969":{"gid":4969,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.46:6833/3794663718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3794663718},{"type":"v1","addr":"172.21.15.46:6833","nonce":3794663718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4969,"qdb_cluster":[4969]},"id":2}]} 2024-05-09T02:22:39.804 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T02:22:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f72b4076300 msgr2=0x7f72b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f72b4076300 0x7f72b4078810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72d40b25f0 tx=0x7f72c4008040 comp rx=0 tx=0).stop 2024-05-09T02:22:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 msgr2=0x7f72d4153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 0x7f72d4153860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72d40c43c0 tx=0x7f72cc00fd40 comp rx=0 tx=0).stop 2024-05-09T02:22:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 shutdown_connections 2024-05-09T02:22:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f72b4076300 0x7f72b4078810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72d413ebe0 0x7f72d4153860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72d413e7d0 0x7f72d41ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 --2- 172.21.15.46:0/2673757486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c0004000 0x7f72d41f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 >> 172.21.15.46:0/2673757486 conn(0x7f72d4068e00 msgr2=0x7f72d4154520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 shutdown_connections 2024-05-09T02:22:39.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:39.803+0000 7f72d97d6640 1 -- 172.21.15.46:0/2673757486 wait complete. 2024-05-09T02:22:39.818 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T02:22:41.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:41.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:42.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.015+0000 7f0227f5f640 1 Processor -- start 2024-05-09T02:22:42.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.015+0000 7fb4a8a9f640 1 Processor -- start 2024-05-09T02:22:42.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.015+0000 7fb4a8a9f640 1 -- start start 2024-05-09T02:22:42.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.015+0000 7f0227f5f640 1 -- start start 2024-05-09T02:22:42.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7f0227f5f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0220155000 0x7f02200742d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7f0227f5f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f02200c4670 0x7f02200c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7fb4a8a9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a415bc50 0x7fb4a4154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7fb4a8a9f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb4a40c44f0 0x7fb4a40cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7fb4a8a9f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a41586b0 con 0x7fb4a40cb0b0 2024-05-09T02:22:42.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7fb4a8a9f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a4158990 con 0x7fb4a40c44f0 2024-05-09T02:22:42.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.016+0000 7fb4a8a9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a415b170 con 0x7fb4a415bc50 2024-05-09T02:22:42.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0227f5f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0220070a70 con 0x7f0220157d60 2024-05-09T02:22:42.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0227f5f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f0220071960 con 0x7f0220155000 2024-05-09T02:22:42.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0227f5f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0220070d50 con 0x7f02200c4670 2024-05-09T02:22:42.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb4a40c44f0 0x7fb4a40cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0220155000 0x7f02200742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0220155000 0x7f02200742d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45664/0 (socket says 172.21.15.46:45664) 2024-05-09T02:22:42.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 -- 172.21.15.46:0/888220120 learned_addr learned my addr 172.21.15.46:0/888220120 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:42.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb4a40c44f0 0x7fb4a40cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45676/0 (socket says 172.21.15.46:45676) 2024-05-09T02:22:42.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 -- 172.21.15.46:0/3886501547 learned_addr learned my addr 172.21.15.46:0/3886501547 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:42.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a259c640 1 --2- 172.21.15.46:0/3886501547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a415bc50 0x7fb4a4154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f02254fa640 1 --2- 172.21.15.46:0/888220120 >> v2:172.21.15.107:3300/0 conn(0x7f02200c4670 0x7f02200c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 -- 172.21.15.46:0/888220120 >> v2:172.21.15.107:3300/0 conn(0x7f02200c4670 msgr2=0x7f02200c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:42.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 --2- 172.21.15.46:0/888220120 >> v2:172.21.15.107:3300/0 conn(0x7f02200c4670 0x7f02200c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 -- 172.21.15.46:0/888220120 >> v1:172.21.15.46:6789/0 conn(0x7f0220157d60 legacy=0x7f0220158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 -- 172.21.15.46:0/3886501547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a415bc50 msgr2=0x7fb4a4154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:42.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 --2- 172.21.15.46:0/3886501547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a415bc50 0x7fb4a4154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 -- 172.21.15.46:0/3886501547 >> v1:172.21.15.46:6789/0 conn(0x7fb4a40cb0b0 legacy=0x7fb4a40c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7f0225cfb640 1 -- 172.21.15.46:0/888220120 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0220071030 con 0x7f0220155000 2024-05-09T02:22:42.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.017+0000 7fb4a1d9b640 1 -- 172.21.15.46:0/3886501547 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a415b450 con 0x7fb4a40c44f0 2024-05-09T02:22:42.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7fb4a1d9b640 1 --2- 172.21.15.46:0/3886501547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40cab70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb498009870 tx=0x7fb49802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241a9e0a0e917539 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7f0225cfb640 1 --2- 172.21.15.46:0/888220120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f02200742d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f022006edb0 tx=0x7f021c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a717f9541186c6de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7fb4a159a640 1 -- 172.21.15.46:0/3886501547 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498037070 con 0x7fb4a40c44f0 2024-05-09T02:22:42.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7fb4a159a640 1 -- 172.21.15.46:0/3886501547 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb498032440 con 0x7fb4a40c44f0 2024-05-09T02:22:42.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7fb4a159a640 1 -- 172.21.15.46:0/3886501547 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498032810 con 0x7fb4a40c44f0 2024-05-09T02:22:42.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7f0224cf9640 1 -- 172.21.15.46:0/888220120 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c037070 con 0x7f0220155000 2024-05-09T02:22:42.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7f0224cf9640 1 -- 172.21.15.46:0/888220120 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c032440 con 0x7f0220155000 2024-05-09T02:22:42.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.018+0000 7f0224cf9640 1 -- 172.21.15.46:0/888220120 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c032810 con 0x7f0220155000 2024-05-09T02:22:42.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7f0227f5f640 1 -- 172.21.15.46:0/888220120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 msgr2=0x7f02200742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7f0227f5f640 1 --2- 172.21.15.46:0/888220120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f02200742d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f022006edb0 tx=0x7f021c02a160 comp rx=0 tx=0).stop 2024-05-09T02:22:42.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/3886501547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a40c44f0 msgr2=0x7fb4a40cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/3886501547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40cab70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb498009870 tx=0x7fb49802a250 comp rx=0 tx=0).stop 2024-05-09T02:22:42.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7f0227f5f640 1 -- 172.21.15.46:0/888220120 shutdown_connections 2024-05-09T02:22:42.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7f0227f5f640 1 --2- 172.21.15.46:0/888220120 >> v2:172.21.15.107:3300/0 conn(0x7f02200c4670 0x7f02200c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7f0227f5f640 1 --2- 172.21.15.46:0/888220120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f02200742d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.019+0000 7f0227f5f640 1 -- 172.21.15.46:0/888220120 >> 172.21.15.46:0/888220120 conn(0x7f02200c6770 msgr2=0x7f02200c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:42.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/3886501547 shutdown_connections 2024-05-09T02:22:42.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/3886501547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40cab70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/3886501547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a415bc50 0x7fb4a4154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/3886501547 >> 172.21.15.46:0/3886501547 conn(0x7fb4a40aca30 msgr2=0x7fb4a40ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:42.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7f0227f5f640 1 -- 172.21.15.46:0/888220120 shutdown_connections 2024-05-09T02:22:42.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/3886501547 shutdown_connections 2024-05-09T02:22:42.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7f0227f5f640 1 -- 172.21.15.46:0/888220120 wait complete. 2024-05-09T02:22:42.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.020+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/3886501547 wait complete. 2024-05-09T02:22:42.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.021+0000 7f0227f5f640 1 Processor -- start 2024-05-09T02:22:42.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.021+0000 7f0227f5f640 1 -- start start 2024-05-09T02:22:42.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.021+0000 7fb4a8a9f640 1 Processor -- start 2024-05-09T02:22:42.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.022+0000 7fb4a8a9f640 1 -- start start 2024-05-09T02:22:42.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0227f5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02200c4670 0x7f022014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a8a9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a8a9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a40cb0b0 0x7fb4a41f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a8a9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 0x7fb4a4155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0227f5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f0220158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0227f5f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0220157d60 0x7f02201592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a8a9f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4158360 con 0x7fb4a415bc50 2024-05-09T02:22:42.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a8a9f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a40aa6f0 con 0x7fb4a40c44f0 2024-05-09T02:22:42.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a8a9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a40c6aa0 con 0x7fb4a40cb0b0 2024-05-09T02:22:42.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0227f5f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f022006d0f0 con 0x7f0220155000 2024-05-09T02:22:42.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0227f5f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f02200715f0 con 0x7f02200c4670 2024-05-09T02:22:42.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0227f5f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0220155410 con 0x7f0220157d60 2024-05-09T02:22:42.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f0220158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 0x7fb4a4155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 0x7fb4a4155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45684/0 (socket says 172.21.15.46:45684) 2024-05-09T02:22:42.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 -- 172.21.15.46:0/260316744 learned_addr learned my addr 172.21.15.46:0/260316744 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:42.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f0220158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45694/0 (socket says 172.21.15.46:45694) 2024-05-09T02:22:42.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 -- 172.21.15.46:0/1328500480 learned_addr learned my addr 172.21.15.46:0/1328500480 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:42.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a1d9b640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a40cb0b0 0x7fb4a41f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a259c640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f0225cfb640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02200c4670 0x7f022014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02264fc640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0220157d60 0x7f02201592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 -- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0220157d60 msgr2=0x7f02201592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0220157d60 0x7f02201592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 -- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02200c4670 msgr2=0x7f022014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02200c4670 0x7f022014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7f02254fa640 1 -- 172.21.15.46:0/1328500480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0220150600 con 0x7f0220155000 2024-05-09T02:22:42.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 -- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a40cb0b0 msgr2=0x7fb4a41f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a40cb0b0 0x7fb4a41f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 -- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4a40c44f0 msgr2=0x7fb4a40b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7f02254fa640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f0220158330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f021000e8a0 tx=0x7f021000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a2d9d640 1 -- 172.21.15.46:0/260316744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a41f1c00 con 0x7fb4a415bc50 2024-05-09T02:22:42.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.023+0000 7fb4a1d9b640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a40cb0b0 0x7fb4a41f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:22:42.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210017070 con 0x7f0220155000 2024-05-09T02:22:42.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7fb4a2d9d640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 0x7fb4a4155e80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00c730 tx=0x7fb49c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021000c940 con 0x7f0220155000 2024-05-09T02:22:42.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021000cd30 con 0x7f0220155000 2024-05-09T02:22:42.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022014f580 con 0x7f0220155000 2024-05-09T02:22:42.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022014fb40 con 0x7f0220155000 2024-05-09T02:22:42.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c003b70 con 0x7fb4a415bc50 2024-05-09T02:22:42.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c003d10 con 0x7fb4a415bc50 2024-05-09T02:22:42.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a41f1ee0 con 0x7fb4a415bc50 2024-05-09T02:22:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00aa70 con 0x7fb4a415bc50 2024-05-09T02:22:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.024+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a406da70 con 0x7fb4a415bc50 2024-05-09T02:22:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.025+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022006a330 con 0x7f0220155000 2024-05-09T02:22:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.026+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f021001a070 con 0x7f0220155000 2024-05-09T02:22:42.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.025+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a406a330 con 0x7fb4a415bc50 2024-05-09T02:22:42.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.026+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb49c00ac10 con 0x7fb4a415bc50 2024-05-09T02:22:42.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.027+0000 7f02167fc640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02040762d0 0x7f02040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.027+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f0210097990 con 0x7f0220155000 2024-05-09T02:22:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.027+0000 7f0225cfb640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02040762d0 0x7f02040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.027+0000 7fb492ffd640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb484076320 0x7fb484078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.027+0000 7fb4a259c640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb484076320 0x7fb484078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.027+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7fb49c097820 con 0x7fb4a415bc50 2024-05-09T02:22:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.028+0000 7f0225cfb640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02040762d0 0x7f02040787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f021c034000 tx=0x7f021c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.028+0000 7fb4a259c640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb484076320 0x7fb484078830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4069550 tx=0x7fb494009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.032+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0210060740 con 0x7f0220155000 2024-05-09T02:22:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.037+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb49c060650 con 0x7fb4a415bc50 2024-05-09T02:22:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.267+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4a4157640 con 0x7fb4a415bc50 2024-05-09T02:22:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.267+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02201517a0 con 0x7f0220155000 2024-05-09T02:22:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.267+0000 7fb492ffd640 1 -- 172.21.15.46:0/260316744 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5659 (secure 0 0 0) 0x7fb49c064950 con 0x7fb4a415bc50 2024-05-09T02:22:42.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:42.271 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:40.926762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:22:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 34 2024-05-09T02:22:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.268+0000 7f02167fc640 1 -- 172.21.15.46:0/1328500480 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5659 (secure 0 0 0) 0x7f0210064a40 con 0x7f0220155000 2024-05-09T02:22:42.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:42.272 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:40.926762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:22:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 34 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb484076320 msgr2=0x7fb484078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb484076320 0x7fb484078830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4069550 tx=0x7fb494009190 comp rx=0 tx=0).stop 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 msgr2=0x7fb4a4155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 0x7fb4a4155e80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00c730 tx=0x7fb49c00cbf0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 shutdown_connections 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb484076320 0x7fb484078830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a415bc50 0x7fb4a4155e80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4a40cb0b0 0x7fb4a41f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 --2- 172.21.15.46:0/260316744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4a40c44f0 0x7fb4a40b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 >> 172.21.15.46:0/260316744 conn(0x7fb4a40aca30 msgr2=0x7fb4a40aaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:42.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 shutdown_connections 2024-05-09T02:22:42.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7fb4a8a9f640 1 -- 172.21.15.46:0/260316744 wait complete. 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02040762d0 msgr2=0x7f02040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02040762d0 0x7f02040787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f021c034000 tx=0x7f021c02e000 comp rx=0 tx=0).stop 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 msgr2=0x7f0220158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f0220158330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f021000e8a0 tx=0x7f021000ed60 comp rx=0 tx=0).stop 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 shutdown_connections 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f02040762d0 0x7f02040787e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0220157d60 0x7f02201592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0220155000 0x7f0220158330 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 --2- 172.21.15.46:0/1328500480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02200c4670 0x7f022014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 >> 172.21.15.46:0/1328500480 conn(0x7f02200c6770 msgr2=0x7f02201528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 shutdown_connections 2024-05-09T02:22:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.270+0000 7f0227f5f640 1 -- 172.21.15.46:0/1328500480 wait complete. 2024-05-09T02:22:42.286 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T02:22:42.287 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-05-09T02:22:42.287 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-05-09T02:22:42.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.400+0000 7f4e30c61640 1 Processor -- start 2024-05-09T02:22:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.400+0000 7f4e30c61640 1 -- start start 2024-05-09T02:22:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e30c61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e30c61640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e2c1584a0 0x7f4e2c06e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e30c61640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2c06eab0 con 0x7f4e2c0c1e20 2024-05-09T02:22:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e30c61640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2c06f010 con 0x7f4e2c1584a0 2024-05-09T02:22:42.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e30c61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c1588b0 con 0x7f4e2c140d40 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e29d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e2c1584a0 0x7f4e2c06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e2ad9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e2c0c1e20 0x7f4e2c0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49560/0 (socket says 172.21.15.46:49560) 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e2ad9d640 1 -- 172.21.15.46:0/88498279 learned_addr learned my addr 172.21.15.46:0/88498279 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e2a59c640 1 --2- 172.21.15.46:0/88498279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e29d9b640 1 -- 172.21.15.46:0/88498279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 msgr2=0x7f4e2c0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e29d9b640 1 --2- 172.21.15.46:0/88498279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e29d9b640 1 -- 172.21.15.46:0/88498279 >> v1:172.21.15.46:6789/0 conn(0x7f4e2c0c1e20 legacy=0x7f4e2c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e2959a640 1 -- 172.21.15.46:0/88498279 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942374835 0 0) 0x7f4e1c001110 con 0x7f4e2c0c1e20 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.402+0000 7f4e29d9b640 1 -- 172.21.15.46:0/88498279 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c06ed30 con 0x7f4e2c1584a0 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.403+0000 7f4e29d9b640 1 --2- 172.21.15.46:0/88498279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c06e570 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097d0 tx=0x7f4e1402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9e199e76d2f721 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.403+0000 7f4e2959a640 1 -- 172.21.15.46:0/88498279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14037070 con 0x7f4e2c1584a0 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.403+0000 7f4e2959a640 1 -- 172.21.15.46:0/88498279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1402ae40 con 0x7f4e2c1584a0 2024-05-09T02:22:42.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.403+0000 7f4e2959a640 1 -- 172.21.15.46:0/88498279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14032660 con 0x7f4e2c1584a0 2024-05-09T02:22:42.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 -- 172.21.15.46:0/88498279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 msgr2=0x7f4e2c06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 --2- 172.21.15.46:0/88498279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c06e570 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097d0 tx=0x7f4e1402a130 comp rx=0 tx=0).stop 2024-05-09T02:22:42.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 -- 172.21.15.46:0/88498279 shutdown_connections 2024-05-09T02:22:42.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 --2- 172.21.15.46:0/88498279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c06e570 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 --2- 172.21.15.46:0/88498279 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 -- 172.21.15.46:0/88498279 >> 172.21.15.46:0/88498279 conn(0x7f4e2c068e00 msgr2=0x7f4e2c0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:42.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 -- 172.21.15.46:0/88498279 shutdown_connections 2024-05-09T02:22:42.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.404+0000 7f4e30c61640 1 -- 172.21.15.46:0/88498279 wait complete. 2024-05-09T02:22:42.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.406+0000 7f4e30c61640 1 Processor -- start 2024-05-09T02:22:42.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.406+0000 7f4e30c61640 1 -- start start 2024-05-09T02:22:42.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e30c61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e2c0c1e20 0x7f4e2c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e30c61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e30c61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e30c61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0c7ef0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e30c61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0c7c10 con 0x7f4e2c0c1e20 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e30c61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c0c92f0 con 0x7f4e2c140d40 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e2ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e2ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c1590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45720/0 (socket says 172.21.15.46:45720) 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e2ad9d640 1 -- 172.21.15.46:0/2279441626 learned_addr learned my addr 172.21.15.46:0/2279441626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e29d9b640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.407+0000 7f4e2a59c640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e2c0c1e20 0x7f4e2c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e2ad9d640 1 -- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 msgr2=0x7f4e2c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e2ad9d640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e2ad9d640 1 -- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e2c0c1e20 msgr2=0x7f4e2c15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e2ad9d640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e2c0c1e20 0x7f4e2c15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e2ad9d640 1 -- 172.21.15.46:0/2279441626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c159fc0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e2ad9d640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c1590a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00c3c0 tx=0x7f4e1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0074e0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1c0047e0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c15b6c0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c004bd0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.408+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c15bc80 con 0x7f4e2c1584a0 2024-05-09T02:22:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.409+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c06a330 con 0x7f4e2c1584a0 2024-05-09T02:22:42.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.410+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e1c011070 con 0x7f4e2c1584a0 2024-05-09T02:22:42.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.410+0000 7f4e22ffd640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4e0c0762d0 0x7f4e0c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:42.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.410+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f4e1c097530 con 0x7f4e2c1584a0 2024-05-09T02:22:42.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.411+0000 7f4e2a59c640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4e0c0762d0 0x7f4e0c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:42.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.411+0000 7f4e2a59c640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4e0c0762d0 0x7f4e0c0787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0b25f0 tx=0x7f4e24009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.415+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e2c06eab0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.644+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e2c0c89c0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.645+0000 7f4e22ffd640 1 -- 172.21.15.46:0/2279441626 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5659 (secure 0 0 0) 0x7f4e1c0602e0 con 0x7f4e2c1584a0 2024-05-09T02:22:42.648 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:42.648 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:40.926762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-09T02:22:42.649 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 34 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4e0c0762d0 msgr2=0x7f4e0c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4e0c0762d0 0x7f4e0c0787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0b25f0 tx=0x7f4e24009830 comp rx=0 tx=0).stop 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 msgr2=0x7f4e2c1590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c1590a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00c3c0 tx=0x7f4e1c00c880 comp rx=0 tx=0).stop 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 shutdown_connections 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4e0c0762d0 0x7f4e0c0787e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e2c1584a0 0x7f4e2c1590a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e2c140d40 0x7f4e2c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 --2- 172.21.15.46:0/2279441626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e2c0c1e20 0x7f4e2c15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 >> 172.21.15.46:0/2279441626 conn(0x7f4e2c068e00 msgr2=0x7f4e2c0c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 shutdown_connections 2024-05-09T02:22:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:42.647+0000 7f4e30c61640 1 -- 172.21.15.46:0/2279441626 wait complete. 2024-05-09T02:22:42.663 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 34, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:13.523096+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 29, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4232": { "addr": "172.21.15.107:6836/1968918469", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6834", "nonce": 1968918469, "type": "v2" }, { "addr": "172.21.15.107:6836", "nonce": 1968918469, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4232, "incarnation": 26, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 39 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T02:20:32.920436+0000", "qdb_cluster": [ 4232 ], "qdb_leader": 4232, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4232 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:22.572836+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 34, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5151": { "addr": "172.21.15.46:6835/236663003", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6834", "nonce": 236663003, "type": "v2" }, { "addr": "172.21.15.46:6835", "nonce": 236663003, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5151, "incarnation": 32, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:rejoin", "state_seq": 32 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T02:22:40.926762+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5151 } } } ], "standbys": [ { "addr": "172.21.15.107:6837/648578566", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6835", "nonce": 648578566, "type": "v2" }, { "addr": "172.21.15.107:6837", "nonce": 648578566, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 30, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5110, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T02:22:43.948 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.1... 2024-05-09T02:22:43.948 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-09T02:22:44.218 DEBUG:teuthology.parallel:result is None 2024-05-09T02:22:44.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T02:22:44.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.414+0000 7f717903b640 1 Processor -- start 2024-05-09T02:22:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.414+0000 7f717903b640 1 -- start start 2024-05-09T02:22:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.415+0000 7f717903b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7174140d40 0x7f71740c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.415+0000 7f717903b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71740c1e20 0x7f71740c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.415+0000 7f717903b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71741588b0 con 0x7f71741584a0 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.415+0000 7f717903b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f717406f010 con 0x7f71740c1e20 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.415+0000 7f717903b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f717406ed30 con 0x7f7174140d40 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.415+0000 7f717359e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71740c1e20 0x7f71740c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f717359e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f71740c1e20 0x7f71740c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45734/0 (socket says 172.21.15.46:45734) 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f717359e640 1 -- 172.21.15.46:0/91268334 learned_addr learned my addr 172.21.15.46:0/91268334 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f7172d9d640 1 --2- 172.21.15.46:0/91268334 >> v2:172.21.15.107:3300/0 conn(0x7f7174140d40 0x7f71740c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f717359e640 1 -- 172.21.15.46:0/91268334 >> v2:172.21.15.107:3300/0 conn(0x7f7174140d40 msgr2=0x7f71740c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f717359e640 1 --2- 172.21.15.46:0/91268334 >> v2:172.21.15.107:3300/0 conn(0x7f7174140d40 0x7f71740c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f717359e640 1 -- 172.21.15.46:0/91268334 >> v1:172.21.15.107:6789/0 conn(0x7f71741584a0 legacy=0x7f717406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.416+0000 7f717359e640 1 -- 172.21.15.46:0/91268334 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71740c7930 con 0x7f71740c1e20 2024-05-09T02:22:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.417+0000 7f717359e640 1 --2- 172.21.15.46:0/91268334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71740c1e20 0x7f71740c8be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f71740ca9e0 tx=0x7f716c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664620b8f305d1a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.417+0000 7f717259c640 1 -- 172.21.15.46:0/91268334 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c036070 con 0x7f71740c1e20 2024-05-09T02:22:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.417+0000 7f717259c640 1 -- 172.21.15.46:0/91268334 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c031600 con 0x7f71740c1e20 2024-05-09T02:22:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.417+0000 7f717259c640 1 -- 172.21.15.46:0/91268334 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c0319d0 con 0x7f71740c1e20 2024-05-09T02:22:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.417+0000 7f717903b640 1 -- 172.21.15.46:0/91268334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71740c1e20 msgr2=0x7f71740c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.417+0000 7f717903b640 1 --2- 172.21.15.46:0/91268334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71740c1e20 0x7f71740c8be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f71740ca9e0 tx=0x7f716c02a6a0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.418+0000 7f717903b640 1 -- 172.21.15.46:0/91268334 shutdown_connections 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.418+0000 7f717903b640 1 --2- 172.21.15.46:0/91268334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71740c1e20 0x7f71740c8be0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.418+0000 7f717903b640 1 --2- 172.21.15.46:0/91268334 >> v2:172.21.15.107:3300/0 conn(0x7f7174140d40 0x7f71740c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.418+0000 7f717903b640 1 -- 172.21.15.46:0/91268334 >> 172.21.15.46:0/91268334 conn(0x7f7174068e00 msgr2=0x7f71740c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.418+0000 7f717903b640 1 -- 172.21.15.46:0/91268334 shutdown_connections 2024-05-09T02:22:44.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.418+0000 7f717903b640 1 -- 172.21.15.46:0/91268334 wait complete. 2024-05-09T02:22:44.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.419+0000 7f717903b640 1 Processor -- start 2024-05-09T02:22:44.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.420+0000 7f717903b640 1 -- start start 2024-05-09T02:22:44.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717903b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71740c1e20 0x7f71740cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717903b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 0x7f71740cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717903b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71741584a0 0x7f717413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717903b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f71740c9120 con 0x7f7174140d40 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717903b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f71740c7ef0 con 0x7f71741584a0 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717903b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f71740c92a0 con 0x7f71740c1e20 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 0x7f71740cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 0x7f71740cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45750/0 (socket says 172.21.15.46:45750) 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 -- 172.21.15.46:0/349328133 learned_addr learned my addr 172.21.15.46:0/349328133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f7172d9d640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71740c1e20 0x7f71740cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f717359e640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71741584a0 0x7f717413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 -- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71740c1e20 msgr2=0x7f71740cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71740c1e20 0x7f71740cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 -- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71741584a0 msgr2=0x7f717413fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71741584a0 0x7f717413fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 -- 172.21.15.46:0/349328133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71740ccb30 con 0x7f7174140d40 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.421+0000 7f716bfff640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 0x7f71740cb830 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c3a0 tx=0x7f715c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.422+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c017070 con 0x7f7174140d40 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.422+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c0052d0 con 0x7f7174140d40 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.422+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71741edbf0 con 0x7f7174140d40 2024-05-09T02:22:44.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.422+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c003830 con 0x7f7174140d40 2024-05-09T02:22:44.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.422+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71740c6e50 con 0x7f7174140d40 2024-05-09T02:22:44.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.423+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717406a330 con 0x7f7174140d40 2024-05-09T02:22:44.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.424+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f715c01a070 con 0x7f7174140d40 2024-05-09T02:22:44.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.424+0000 7f716b7fe640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7154076300 0x7f7154078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.424+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f715c096e10 con 0x7f7174140d40 2024-05-09T02:22:44.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.424+0000 7f7172d9d640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7154076300 0x7f7154078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.425+0000 7f7172d9d640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7154076300 0x7f7154078810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71740b25f0 tx=0x7f7164009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:44.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.429+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f715c05fb40 con 0x7f7174140d40 2024-05-09T02:22:44.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.658+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71740c89c0 con 0x7f7174140d40 2024-05-09T02:22:44.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.658+0000 7f716b7fe640 1 -- 172.21.15.46:0/349328133 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5666 (secure 0 0 0) 0x7f715c068210 con 0x7f7174140d40 2024-05-09T02:22:44.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:44.662 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T02:22:44.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7154076300 msgr2=0x7f7154078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7154076300 0x7f7154078810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71740b25f0 tx=0x7f7164009190 comp rx=0 tx=0).stop 2024-05-09T02:22:44.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 msgr2=0x7f71740cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 0x7f71740cb830 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c3a0 tx=0x7f715c00c860 comp rx=0 tx=0).stop 2024-05-09T02:22:44.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 shutdown_connections 2024-05-09T02:22:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7154076300 0x7f7154078810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71741584a0 0x7f717413fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7174140d40 0x7f71740cb830 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 --2- 172.21.15.46:0/349328133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71740c1e20 0x7f71740cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 >> 172.21.15.46:0/349328133 conn(0x7f7174068e00 msgr2=0x7f717413cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.660+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 shutdown_connections 2024-05-09T02:22:44.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.661+0000 7f717903b640 1 -- 172.21.15.46:0/349328133 wait complete. 2024-05-09T02:22:44.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:44.676 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T02:22:44.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.781+0000 7f91ca7ea640 1 Processor -- start 2024-05-09T02:22:44.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.781+0000 7f91ca7ea640 1 -- start start 2024-05-09T02:22:44.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91ca7ea640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f91c40c96c0 0x7f91c40c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91ca7ea640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c4158ae0 con 0x7f91c415b3a0 2024-05-09T02:22:44.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91ca7ea640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c4155570 con 0x7f91c4155160 2024-05-09T02:22:44.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91ca7ea640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f91c4157ed0 con 0x7f91c40c96c0 2024-05-09T02:22:44.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91c37fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f91c40c96c0 0x7f91c40c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91c8d87640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f91c415b3a0 0x7f91c415b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49568/0 (socket says 172.21.15.46:49568) 2024-05-09T02:22:44.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.782+0000 7f91c8d87640 1 -- 172.21.15.46:0/69875753 learned_addr learned my addr 172.21.15.46:0/69875753 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:44.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.783+0000 7f91c2ffd640 1 -- 172.21.15.46:0/69875753 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692783166 0 0) 0x7f91c4155570 con 0x7f91c4155160 2024-05-09T02:22:44.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.783+0000 7f91c37fe640 1 -- 172.21.15.46:0/69875753 >> v1:172.21.15.107:6789/0 conn(0x7f91c4155160 legacy=0x7f91c40c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.783+0000 7f91c37fe640 1 -- 172.21.15.46:0/69875753 >> v1:172.21.15.46:6789/0 conn(0x7f91c415b3a0 legacy=0x7f91c415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.783+0000 7f91c37fe640 1 -- 172.21.15.46:0/69875753 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c41581b0 con 0x7f91c40c96c0 2024-05-09T02:22:44.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91c37fe640 1 --2- 172.21.15.46:0/69875753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c40c96c0 0x7f91c40c9ad0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f91b80097a0 tx=0x7f91b802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa27e866bb79b582 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:44.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91c2ffd640 1 -- 172.21.15.46:0/69875753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8037070 con 0x7f91c40c96c0 2024-05-09T02:22:44.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91c2ffd640 1 -- 172.21.15.46:0/69875753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b802ac90 con 0x7f91c40c96c0 2024-05-09T02:22:44.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91c2ffd640 1 -- 172.21.15.46:0/69875753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8032660 con 0x7f91c40c96c0 2024-05-09T02:22:44.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91ca7ea640 1 -- 172.21.15.46:0/69875753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c40c96c0 msgr2=0x7f91c40c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/69875753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c40c96c0 0x7f91c40c9ad0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f91b80097a0 tx=0x7f91b802a000 comp rx=0 tx=0).stop 2024-05-09T02:22:44.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91ca7ea640 1 -- 172.21.15.46:0/69875753 shutdown_connections 2024-05-09T02:22:44.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/69875753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c40c96c0 0x7f91c40c9ad0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91ca7ea640 1 -- 172.21.15.46:0/69875753 >> 172.21.15.46:0/69875753 conn(0x7f91c40aebe0 msgr2=0x7f91c40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:44.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.784+0000 7f91ca7ea640 1 -- 172.21.15.46:0/69875753 shutdown_connections 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.785+0000 7f91ca7ea640 1 -- 172.21.15.46:0/69875753 wait complete. 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.786+0000 7f91ca7ea640 1 Processor -- start 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.786+0000 7f91ca7ea640 1 -- start start 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.787+0000 7f91ca7ea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40c96c0 0x7f91c4150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.787+0000 7f91ca7ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 0x7f91c4157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.787+0000 7f91ca7ea640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91c415b3a0 0x7f91c414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.787+0000 7f91ca7ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f91c40c8670 con 0x7f91c4155160 2024-05-09T02:22:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.787+0000 7f91ca7ea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f91c4158770 con 0x7f91c40c96c0 2024-05-09T02:22:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.787+0000 7f91ca7ea640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f91c4157b30 con 0x7f91c415b3a0 2024-05-09T02:22:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 0x7f91c4157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 0x7f91c4157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45774/0 (socket says 172.21.15.46:45774) 2024-05-09T02:22:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 -- 172.21.15.46:0/2894754101 learned_addr learned my addr 172.21.15.46:0/2894754101 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:44.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c8d87640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91c415b3a0 0x7f91c414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c3fff640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40c96c0 0x7f91c4150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 -- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91c415b3a0 msgr2=0x7f91c414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91c415b3a0 0x7f91c414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 -- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40c96c0 msgr2=0x7f91c4150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40c96c0 0x7f91c4150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:44.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 -- 172.21.15.46:0/2894754101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c4155a40 con 0x7f91c4155160 2024-05-09T02:22:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c3fff640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40c96c0 0x7f91c4150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:22:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c37fe640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 0x7f91c4157380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8037040 con 0x7f91c4155160 2024-05-09T02:22:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b8004030 con 0x7f91c4155160 2024-05-09T02:22:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c41f57d0 con 0x7f91c4155160 2024-05-09T02:22:44.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8006e10 con 0x7f91c4155160 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.788+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41f5d90 con 0x7f91c4155160 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.789+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c414f500 con 0x7f91c4155160 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.790+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91b803a070 con 0x7f91c4155160 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.791+0000 7f91c0ff9640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f91b00762d0 0x7f91b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.791+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f91b80b8600 con 0x7f91c4155160 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.791+0000 7f91c3fff640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f91b00762d0 0x7f91b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:44.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.791+0000 7f91c3fff640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f91b00762d0 0x7f91b00787e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f91b4000f60 tx=0x7f91b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:44.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:44.795+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91b8041020 con 0x7f91c4155160 2024-05-09T02:22:45.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.116+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91c406a330 con 0x7f91c4155160 2024-05-09T02:22:45.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.118+0000 7f91c0ff9640 1 -- 172.21.15.46:0/2894754101 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5666 (secure 0 0 0) 0x7f91b80813a0 con 0x7f91c4155160 2024-05-09T02:22:45.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:45.122 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:45.123 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T02:22:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.121+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f91b00762d0 msgr2=0x7f91b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.121+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f91b00762d0 0x7f91b00787e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f91b4000f60 tx=0x7f91b4009040 comp rx=0 tx=0).stop 2024-05-09T02:22:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.121+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 msgr2=0x7f91c4157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.121+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 0x7f91c4157380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b80046c0 comp rx=0 tx=0).stop 2024-05-09T02:22:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 shutdown_connections 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f91b00762d0 0x7f91b00787e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91c415b3a0 0x7f91c414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91c4155160 0x7f91c4157380 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 --2- 172.21.15.46:0/2894754101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40c96c0 0x7f91c4150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 >> 172.21.15.46:0/2894754101 conn(0x7f91c40aebe0 msgr2=0x7f91c40c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 shutdown_connections 2024-05-09T02:22:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:45.122+0000 7f91ca7ea640 1 -- 172.21.15.46:0/2894754101 wait complete. 2024-05-09T02:22:45.143 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=4969 2024-05-09T02:22:45.144 INFO:tasks.mds_thrash.fs.[b]:waiting for 8 secs before reviving mds.c 2024-05-09T02:22:45.960 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-05-09T02:22:45.957+0000 7f6e2e339640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:22:46.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.794+0000 7f82fde61640 1 Processor -- start 2024-05-09T02:22:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.794+0000 7f82fde61640 1 -- start start 2024-05-09T02:22:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.795+0000 7f82fde61640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82f80c58d0 0x7f82f8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.795+0000 7f82fde61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f806d6d0 0x7f82f806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.795+0000 7f82fde61640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f80aaa00 con 0x7f82f8154c90 2024-05-09T02:22:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.795+0000 7f82fde61640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f82f8154790 con 0x7f82f80c58d0 2024-05-09T02:22:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.795+0000 7f82fde61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f82f8158aa0 con 0x7f82f806d6d0 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82f80c58d0 0x7f82f8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82f80c58d0 0x7f82f8151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39120/0 (socket says 172.21.15.46:39120) 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 -- 172.21.15.46:0/3039958538 learned_addr learned my addr 172.21.15.46:0/3039958538 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f6ffd640 1 --2- 172.21.15.46:0/3039958538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f806d6d0 0x7f82f806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 -- 172.21.15.46:0/3039958538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f806d6d0 msgr2=0x7f82f806dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 --2- 172.21.15.46:0/3039958538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f806d6d0 0x7f82f806dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 -- 172.21.15.46:0/3039958538 >> v1:172.21.15.107:6789/0 conn(0x7f82f8154c90 legacy=0x7f82f81550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.796+0000 7f82f77fe640 1 -- 172.21.15.46:0/3039958538 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f8070eb0 con 0x7f82f80c58d0 2024-05-09T02:22:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.797+0000 7f82f77fe640 1 --2- 172.21.15.46:0/3039958538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f80c58d0 0x7f82f8151e60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cfb97691f6f984 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:46.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.797+0000 7f82f67fc640 1 -- 172.21.15.46:0/3039958538 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8037070 con 0x7f82f80c58d0 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.797+0000 7f82f67fc640 1 -- 172.21.15.46:0/3039958538 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e8032440 con 0x7f82f80c58d0 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.797+0000 7f82f67fc640 1 -- 172.21.15.46:0/3039958538 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8032810 con 0x7f82f80c58d0 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 -- 172.21.15.46:0/3039958538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f80c58d0 msgr2=0x7f82f8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 --2- 172.21.15.46:0/3039958538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f80c58d0 0x7f82f8151e60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e802a1c0 comp rx=0 tx=0).stop 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 -- 172.21.15.46:0/3039958538 shutdown_connections 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 --2- 172.21.15.46:0/3039958538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f806d6d0 0x7f82f806dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 --2- 172.21.15.46:0/3039958538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f80c58d0 0x7f82f8151e60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 -- 172.21.15.46:0/3039958538 >> 172.21.15.46:0/3039958538 conn(0x7f82f80733f0 msgr2=0x7f82f8073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 -- 172.21.15.46:0/3039958538 shutdown_connections 2024-05-09T02:22:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.798+0000 7f82fde61640 1 -- 172.21.15.46:0/3039958538 wait complete. 2024-05-09T02:22:46.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.799+0000 7f82fde61640 1 Processor -- start 2024-05-09T02:22:46.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.800+0000 7f82fde61640 1 -- start start 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82fde61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 0x7f82f80ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82fde61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82f80c58d0 0x7f82f8156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82fde61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f8154c90 0x7f82f80aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82fde61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f82f8158790 con 0x7f82f806d6d0 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82fde61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80c5450 con 0x7f82f80c58d0 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82fde61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80acb80 con 0x7f82f8154c90 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 0x7f82f80ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 0x7f82f80ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39124/0 (socket says 172.21.15.46:39124) 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 -- 172.21.15.46:0/3216432929 learned_addr learned my addr 172.21.15.46:0/3216432929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f6ffd640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82f80c58d0 0x7f82f8156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f7fff640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f8154c90 0x7f82f80aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 -- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f8154c90 msgr2=0x7f82f80aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f8154c90 0x7f82f80aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 -- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82f80c58d0 msgr2=0x7f82f8156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82f80c58d0 0x7f82f8156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 -- 172.21.15.46:0/3216432929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80c7290 con 0x7f82f806d6d0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.801+0000 7f82f77fe640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 0x7f82f80ae0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.802+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8041020 con 0x7f82f806d6d0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.802+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80306c0 con 0x7f82f806d6d0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.802+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8037040 con 0x7f82f806d6d0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.802+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f80c35f0 con 0x7f82f806d6d0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.802+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f81e1ba0 con 0x7f82f806d6d0 2024-05-09T02:22:46.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.803+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f806a330 con 0x7f82f806d6d0 2024-05-09T02:22:46.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.803+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82e8044020 con 0x7f82f806d6d0 2024-05-09T02:22:46.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.804+0000 7f82dffff640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f82e40762d0 0x7f82e40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.804+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f82e80b8220 con 0x7f82f806d6d0 2024-05-09T02:22:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.804+0000 7f82f6ffd640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f82e40762d0 0x7f82e40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.805+0000 7f82f6ffd640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f82e40762d0 0x7f82e40787e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f82f80c6020 tx=0x7f82ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:46.809+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82e804b030 con 0x7f82f806d6d0 2024-05-09T02:22:47.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.045+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82f80c56b0 con 0x7f82f806d6d0 2024-05-09T02:22:47.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.045+0000 7f82dffff640 1 -- 172.21.15.46:0/3216432929 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5666 (secure 0 0 0) 0x7f82e8081070 con 0x7f82f806d6d0 2024-05-09T02:22:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:47.049 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f82e40762d0 msgr2=0x7f82e40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f82e40762d0 0x7f82e40787e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f82f80c6020 tx=0x7f82ec008040 comp rx=0 tx=0).stop 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 msgr2=0x7f82f80ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 0x7f82f80ae0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e80046c0 comp rx=0 tx=0).stop 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 shutdown_connections 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f82e40762d0 0x7f82e40787e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82f8154c90 0x7f82f80aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82f80c58d0 0x7f82f8156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 --2- 172.21.15.46:0/3216432929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82f806d6d0 0x7f82f80ae0c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.047+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 >> 172.21.15.46:0/3216432929 conn(0x7f82f80733f0 msgr2=0x7f82f81529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.048+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 shutdown_connections 2024-05-09T02:22:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:47.048+0000 7f82fde61640 1 -- 172.21.15.46:0/3216432929 wait complete. 2024-05-09T02:22:47.063 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T02:22:48.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:22:48.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:22:49.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.193+0000 7f3ae9d00640 1 Processor -- start 2024-05-09T02:22:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.193+0000 7f3ae9d00640 1 -- start start 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.194+0000 7f3ae9d00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae40c8fb0 0x7f3ae415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.194+0000 7f3ae9d00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ae4154f50 0x7f3ae4158230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.194+0000 7f3ae9d00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae40c5bc0 con 0x7f3ae4158770 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.194+0000 7f3ae9d00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae40c5ea0 con 0x7f3ae4154f50 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.194+0000 7f3ae9d00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae40c6180 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.194+0000 7f3adbfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ae4154f50 0x7f3ae4158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3adbfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3ae4154f50 0x7f3ae4158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39138/0 (socket says 172.21.15.46:39138) 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3adbfff640 1 -- 172.21.15.46:0/3950047437 learned_addr learned my addr 172.21.15.46:0/3950047437 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3ae37fe640 1 --2- 172.21.15.46:0/3950047437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae40c8fb0 0x7f3ae415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3adbfff640 1 -- 172.21.15.46:0/3950047437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae40c8fb0 msgr2=0x7f3ae415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:49.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3adbfff640 1 --2- 172.21.15.46:0/3950047437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae40c8fb0 0x7f3ae415b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3adbfff640 1 -- 172.21.15.46:0/3950047437 >> v1:172.21.15.107:6789/0 conn(0x7f3ae4158770 legacy=0x7f3ae40c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:49.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.195+0000 7f3adbfff640 1 -- 172.21.15.46:0/3950047437 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae4157d10 con 0x7f3ae4154f50 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.196+0000 7f3adbfff640 1 --2- 172.21.15.46:0/3950047437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae4154f50 0x7f3ae4158230 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009870 tx=0x7f3acc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331194b4c22e5301 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.196+0000 7f3ae2ffd640 1 -- 172.21.15.46:0/3950047437 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc037070 con 0x7f3ae4154f50 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.196+0000 7f3ae2ffd640 1 -- 172.21.15.46:0/3950047437 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3acc032440 con 0x7f3ae4154f50 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.196+0000 7f3ae2ffd640 1 -- 172.21.15.46:0/3950047437 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc032810 con 0x7f3ae4154f50 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 -- 172.21.15.46:0/3950047437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae4154f50 msgr2=0x7f3ae4158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/3950047437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae4154f50 0x7f3ae4158230 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009870 tx=0x7f3acc02a1c0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 -- 172.21.15.46:0/3950047437 shutdown_connections 2024-05-09T02:22:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/3950047437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae4154f50 0x7f3ae4158230 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/3950047437 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae40c8fb0 0x7f3ae415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 -- 172.21.15.46:0/3950047437 >> 172.21.15.46:0/3950047437 conn(0x7f3ae4069040 msgr2=0x7f3ae40ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 -- 172.21.15.46:0/3950047437 shutdown_connections 2024-05-09T02:22:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.197+0000 7f3ae9d00640 1 -- 172.21.15.46:0/3950047437 wait complete. 2024-05-09T02:22:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.199+0000 7f3ae9d00640 1 Processor -- start 2024-05-09T02:22:49.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.199+0000 7f3ae9d00640 1 -- start start 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae9d00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 0x7f3ae40aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae9d00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ae4154f50 0x7f3ae415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae9d00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae4158770 0x7f3ae415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae9d00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41579c0 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae9d00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae4155360 con 0x7f3ae4154f50 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae9d00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae40c7d60 con 0x7f3ae4158770 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 0x7f3ae40aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 0x7f3ae40aa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39140/0 (socket says 172.21.15.46:39140) 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 -- 172.21.15.46:0/18020982 learned_addr learned my addr 172.21.15.46:0/18020982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3adbfff640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ae4154f50 0x7f3ae415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae3fff640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae4158770 0x7f3ae415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 -- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae4158770 msgr2=0x7f3ae415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae4158770 0x7f3ae415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 -- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ae4154f50 msgr2=0x7f3ae415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ae4154f50 0x7f3ae415a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3ae37fe640 1 -- 172.21.15.46:0/18020982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae41ee210 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.200+0000 7f3adbfff640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ae4154f50 0x7f3ae415a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.201+0000 7f3ae37fe640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 0x7f3ae40aa840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400d620 tx=0x7f3ad400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.201+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400b620 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.201+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad4019070 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.201+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae4151db0 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.201+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400ba00 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.201+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae40aaf20 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.202+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae406a330 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.203+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ad400bba0 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.203+0000 7f3ae0ff9640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ac40762d0 0x7f3ac40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.203+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f3ad4098a20 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.204+0000 7f3adbfff640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ac40762d0 0x7f3ac40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:49.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.204+0000 7f3adbfff640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ac40762d0 0x7f3ac40787e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3acc034000 tx=0x7f3acc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:49.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.212+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ad4061ec0 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.443+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ae40cb6e0 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.444+0000 7f3ae0ff9640 1 -- 172.21.15.46:0/18020982 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5666 (secure 0 0 0) 0x7f3ad40617c0 con 0x7f3ae40c8fb0 2024-05-09T02:22:49.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:49.447 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T02:22:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ac40762d0 msgr2=0x7f3ac40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ac40762d0 0x7f3ac40787e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3acc034000 tx=0x7f3acc02e000 comp rx=0 tx=0).stop 2024-05-09T02:22:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 msgr2=0x7f3ae40aa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 0x7f3ae40aa840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400d620 tx=0x7f3ad400dae0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 shutdown_connections 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3ac40762d0 0x7f3ac40787e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ae4158770 0x7f3ae415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ae4154f50 0x7f3ae415a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 --2- 172.21.15.46:0/18020982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae40c8fb0 0x7f3ae40aa840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 >> 172.21.15.46:0/18020982 conn(0x7f3ae4069040 msgr2=0x7f3ae415b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 shutdown_connections 2024-05-09T02:22:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:49.446+0000 7f3ae9d00640 1 -- 172.21.15.46:0/18020982 wait complete. 2024-05-09T02:22:49.462 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T02:22:51.463 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.590+0000 7f4f2683b640 1 Processor -- start 2024-05-09T02:22:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.590+0000 7f4f2683b640 1 -- start start 2024-05-09T02:22:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.591+0000 7f4f2683b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f200c51a0 0x7f4f20153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.591+0000 7f4f2683b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f200aa900 con 0x7f4f200c2ee0 2024-05-09T02:22:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.591+0000 7f4f2683b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f200aa620 con 0x7f4f200c42e0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.591+0000 7f4f2683b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4f20153560 con 0x7f4f200c51a0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.591+0000 7f4f24dd8640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4f200c2ee0 0x7f4f20155880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41226/0 (socket says 172.21.15.46:41226) 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.591+0000 7f4f24dd8640 1 -- 172.21.15.46:0/3918377533 learned_addr learned my addr 172.21.15.46:0/3918377533 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1ffff640 1 --2- 172.21.15.46:0/3918377533 >> v2:172.21.15.107:3300/0 conn(0x7f4f200c51a0 0x7f4f20153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248919757 0 0) 0x7f4f200aa900 con 0x7f4f200c2ee0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f08003520 con 0x7f4f200c2ee0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259173205 0 0) 0x7f4f200aa620 con 0x7f4f200c42e0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f200aa900 con 0x7f4f200c42e0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3151131090 0 0) 0x7f4f08003520 con 0x7f4f200c2ee0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 >> v2:172.21.15.107:3300/0 conn(0x7f4f200c51a0 msgr2=0x7f4f20153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 --2- 172.21.15.46:0/3918377533 >> v2:172.21.15.107:3300/0 conn(0x7f4f200c51a0 0x7f4f20153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 >> v1:172.21.15.107:6789/0 conn(0x7f4f200c42e0 legacy=0x7f4f2006f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f200c3800 con 0x7f4f200c2ee0 2024-05-09T02:22:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f4f18001a70 con 0x7f4f200c2ee0 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 >> v1:172.21.15.46:6789/0 conn(0x7f4f200c2ee0 legacy=0x7f4f20155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f08003c30 0x7f4f08004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f08004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f08005320 0x7f4f0800b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0800c290 con 0x7f4f08004800 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0800c440 con 0x7f4f08005320 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0800c640 con 0x7f4f08003c30 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f08004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f1ffff640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f08003c30 0x7f4f08004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.592+0000 7f4f24dd8640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f08005320 0x7f4f0800b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f1f7fe640 1 -- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f08003c30 msgr2=0x7f4f08004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f08003c30 0x7f4f08004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f1f7fe640 1 -- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f08005320 msgr2=0x7f4f0800b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f08005320 0x7f4f0800b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f24dd8640 1 -- 172.21.15.46:0/3918377533 reap_dead start 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f1f7fe640 1 -- 172.21.15.46:0/3918377533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f08003520 con 0x7f4f08004800 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.593+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f08004c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4f14001900 tx=0x7f4f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e62c668b4162ab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14001520 con 0x7f4f08004800 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1402acb0 con 0x7f4f08004800 2024-05-09T02:22:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f1effd640 1 -- 172.21.15.46:0/3918377533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14005310 con 0x7f4f08004800 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f2683b640 1 -- 172.21.15.46:0/3918377533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 msgr2=0x7f4f08004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f2683b640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f08004c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4f14001900 tx=0x7f4f08005830 comp rx=0 tx=0).stop 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f2683b640 1 -- 172.21.15.46:0/3918377533 shutdown_connections 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f2683b640 1 --2- 172.21.15.46:0/3918377533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f08004c10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.594+0000 7f4f2683b640 1 -- 172.21.15.46:0/3918377533 >> 172.21.15.46:0/3918377533 conn(0x7f4f200c5940 msgr2=0x7f4f200c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.595+0000 7f4f2683b640 1 -- 172.21.15.46:0/3918377533 shutdown_connections 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.595+0000 7f4f2683b640 1 -- 172.21.15.46:0/3918377533 wait complete. 2024-05-09T02:22:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.596+0000 7f4f2683b640 1 Processor -- start 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.596+0000 7f4f2683b640 1 -- start start 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f2683b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f200c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f2683b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f200bfff0 0x7f4f200c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f2683b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f201e04a0 0x7f4f201e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f2683b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200aa2b0 con 0x7f4f08004800 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f2683b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200c3e50 con 0x7f4f200bfff0 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f2683b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f20153020 con 0x7f4f201e04a0 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f200c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f200c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39164/0 (socket says 172.21.15.46:39164) 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 -- 172.21.15.46:0/2608246217 learned_addr learned my addr 172.21.15.46:0/2608246217 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f24dd8640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f201e04a0 0x7f4f201e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f200bfff0 0x7f4f200c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 -- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f201e04a0 msgr2=0x7f4f201e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f201e04a0 0x7f4f201e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 -- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f200bfff0 msgr2=0x7f4f200c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f200bfff0 0x7f4f200c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 -- 172.21.15.46:0/2608246217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f200c2b80 con 0x7f4f08004800 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f24dd8640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f201e04a0 0x7f4f201e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f200bfff0 0x7f4f200c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1ffff640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f200c1f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4f10011960 tx=0x7f4f10011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.598+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000fa90 con 0x7f4f08004800 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.599+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1000fc30 con 0x7f4f08004800 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.599+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10014440 con 0x7f4f08004800 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.599+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f200c28a0 con 0x7f4f08004800 2024-05-09T02:22:51.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.599+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f201ec940 con 0x7f4f08004800 2024-05-09T02:22:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.600+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2006a330 con 0x7f4f08004800 2024-05-09T02:22:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.600+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f10012040 con 0x7f4f08004800 2024-05-09T02:22:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.601+0000 7f4f1cff9640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4f0c0762d0 0x7f4f0c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.601+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f4f10098070 con 0x7f4f08004800 2024-05-09T02:22:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.601+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4f0c0762d0 0x7f4f0c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.602+0000 7f4f1f7fe640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4f0c0762d0 0x7f4f0c0787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f14031000 tx=0x7f4f1402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.606+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f200c2b80 con 0x7f4f08004800 2024-05-09T02:22:51.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.834+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f200c8440 con 0x7f4f08004800 2024-05-09T02:22:51.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.835+0000 7f4f1cff9640 1 -- 172.21.15.46:0/2608246217 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5666 (secure 0 0 0) 0x7f4f10019030 con 0x7f4f08004800 2024-05-09T02:22:51.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:51.838 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:51.838 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4f0c0762d0 msgr2=0x7f4f0c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4f0c0762d0 0x7f4f0c0787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f14031000 tx=0x7f4f1402e000 comp rx=0 tx=0).stop 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 msgr2=0x7f4f200c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f200c1f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4f10011960 tx=0x7f4f10011e20 comp rx=0 tx=0).stop 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 shutdown_connections 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4f0c0762d0 0x7f4f0c0787e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f201e04a0 0x7f4f201e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f200bfff0 0x7f4f200c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 --2- 172.21.15.46:0/2608246217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f08004800 0x7f4f200c1f40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 >> 172.21.15.46:0/2608246217 conn(0x7f4f200c5940 msgr2=0x7f4f20152340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 shutdown_connections 2024-05-09T02:22:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:51.837+0000 7f4f2683b640 1 -- 172.21.15.46:0/2608246217 wait complete. 2024-05-09T02:22:51.852 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-09T02:22:53.144 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-05-09T02:22:53.145 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T02:22:53.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T02:22:53.149 INFO:tasks.ceph.mds.c:Started 2024-05-09T02:22:53.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:53.252 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-05-09T02:22:53.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.277+0000 7f05ac714640 1 Processor -- start 2024-05-09T02:22:53.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.278+0000 7f05ac714640 1 -- start start 2024-05-09T02:22:53.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05ac714640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a40c3f60 0x7f05a40c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05ac714640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05a4073ae0 0x7f05a4073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05ac714640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a40c9490 con 0x7f05a4152ee0 2024-05-09T02:22:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05ac714640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f05a4156790 con 0x7f05a4073ae0 2024-05-09T02:22:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05ac714640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05a4155bf0 con 0x7f05a40c3f60 2024-05-09T02:22:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05aacb1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05a4073ae0 0x7f05a4073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05aacb1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05a4073ae0 0x7f05a4073ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39198/0 (socket says 172.21.15.46:39198) 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05aacb1640 1 -- 172.21.15.46:0/3192086907 learned_addr learned my addr 172.21.15.46:0/3192086907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.279+0000 7f05a9caf640 1 --2- 172.21.15.46:0/3192086907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a40c3f60 0x7f05a40c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05aacb1640 1 -- 172.21.15.46:0/3192086907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a40c3f60 msgr2=0x7f05a40c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05aacb1640 1 --2- 172.21.15.46:0/3192086907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a40c3f60 0x7f05a40c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05aacb1640 1 -- 172.21.15.46:0/3192086907 >> v1:172.21.15.107:6789/0 conn(0x7f05a4152ee0 legacy=0x7f05a4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05a94ae640 1 -- 172.21.15.46:0/3192086907 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108556369 0 0) 0x7f05a40c9490 con 0x7f05a4152ee0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05aacb1640 1 -- 172.21.15.46:0/3192086907 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a40c9770 con 0x7f05a4073ae0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05aacb1640 1 --2- 172.21.15.46:0/3192086907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a4073ef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f059c009e50 tx=0x7f059c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbf01b00b144126 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.280+0000 7f05a94ae640 1 -- 172.21.15.46:0/3192086907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c036070 con 0x7f05a4073ae0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05a94ae640 1 -- 172.21.15.46:0/3192086907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c031600 con 0x7f05a4073ae0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05a94ae640 1 -- 172.21.15.46:0/3192086907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c0319d0 con 0x7f05a4073ae0 2024-05-09T02:22:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 -- 172.21.15.46:0/3192086907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 msgr2=0x7f05a4073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 --2- 172.21.15.46:0/3192086907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a4073ef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f059c009e50 tx=0x7f059c02a680 comp rx=0 tx=0).stop 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 -- 172.21.15.46:0/3192086907 shutdown_connections 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 --2- 172.21.15.46:0/3192086907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a4073ef0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 --2- 172.21.15.46:0/3192086907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a40c3f60 0x7f05a40c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 -- 172.21.15.46:0/3192086907 >> 172.21.15.46:0/3192086907 conn(0x7f05a40aba90 msgr2=0x7f05a40abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 -- 172.21.15.46:0/3192086907 shutdown_connections 2024-05-09T02:22:53.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.281+0000 7f05ac714640 1 -- 172.21.15.46:0/3192086907 wait complete. 2024-05-09T02:22:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.283+0000 7f05ac714640 1 Processor -- start 2024-05-09T02:22:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.283+0000 7f05ac714640 1 -- start start 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05ac714640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05ac714640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a40c3f60 0x7f05a4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05ac714640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a4152ee0 0x7f05a41ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05ac714640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4071ab0 con 0x7f05a4073ae0 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05ac714640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05a40c9a50 con 0x7f05a40c3f60 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05ac714640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05a41ecbc0 con 0x7f05a4152ee0 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05aa4b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.284+0000 7f05aa4b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a414a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39206/0 (socket says 172.21.15.46:39206) 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 -- 172.21.15.46:0/2705416136 learned_addr learned my addr 172.21.15.46:0/2705416136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aacb1640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a4152ee0 0x7f05a41ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05a9caf640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a40c3f60 0x7f05a4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 -- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a4152ee0 msgr2=0x7f05a41ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a4152ee0 0x7f05a41ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 -- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a40c3f60 msgr2=0x7f05a4154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a40c3f60 0x7f05a4154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 -- 172.21.15.46:0/2705416136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a41ebfb0 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05aa4b0640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a414a570 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c390 tx=0x7f05a000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0017070 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a00035f0 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a41ec290 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a00039c0 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.285+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a41ec900 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.286+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a406a330 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.287+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05a001a070 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.288+0000 7f059affd640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0588076300 0x7f0588078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.288+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f05a0096e50 con 0x7f05a4073ae0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.288+0000 7f05a9caf640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0588076300 0x7f0588078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.288+0000 7f05a9caf640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0588076300 0x7f0588078810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05a414e5c0 tx=0x7f0594009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.292+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05a005fb80 con 0x7f05a4073ae0 2024-05-09T02:22:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.523+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05a4071c30 con 0x7f05a4073ae0 2024-05-09T02:22:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.523+0000 7f059affd640 1 -- 172.21.15.46:0/2705416136 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5666 (secure 0 0 0) 0x7f05a0063e80 con 0x7f05a4073ae0 2024-05-09T02:22:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:53.527 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:20:32.920436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":39,"addr":"172.21.15.107:6836/1968918469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1968918469},{"type":"v1","addr":"172.21.15.107:6836","nonce":1968918469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4232,"qdb_cluster":[4232]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:53.527 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T02:22:53.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0588076300 msgr2=0x7f0588078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0588076300 0x7f0588078810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05a414e5c0 tx=0x7f0594009190 comp rx=0 tx=0).stop 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 msgr2=0x7f05a414a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a414a570 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c390 tx=0x7f05a000c850 comp rx=0 tx=0).stop 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 shutdown_connections 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0588076300 0x7f0588078810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05a4152ee0 0x7f05a41ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05a40c3f60 0x7f05a4154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 --2- 172.21.15.46:0/2705416136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05a4073ae0 0x7f05a414a570 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 >> 172.21.15.46:0/2705416136 conn(0x7f05a40aba90 msgr2=0x7f05a4150e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 shutdown_connections 2024-05-09T02:22:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.525+0000 7f05ac714640 1 -- 172.21.15.46:0/2705416136 wait complete. 2024-05-09T02:22:53.541 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-05-09T02:22:53.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.974+0000 7f516bcf9640 1 Processor -- start 2024-05-09T02:22:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.974+0000 7f516bcf9640 1 -- start start 2024-05-09T02:22:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516bcf9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5164152e50 0x7f51640c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516bcf9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51640c7060 0x7f51640c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516bcf9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51640743f0 con 0x7f51640c9370 2024-05-09T02:22:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516bcf9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f5164070da0 con 0x7f51640c7060 2024-05-09T02:22:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516bcf9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5164071790 con 0x7f5164152e50 2024-05-09T02:22:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169294640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51640c7060 0x7f51640c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516a296640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f51640c9370 0x7f516406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41242/0 (socket says 172.21.15.46:41242) 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169294640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51640c7060 0x7f51640c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39208/0 (socket says 172.21.15.46:39208) 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f516a296640 1 -- 172.21.15.46:0/290268161 learned_addr learned my addr 172.21.15.46:0/290268161 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169a95640 1 --2- 172.21.15.46:0/290268161 >> v2:172.21.15.107:3300/0 conn(0x7f5164152e50 0x7f51640c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169294640 1 -- 172.21.15.46:0/290268161 >> v2:172.21.15.107:3300/0 conn(0x7f5164152e50 msgr2=0x7f51640c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169294640 1 --2- 172.21.15.46:0/290268161 >> v2:172.21.15.107:3300/0 conn(0x7f5164152e50 0x7f51640c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169294640 1 -- 172.21.15.46:0/290268161 >> v1:172.21.15.46:6789/0 conn(0x7f51640c9370 legacy=0x7f516406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.976+0000 7f5169294640 1 -- 172.21.15.46:0/290268161 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5164071420 con 0x7f51640c7060 2024-05-09T02:22:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.977+0000 7f5169294640 1 --2- 172.21.15.46:0/290268161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c7060 0x7f51640c8e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f516406d760 tx=0x7f516002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990fa41c3f826e49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.978+0000 7f5168a93640 1 -- 172.21.15.46:0/290268161 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160037070 con 0x7f51640c7060 2024-05-09T02:22:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.978+0000 7f5168a93640 1 -- 172.21.15.46:0/290268161 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5160032440 con 0x7f51640c7060 2024-05-09T02:22:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.978+0000 7f5168a93640 1 -- 172.21.15.46:0/290268161 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160032810 con 0x7f51640c7060 2024-05-09T02:22:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 -- 172.21.15.46:0/290268161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c7060 msgr2=0x7f51640c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 --2- 172.21.15.46:0/290268161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c7060 0x7f51640c8e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f516406d760 tx=0x7f516002a1a0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 -- 172.21.15.46:0/290268161 shutdown_connections 2024-05-09T02:22:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 --2- 172.21.15.46:0/290268161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c7060 0x7f51640c8e30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 --2- 172.21.15.46:0/290268161 >> v2:172.21.15.107:3300/0 conn(0x7f5164152e50 0x7f51640c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 -- 172.21.15.46:0/290268161 >> 172.21.15.46:0/290268161 conn(0x7f516406dbc0 msgr2=0x7f516406dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 -- 172.21.15.46:0/290268161 shutdown_connections 2024-05-09T02:22:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.979+0000 7f516bcf9640 1 -- 172.21.15.46:0/290268161 wait complete. 2024-05-09T02:22:53.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.981+0000 7f516bcf9640 1 Processor -- start 2024-05-09T02:22:53.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.981+0000 7f516bcf9640 1 -- start start 2024-05-09T02:22:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f516bcf9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51640c7060 0x7f51641e4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f516bcf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 0x7f516414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f516bcf9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5164152e50 0x7f516414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f516bcf9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f51640afe40 con 0x7f51640c9370 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f516bcf9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f51640afcc0 con 0x7f51640c7060 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f516bcf9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5164073d60 con 0x7f5164152e50 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f5169294640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 0x7f516414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.982+0000 7f5169294640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 0x7f516414bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39224/0 (socket says 172.21.15.46:39224) 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169294640 1 -- 172.21.15.46:0/1057626227 learned_addr learned my addr 172.21.15.46:0/1057626227 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169a95640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51640c7060 0x7f51641e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f516a296640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5164152e50 0x7f516414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169294640 1 -- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5164152e50 msgr2=0x7f516414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169294640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5164152e50 0x7f516414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169294640 1 -- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51640c7060 msgr2=0x7f51641e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169294640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51640c7060 0x7f51641e4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169294640 1 -- 172.21.15.46:0/1057626227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51641f2470 con 0x7f51640c9370 2024-05-09T02:22:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.983+0000 7f5169a95640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51640c7060 0x7f51641e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:22:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.985+0000 7f5169294640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 0x7f516414bfb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f516002a790 tx=0x7f51600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.985+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160037050 con 0x7f51640c9370 2024-05-09T02:22:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.985+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5160038040 con 0x7f51640c9370 2024-05-09T02:22:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.985+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160030bd0 con 0x7f51640c9370 2024-05-09T02:22:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.985+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51641f27a0 con 0x7f51640c9370 2024-05-09T02:22:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.985+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51640c5020 con 0x7f51640c9370 2024-05-09T02:22:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.986+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51641e3ba0 con 0x7f51640c9370 2024-05-09T02:22:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.987+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f516003c440 con 0x7f51640c9370 2024-05-09T02:22:53.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.988+0000 7f515a7fc640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5148076300 0x7f5148078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:53.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.988+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f51600b8450 con 0x7f51640c9370 2024-05-09T02:22:53.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.989+0000 7f5169a95640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5148076300 0x7f5148078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:53.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.989+0000 7f5169a95640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5148076300 0x7f5148078810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51641568d0 tx=0x7f5154008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:53.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:53.996+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f516004c020 con 0x7f51640c9370 2024-05-09T02:22:54.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.230+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f516406a330 con 0x7f51640c9370 2024-05-09T02:22:54.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.231+0000 7f515a7fc640 1 -- 172.21.15.46:0/1057626227 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5655 (secure 0 0 0) 0x7f5160081890 con 0x7f51640c9370 2024-05-09T02:22:54.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:54.234 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:53.964928+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:54.235 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 38 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5148076300 msgr2=0x7f5148078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5148076300 0x7f5148078810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51641568d0 tx=0x7f5154008040 comp rx=0 tx=0).stop 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 msgr2=0x7f516414bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 0x7f516414bfb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f516002a790 tx=0x7f51600046c0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 shutdown_connections 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f5148076300 0x7f5148078810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5164152e50 0x7f516414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51640c9370 0x7f516414bfb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 --2- 172.21.15.46:0/1057626227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51640c7060 0x7f51641e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 >> 172.21.15.46:0/1057626227 conn(0x7f516406dbc0 msgr2=0x7f5164151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:54.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 shutdown_connections 2024-05-09T02:22:54.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.233+0000 7f516bcf9640 1 -- 172.21.15.46:0/1057626227 wait complete. 2024-05-09T02:22:54.247 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-05-09T02:22:54.248 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-05-09T02:22:54.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:54.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.360+0000 7faa0cd6c640 1 Processor -- start 2024-05-09T02:22:54.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.360+0000 7faa0cd6c640 1 -- start start 2024-05-09T02:22:54.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7faa0cd6c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa08154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7faa0cd6c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faa080c92f0 0x7faa080c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7faa0cd6c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa080c9c40 0x7faa080c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7faa0cd6c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7faa080c2690 con 0x7faa080c92f0 2024-05-09T02:22:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7faa0cd6c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa08158580 con 0x7faa080c9c40 2024-05-09T02:22:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7faa0cd6c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa08158860 con 0x7faa080c6d70 2024-05-09T02:22:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.361+0000 7fa9fffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faa080c92f0 0x7faa080c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faa080c92f0 0x7faa080c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39236/0 (socket says 172.21.15.46:39236) 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 -- 172.21.15.46:0/1329501300 learned_addr learned my addr 172.21.15.46:0/1329501300 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7faa0659c640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa08154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7faa06d9d640 1 --2- 172.21.15.46:0/1329501300 >> v2:172.21.15.107:3300/0 conn(0x7faa080c9c40 0x7faa080c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 -- 172.21.15.46:0/1329501300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 msgr2=0x7faa08154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa08154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 -- 172.21.15.46:0/1329501300 >> v2:172.21.15.107:3300/0 conn(0x7faa080c9c40 msgr2=0x7faa080c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 --2- 172.21.15.46:0/1329501300 >> v2:172.21.15.107:3300/0 conn(0x7faa080c9c40 0x7faa080c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7fa9fffff640 1 -- 172.21.15.46:0/1329501300 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa080c2040 con 0x7faa080c92f0 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7faa0659c640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa08154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.362+0000 7faa06d9d640 1 --2- 172.21.15.46:0/1329501300 >> v2:172.21.15.107:3300/0 conn(0x7faa080c9c40 0x7faa080c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:22:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7fa9fffff640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c92f0 0x7faa080c9700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faa0806d510 tx=0x7fa9f002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78d1831422d1c47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa05d9b640 1 -- 172.21.15.46:0/1329501300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0037070 con 0x7faa080c92f0 2024-05-09T02:22:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa05d9b640 1 -- 172.21.15.46:0/1329501300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f002ae00 con 0x7faa080c92f0 2024-05-09T02:22:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa05d9b640 1 -- 172.21.15.46:0/1329501300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0032660 con 0x7faa080c92f0 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1329501300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c92f0 msgr2=0x7faa080c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c92f0 0x7faa080c9700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faa0806d510 tx=0x7fa9f002a0b0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1329501300 shutdown_connections 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1329501300 >> v2:172.21.15.107:3300/0 conn(0x7faa080c9c40 0x7faa080c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c92f0 0x7faa080c9700 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.363+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1329501300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa08154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.364+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1329501300 >> 172.21.15.46:0/1329501300 conn(0x7faa0806e8f0 msgr2=0x7faa0806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.364+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1329501300 shutdown_connections 2024-05-09T02:22:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.364+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1329501300 wait complete. 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.365+0000 7faa0cd6c640 1 Processor -- start 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.365+0000 7faa0cd6c640 1 -- start start 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0cd6c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa081482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0cd6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080c92f0 0x7faa08155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0cd6c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 0x7faa081f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0cd6c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa080c7ed0 con 0x7faa080c9c40 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0cd6c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa080c7d50 con 0x7faa080c92f0 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0cd6c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa080c8050 con 0x7faa080c6d70 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 0x7faa081f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 0x7faa081f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39244/0 (socket says 172.21.15.46:39244) 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 -- 172.21.15.46:0/1886348703 learned_addr learned my addr 172.21.15.46:0/1886348703 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0659c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa081482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7fa9fffff640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080c92f0 0x7faa08155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 -- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 msgr2=0x7faa081482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa081482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 -- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080c92f0 msgr2=0x7faa08155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080c92f0 0x7faa08155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 -- 172.21.15.46:0/1886348703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa08154810 con 0x7faa080c9c40 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7fa9fffff640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080c92f0 0x7faa08155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:22:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa0659c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa081482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.367+0000 7faa06d9d640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 0x7faa081f0ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa0000cde0 tx=0x7faa0000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.368+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00003b90 con 0x7faa080c9c40 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.368+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa00003d50 con 0x7faa080c9c40 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.368+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa08153540 con 0x7faa080c9c40 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.368+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00004260 con 0x7faa080c9c40 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.368+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa081542f0 con 0x7faa080c9c40 2024-05-09T02:22:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.368+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa081577b0 con 0x7faa080c9c40 2024-05-09T02:22:54.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.369+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa00004400 con 0x7faa080c9c40 2024-05-09T02:22:54.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.370+0000 7fa9feffd640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa9e8076300 0x7fa9e8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:54.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.370+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7faa00098530 con 0x7faa080c9c40 2024-05-09T02:22:54.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.370+0000 7faa0659c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa9e8076300 0x7fa9e8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:54.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.371+0000 7faa0659c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa9e8076300 0x7fa9e8078810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa080c5520 tx=0x7fa9f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:54.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.374+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa00014030 con 0x7faa080c9c40 2024-05-09T02:22:54.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.603+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa0806a330 con 0x7faa080c9c40 2024-05-09T02:22:54.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.604+0000 7fa9feffd640 1 -- 172.21.15.46:0/1886348703 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5655 (secure 0 0 0) 0x7faa00061970 con 0x7faa080c9c40 2024-05-09T02:22:54.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:54.608 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:53.964928+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:54.608 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 38 2024-05-09T02:22:54.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa9e8076300 msgr2=0x7fa9e8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa9e8076300 0x7fa9e8078810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa080c5520 tx=0x7fa9f8008040 comp rx=0 tx=0).stop 2024-05-09T02:22:54.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 msgr2=0x7faa081f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 0x7faa081f0ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa0000cde0 tx=0x7faa0000a650 comp rx=0 tx=0).stop 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 shutdown_connections 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa9e8076300 0x7fa9e8078810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa080c9c40 0x7faa081f0ed0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa080c92f0 0x7faa08155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 --2- 172.21.15.46:0/1886348703 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa080c6d70 0x7faa081482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 >> 172.21.15.46:0/1886348703 conn(0x7faa0806e8f0 msgr2=0x7faa08157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 shutdown_connections 2024-05-09T02:22:54.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:54.606+0000 7faa0cd6c640 1 -- 172.21.15.46:0/1886348703 wait complete. 2024-05-09T02:22:54.621 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 38, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:13.523096+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 38, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5292": { "addr": "172.21.15.46:6833/3541939604", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6832", "nonce": 3541939604, "type": "v2" }, { "addr": "172.21.15.46:6833", "nonce": 3541939604, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5292, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T02:22:53.964928+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5292 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T02:18:22.572836+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 36, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5151": { "addr": "172.21.15.46:6835/236663003", "addrs": { "addrvec": [ { "addr": "172.21.15.46:6834", "nonce": 236663003, "type": "v2" }, { "addr": "172.21.15.46:6835", "nonce": 236663003, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5151, "incarnation": 32, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-05-09T02:22:43.934984+0000", "qdb_cluster": [ 5151 ], "qdb_leader": 5151, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5151 } } } ], "standbys": [ { "addr": "172.21.15.107:6837/648578566", "addrs": { "addrvec": [ { "addr": "172.21.15.107:6835", "nonce": 648578566, "type": "v2" }, { "addr": "172.21.15.107:6837", "nonce": 648578566, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 30, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5110, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-09T02:22:55.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:55.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.670+0000 7fbc03261640 1 Processor -- start 2024-05-09T02:22:55.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.670+0000 7fbc03261640 1 -- start start 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc03261640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc03261640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbbfc0c7650 0x7fbbfc0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc03261640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbfc0c97b0 con 0x7fbbfc158e00 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc03261640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fbbfc0c60e0 con 0x7fbbfc0c7650 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc03261640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbbfc0c5b40 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc017fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbbfc0c7650 0x7fbbfc0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc017fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbbfc0c7650 0x7fbbfc0c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39252/0 (socket says 172.21.15.46:39252) 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.671+0000 7fbc017fe640 1 -- 172.21.15.46:0/713725952 learned_addr learned my addr 172.21.15.46:0/713725952 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.672+0000 7fbbf3fff640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.672+0000 7fbc017fe640 1 -- 172.21.15.46:0/713725952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc0ca6c0 msgr2=0x7fbbfc1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.672+0000 7fbc017fe640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.672+0000 7fbc017fe640 1 -- 172.21.15.46:0/713725952 >> v1:172.21.15.107:6789/0 conn(0x7fbbfc158e00 legacy=0x7fbbfc155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.672+0000 7fbc017fe640 1 -- 172.21.15.46:0/713725952 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc0ad850 con 0x7fbbfc0c7650 2024-05-09T02:22:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.672+0000 7fbbf3fff640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:22:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.673+0000 7fbc017fe640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc0c7a60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009e50 tx=0x7fbbf402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7edc985d913f38 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.673+0000 7fbbf37fe640 1 -- 172.21.15.46:0/713725952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4036070 con 0x7fbbfc0c7650 2024-05-09T02:22:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.673+0000 7fbbf37fe640 1 -- 172.21.15.46:0/713725952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf4031600 con 0x7fbbfc0c7650 2024-05-09T02:22:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.673+0000 7fbbf37fe640 1 -- 172.21.15.46:0/713725952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40319d0 con 0x7fbbfc0c7650 2024-05-09T02:22:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.673+0000 7fbc03261640 1 -- 172.21.15.46:0/713725952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0c7650 msgr2=0x7fbbfc0c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.673+0000 7fbc03261640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc0c7a60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009e50 tx=0x7fbbf402a710 comp rx=0 tx=0).stop 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.674+0000 7fbc03261640 1 -- 172.21.15.46:0/713725952 shutdown_connections 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.674+0000 7fbc03261640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc0c7a60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.674+0000 7fbc03261640 1 --2- 172.21.15.46:0/713725952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.674+0000 7fbc03261640 1 -- 172.21.15.46:0/713725952 >> 172.21.15.46:0/713725952 conn(0x7fbbfc068cd0 msgr2=0x7fbbfc0ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.674+0000 7fbc03261640 1 -- 172.21.15.46:0/713725952 shutdown_connections 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.674+0000 7fbc03261640 1 -- 172.21.15.46:0/713725952 wait complete. 2024-05-09T02:22:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.675+0000 7fbc03261640 1 Processor -- start 2024-05-09T02:22:55.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.675+0000 7fbc03261640 1 -- start start 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc03261640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc1ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc03261640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc03261640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc158e00 0x7fbbfc1f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc03261640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc155a30 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc03261640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc0c5e00 con 0x7fbbfc0c7650 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc03261640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbbfc0c5690 con 0x7fbbfc158e00 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39258/0 (socket says 172.21.15.46:39258) 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 -- 172.21.15.46:0/829540486 learned_addr learned my addr 172.21.15.46:0/829540486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc017fe640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc158e00 0x7fbbfc1f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbc00ffd640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc1ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 -- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc158e00 msgr2=0x7fbbfc1f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc158e00 0x7fbbfc1f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 -- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbfc0c7650 msgr2=0x7fbbfc1ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc1ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.677+0000 7fbbf3fff640 1 -- 172.21.15.46:0/829540486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc1f1fc0 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.678+0000 7fbbf3fff640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1538e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00d830 tx=0x7fbbec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.678+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec004030 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.678+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0041d0 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.678+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc154210 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.678+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0096a0 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.678+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc06e410 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.679+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbfc0c5900 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.680+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbbec009a50 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.680+0000 7fbbf17fa640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbe8076300 0x7fbbe8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:55.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.680+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fbbec097e30 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.680+0000 7fbc00ffd640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbe8076300 0x7fbbe8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:55.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.681+0000 7fbc00ffd640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbe8076300 0x7fbbe8078810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0aa430 tx=0x7fbbf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.685+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbbfc0c5900 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.916+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbfc069e80 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.917+0000 7fbbf17fa640 1 -- 172.21.15.46:0/829540486 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5658 (secure 0 0 0) 0x7fbbec060c20 con 0x7fbbfc0ca6c0 2024-05-09T02:22:55.920 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:55.920 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:53.997753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:55.920 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 39 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbe8076300 msgr2=0x7fbbe8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbe8076300 0x7fbbe8078810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0aa430 tx=0x7fbbf8009040 comp rx=0 tx=0).stop 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 msgr2=0x7fbbfc1538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1538e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00d830 tx=0x7fbbec00dcf0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 shutdown_connections 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbbe8076300 0x7fbbe8078810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbbfc158e00 0x7fbbfc1f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbfc0ca6c0 0x7fbbfc1538e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 --2- 172.21.15.46:0/829540486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbfc0c7650 0x7fbbfc1ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 >> 172.21.15.46:0/829540486 conn(0x7fbbfc068cd0 msgr2=0x7fbbfc1551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 shutdown_connections 2024-05-09T02:22:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:55.919+0000 7fbc03261640 1 -- 172.21.15.46:0/829540486 wait complete. 2024-05-09T02:22:55.934 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-05-09T02:22:56.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:56.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.753+0000 7f5569315640 1 Processor -- start 2024-05-09T02:22:56.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.753+0000 7f5569315640 1 -- start start 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.754+0000 7f5569315640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5564140d40 0x7f55640c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.754+0000 7f5569315640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55641588b0 con 0x7f55640c1e20 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.754+0000 7f5569315640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556406ed30 con 0x7f55641584a0 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.754+0000 7f5569315640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f556406f010 con 0x7f5564140d40 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f5562ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5564140d40 0x7f55640c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f5562ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5564140d40 0x7f55640c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39172/0 (socket says 172.21.15.46:39172) 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f55637fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f55640c1e20 0x7f55640c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52084/0 (socket says 172.21.15.46:52084) 2024-05-09T02:22:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f5562ffd640 1 -- 172.21.15.46:0/920231689 learned_addr learned my addr 172.21.15.46:0/920231689 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f5562ffd640 1 -- 172.21.15.46:0/920231689 >> v1:172.21.15.107:6789/0 conn(0x7f55641584a0 legacy=0x7f556406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f5562ffd640 1 -- 172.21.15.46:0/920231689 >> v1:172.21.15.46:6789/0 conn(0x7f55640c1e20 legacy=0x7f55640c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f5562ffd640 1 -- 172.21.15.46:0/920231689 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640c7930 con 0x7f5564140d40 2024-05-09T02:22:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.755+0000 7f55627fc640 1 -- 172.21.15.46:0/920231689 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168584638 0 0) 0x7f55641588b0 con 0x7f55640c1e20 2024-05-09T02:22:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.756+0000 7f5562ffd640 1 --2- 172.21.15.46:0/920231689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5564140d40 0x7f55640c8410 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1bd046519f07cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:56.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.756+0000 7f55627fc640 1 -- 172.21.15.46:0/920231689 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554037070 con 0x7f5564140d40 2024-05-09T02:22:56.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.756+0000 7f55627fc640 1 -- 172.21.15.46:0/920231689 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554032440 con 0x7f5564140d40 2024-05-09T02:22:56.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.756+0000 7f55627fc640 1 -- 172.21.15.46:0/920231689 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554032810 con 0x7f5564140d40 2024-05-09T02:22:56.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 -- 172.21.15.46:0/920231689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5564140d40 msgr2=0x7f55640c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:56.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 --2- 172.21.15.46:0/920231689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5564140d40 0x7f55640c8410 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402a270 comp rx=0 tx=0).stop 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 -- 172.21.15.46:0/920231689 shutdown_connections 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 --2- 172.21.15.46:0/920231689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5564140d40 0x7f55640c8410 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 -- 172.21.15.46:0/920231689 >> 172.21.15.46:0/920231689 conn(0x7f5564068e00 msgr2=0x7f55640c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 -- 172.21.15.46:0/920231689 shutdown_connections 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.757+0000 7f5569315640 1 -- 172.21.15.46:0/920231689 wait complete. 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.758+0000 7f5569315640 1 Processor -- start 2024-05-09T02:22:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.759+0000 7f5569315640 1 -- start start 2024-05-09T02:22:56.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5569315640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55640c1e20 0x7f55641f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:56.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5569315640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5564140d40 0x7f556413a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5569315640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 0x7f5564153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5569315640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f55640c92f0 con 0x7f55641584a0 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5569315640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f55640c7ef0 con 0x7f5564140d40 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5569315640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55640c9470 con 0x7f55640c1e20 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 0x7f5564153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 0x7f5564153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39174/0 (socket says 172.21.15.46:39174) 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 -- 172.21.15.46:0/129872758 learned_addr learned my addr 172.21.15.46:0/129872758 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f555bfff640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5564140d40 0x7f556413a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f5562ffd640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55640c1e20 0x7f55641f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 -- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55640c1e20 msgr2=0x7f55641f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:56.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55640c1e20 0x7f55641f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 -- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5564140d40 msgr2=0x7f556413a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5564140d40 0x7f556413a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 -- 172.21.15.46:0/129872758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5564159400 con 0x7f55641584a0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.760+0000 7f55637fe640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 0x7f5564153b10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c6e0 tx=0x7f555c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.761+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c018070 con 0x7f55641584a0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.761+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c004d60 con 0x7f55641584a0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.761+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556415ad60 con 0x7f55641584a0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.761+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c00a880 con 0x7f55641584a0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.761+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55641f1450 con 0x7f55641584a0 2024-05-09T02:22:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.762+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556406a330 con 0x7f55641584a0 2024-05-09T02:22:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.763+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f555c01b070 con 0x7f55641584a0 2024-05-09T02:22:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.763+0000 7f555b7fe640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55440762d0 0x7f55440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.763+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f555c097040 con 0x7f55641584a0 2024-05-09T02:22:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.764+0000 7f5562ffd640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55440762d0 0x7f55440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.764+0000 7f5562ffd640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55440762d0 0x7f55440787e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5554034000 tx=0x7f555402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:56.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:56.768+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f555c05fda0 con 0x7f55641584a0 2024-05-09T02:22:56.996 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T02:22:56.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T02:22:57.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.008+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55640c89c0 con 0x7f55641584a0 2024-05-09T02:22:57.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.009+0000 7f555b7fe640 1 -- 172.21.15.46:0/129872758 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5662 (secure 0 0 0) 0x7f555c0640a0 con 0x7f55641584a0 2024-05-09T02:22:57.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:57.015 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:56.976941+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5292,"qdb_cluster":[5292]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 41 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55440762d0 msgr2=0x7f55440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55440762d0 0x7f55440787e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5554034000 tx=0x7f555402e000 comp rx=0 tx=0).stop 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 msgr2=0x7f5564153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 0x7f5564153b10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c6e0 tx=0x7f555c00cba0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 shutdown_connections 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55440762d0 0x7f55440787e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55641584a0 0x7f5564153b10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5564140d40 0x7f556413a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 --2- 172.21.15.46:0/129872758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55640c1e20 0x7f55641f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 >> 172.21.15.46:0/129872758 conn(0x7f5564068e00 msgr2=0x7f55640c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 shutdown_connections 2024-05-09T02:22:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.011+0000 7f5569315640 1 -- 172.21.15.46:0/129872758 wait complete. 2024-05-09T02:22:57.033 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=4232 2024-05-09T02:22:57.033 INFO:tasks.mds_thrash.fs.[a]:waiting for 2 secs before reviving mds.d 2024-05-09T02:22:57.034 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T02:22:57.034 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-05-09T02:22:57.094 INFO:tasks.mds_thrash:joining mds_thrasher 2024-05-09T02:22:57.094 ERROR:tasks.mds_thrash.fs.[b]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 121, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 329, in do_thrash self.sleep_unless_stopped(2) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-05-09T02:22:57.095 INFO:tasks.mds_thrash:done joining 2024-05-09T02:22:57.095 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-09T02:22:57.109 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-09T02:22:57.110 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:22:57.110 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:22:57.127 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:22:57.127 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:22:57.187 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T02:22:57.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.342+0000 7f0f6994d640 1 Processor -- start 2024-05-09T02:22:57.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.342+0000 7f0f6994d640 1 -- start start 2024-05-09T02:22:57.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f6994d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0f640c74e0 0x7f0f64151db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f6994d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f640c6350 0x7f0f64157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f6994d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f640a9320 con 0x7f0f64158220 2024-05-09T02:22:57.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f6994d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0f64071330 con 0x7f0f640c74e0 2024-05-09T02:22:57.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f6994d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640c94e0 con 0x7f0f640c6350 2024-05-09T02:22:57.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f62ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0f640c74e0 0x7f0f64151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f627fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f640c6350 0x7f0f64157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f637fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0f64158220 0x7f0f64073b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:32822/0 (socket says 172.21.15.46:32822) 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.343+0000 7f0f637fe640 1 -- 172.21.15.46:0/545381569 learned_addr learned my addr 172.21.15.46:0/545381569 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f61ffb640 1 -- 172.21.15.46:0/545381569 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133711214 0 0) 0x7f0f640a9320 con 0x7f0f64158220 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f61ffb640 1 -- 172.21.15.46:0/545381569 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f50003520 con 0x7f0f64158220 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f627fc640 1 -- 172.21.15.46:0/545381569 >> v2:172.21.15.107:3300/0 conn(0x7f0f640c74e0 msgr2=0x7f0f64151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f627fc640 1 --2- 172.21.15.46:0/545381569 >> v2:172.21.15.107:3300/0 conn(0x7f0f640c74e0 0x7f0f64151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f627fc640 1 -- 172.21.15.46:0/545381569 >> v1:172.21.15.107:6789/0 conn(0x7f0f64158220 legacy=0x7f0f64073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f627fc640 1 -- 172.21.15.46:0/545381569 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640c97c0 con 0x7f0f640c6350 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.344+0000 7f0f62ffd640 1 --2- 172.21.15.46:0/545381569 >> v2:172.21.15.107:3300/0 conn(0x7f0f640c74e0 0x7f0f64151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.345+0000 7f0f627fc640 1 --2- 172.21.15.46:0/545381569 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f640c6350 0x7f0f64157ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0097a0 tx=0x7f0f4c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd8c6699a341475 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.345+0000 7f0f61ffb640 1 -- 172.21.15.46:0/545381569 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c037070 con 0x7f0f640c6350 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.345+0000 7f0f61ffb640 1 -- 172.21.15.46:0/545381569 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c02ae50 con 0x7f0f640c6350 2024-05-09T02:22:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.345+0000 7f0f61ffb640 1 -- 172.21.15.46:0/545381569 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c032640 con 0x7f0f640c6350 2024-05-09T02:22:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 -- 172.21.15.46:0/545381569 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f640c6350 msgr2=0x7f0f64157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 --2- 172.21.15.46:0/545381569 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f640c6350 0x7f0f64157ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0097a0 tx=0x7f0f4c02a100 comp rx=0 tx=0).stop 2024-05-09T02:22:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 -- 172.21.15.46:0/545381569 shutdown_connections 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 --2- 172.21.15.46:0/545381569 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f640c6350 0x7f0f64157ce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 --2- 172.21.15.46:0/545381569 >> v2:172.21.15.107:3300/0 conn(0x7f0f640c74e0 0x7f0f64151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 -- 172.21.15.46:0/545381569 >> 172.21.15.46:0/545381569 conn(0x7f0f640ac130 msgr2=0x7f0f640c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 -- 172.21.15.46:0/545381569 shutdown_connections 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.346+0000 7f0f6994d640 1 -- 172.21.15.46:0/545381569 wait complete. 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.347+0000 7f0f6994d640 1 Processor -- start 2024-05-09T02:22:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.347+0000 7f0f6994d640 1 -- start start 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f6994d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f640c6350 0x7f0f6406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f6994d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 0x7f0f641ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f6994d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f64158220 0x7f0f6414a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f6994d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640c7dd0 con 0x7f0f640c74e0 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f6994d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640c7c50 con 0x7f0f640c6350 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f6994d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640717c0 con 0x7f0f64158220 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 0x7f0f641ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 0x7f0f641ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39184/0 (socket says 172.21.15.46:39184) 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 -- 172.21.15.46:0/3500067245 learned_addr learned my addr 172.21.15.46:0/3500067245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:57.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f637fe640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f64158220 0x7f0f6414a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f62ffd640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f640c6350 0x7f0f6406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 -- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f64158220 msgr2=0x7f0f6414a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f64158220 0x7f0f6414a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 -- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f640c6350 msgr2=0x7f0f6406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f640c6350 0x7f0f6406c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 -- 172.21.15.46:0/3500067245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6406d490 con 0x7f0f640c74e0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.349+0000 7f0f627fc640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 0x7f0f641ebbe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c035040 tx=0x7f0f4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.350+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c041020 con 0x7f0f640c74e0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.350+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0044c0 con 0x7f0f640c74e0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.350+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c037040 con 0x7f0f640c74e0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.350+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f641ec640 con 0x7f0f640c74e0 2024-05-09T02:22:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.350+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f641eb6e0 con 0x7f0f640c74e0 2024-05-09T02:22:57.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.350+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6406a330 con 0x7f0f640c74e0 2024-05-09T02:22:57.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.351+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f4c044020 con 0x7f0f640c74e0 2024-05-09T02:22:57.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.352+0000 7f0f5bfff640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0f44076300 0x7f0f44078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.352+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f0f4c0b7ec0 con 0x7f0f640c74e0 2024-05-09T02:22:57.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.352+0000 7f0f62ffd640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0f44076300 0x7f0f44078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.353+0000 7f0f62ffd640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0f44076300 0x7f0f44078810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f640732f0 tx=0x7f0f5400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:57.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.356+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f4c04b070 con 0x7f0f640c74e0 2024-05-09T02:22:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.560+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f64071110 con 0x7f0f640c74e0 2024-05-09T02:22:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.560+0000 7f0f5bfff640 1 -- 172.21.15.46:0/3500067245 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v33) ==== 81+0+730 (secure 0 0 0) 0x7f0f6406d490 con 0x7f0f640c74e0 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6834/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6835/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6834/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6836/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:22:57.564 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:22:57.565 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:listed 12 entries 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0f44076300 msgr2=0x7f0f44078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0f44076300 0x7f0f44078810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f640732f0 tx=0x7f0f5400b040 comp rx=0 tx=0).stop 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 msgr2=0x7f0f641ebbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 0x7f0f641ebbe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c035040 tx=0x7f0f4c0046c0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 shutdown_connections 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0f44076300 0x7f0f44078810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f64158220 0x7f0f6414a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f640c74e0 0x7f0f641ebbe0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 --2- 172.21.15.46:0/3500067245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f640c6350 0x7f0f6406c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 >> 172.21.15.46:0/3500067245 conn(0x7f0f640ac130 msgr2=0x7f0f6414e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 shutdown_connections 2024-05-09T02:22:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.562+0000 7f0f6994d640 1 -- 172.21.15.46:0/3500067245 wait complete. 2024-05-09T02:22:57.577 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:22:57.577 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:22:57.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T02:22:57.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.747+0000 7f4c48d00640 1 Processor -- start 2024-05-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.748+0000 7f4c48d00640 1 -- start start 2024-05-09T02:22:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c48d00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4c440722c0 0x7f4c440c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c48d00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c44158660 con 0x7f4c44155300 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c48d00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c44158940 con 0x7f4c440c3fb0 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c48d00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4c440c8b40 con 0x7f4c440722c0 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c3bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4c44155300 0x7f4c440c9ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52090/0 (socket says 172.21.15.46:52090) 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c3bfff640 1 -- 172.21.15.46:0/3986379091 learned_addr learned my addr 172.21.15.46:0/3986379091 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c4259c640 1 --2- 172.21.15.46:0/3986379091 >> v2:172.21.15.107:3300/0 conn(0x7f4c440722c0 0x7f4c440c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108011090 0 0) 0x7f4c44158660 con 0x7f4c44155300 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c30003520 con 0x7f4c44155300 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760972407 0 0) 0x7f4c44158940 con 0x7f4c440c3fb0 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.749+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c44158660 con 0x7f4c440c3fb0 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.750+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4149877514 0 0) 0x7f4c30003520 con 0x7f4c44155300 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.750+0000 7f4c4259c640 1 -- 172.21.15.46:0/3986379091 >> v1:172.21.15.107:6789/0 conn(0x7f4c440c3fb0 legacy=0x7f4c440c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.750+0000 7f4c4259c640 1 -- 172.21.15.46:0/3986379091 >> v1:172.21.15.46:6789/0 conn(0x7f4c44155300 legacy=0x7f4c440c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.750+0000 7f4c4259c640 1 -- 172.21.15.46:0/3986379091 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c440c8d90 con 0x7f4c440722c0 2024-05-09T02:22:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.750+0000 7f4c4259c640 1 --2- 172.21.15.46:0/3986379091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440722c0 0x7f4c440c9590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4c340097a0 tx=0x7f4c3402a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603a2827935d7cde server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34037070 con 0x7f4c440722c0 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3402ab30 con 0x7f4c440722c0 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c41d9b640 1 -- 172.21.15.46:0/3986379091 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c001710 con 0x7f4c440722c0 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 -- 172.21.15.46:0/3986379091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440722c0 msgr2=0x7f4c440c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 --2- 172.21.15.46:0/3986379091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440722c0 0x7f4c440c9590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4c340097a0 tx=0x7f4c3402a0a0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 -- 172.21.15.46:0/3986379091 shutdown_connections 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 --2- 172.21.15.46:0/3986379091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440722c0 0x7f4c440c9590 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 -- 172.21.15.46:0/3986379091 >> 172.21.15.46:0/3986379091 conn(0x7f4c440ac930 msgr2=0x7f4c440acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 -- 172.21.15.46:0/3986379091 shutdown_connections 2024-05-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.751+0000 7f4c48d00640 1 -- 172.21.15.46:0/3986379091 wait complete. 2024-05-09T02:22:57.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.753+0000 7f4c48d00640 1 Processor -- start 2024-05-09T02:22:57.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.753+0000 7f4c48d00640 1 -- start start 2024-05-09T02:22:57.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.754+0000 7f4c48d00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c440722c0 0x7f4c440b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.754+0000 7f4c48d00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440c3fb0 0x7f4c441e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c48d00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 0x7f4c440af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c48d00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4c44072980 con 0x7f4c44155300 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c48d00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c440ca1e0 con 0x7f4c440c3fb0 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c48d00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c44072b00 con 0x7f4c440722c0 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 0x7f4c440af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 0x7f4c440af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39190/0 (socket says 172.21.15.46:39190) 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 -- 172.21.15.46:0/766465967 learned_addr learned my addr 172.21.15.46:0/766465967 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c3bfff640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440c3fb0 0x7f4c441e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c4259c640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c440722c0 0x7f4c440b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 -- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c440722c0 msgr2=0x7f4c440b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c440722c0 0x7f4c440b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 -- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440c3fb0 msgr2=0x7f4c441e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440c3fb0 0x7f4c441e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 -- 172.21.15.46:0/766465967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4415bb40 con 0x7f4c44155300 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c42d9d640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 0x7f4c440af2e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c730 tx=0x7f4c3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c003b70 con 0x7f4c44155300 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3c003d10 con 0x7f4c44155300 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c44152010 con 0x7f4c44155300 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.755+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00aa70 con 0x7f4c44155300 2024-05-09T02:22:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.756+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4415ac70 con 0x7f4c44155300 2024-05-09T02:22:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.757+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4406a330 con 0x7f4c44155300 2024-05-09T02:22:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.757+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c3c00ac10 con 0x7f4c44155300 2024-05-09T02:22:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.758+0000 7f4c3affd640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4c24076300 0x7f4c24078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.758+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f4c3c097890 con 0x7f4c44155300 2024-05-09T02:22:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.758+0000 7f4c4259c640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4c24076300 0x7f4c24078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.759+0000 7f4c4259c640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4c24076300 0x7f4c24078810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4c34034000 tx=0x7f4c3402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:57.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.763+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4c3c060680 con 0x7f4c44155300 2024-05-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.968+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4c4415bf60 con 0x7f4c44155300 2024-05-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.968+0000 7f4c3affd640 1 -- 172.21.15.46:0/766465967 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v33) ==== 81+0+730 (secure 0 0 0) 0x7f4c3c064980 con 0x7f4c44155300 2024-05-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6834/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6835/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6834/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6836/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi046.stderr:listed 12 entries 2024-05-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4c24076300 msgr2=0x7f4c24078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4c24076300 0x7f4c24078810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4c34034000 tx=0x7f4c3402e000 comp rx=0 tx=0).stop 2024-05-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 msgr2=0x7f4c440af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 0x7f4c440af2e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c730 tx=0x7f4c3c00cbf0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 shutdown_connections 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4c24076300 0x7f4c24078810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c44155300 0x7f4c440af2e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c440c3fb0 0x7f4c441e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 --2- 172.21.15.46:0/766465967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c440722c0 0x7f4c440b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 >> 172.21.15.46:0/766465967 conn(0x7f4c440ac930 msgr2=0x7f4c440c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 shutdown_connections 2024-05-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:57.970+0000 7f4c48d00640 1 -- 172.21.15.46:0/766465967 wait complete. 2024-05-09T02:22:57.985 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-05-09T02:22:57.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:22:57.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-09T02:22:58.012 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:22:58.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[44816]: fuse finished with error 0 and tester_r 0 2024-05-09T02:22:58.976 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-05-09T02:22:58.973+0000 7f9fe1540640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:22:59.034 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-05-09T02:22:59.034 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T02:22:59.035 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T02:22:59.037 INFO:tasks.ceph.mds.d:Started 2024-05-09T02:22:59.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:22:59.127 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-09T02:22:59.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.164+0000 7f42d29a9640 1 Processor -- start 2024-05-09T02:22:59.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.164+0000 7f42d29a9640 1 -- start start 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.165+0000 7f42d29a9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42cc140d40 0x7f42cc0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.165+0000 7f42d29a9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42cc1584a0 0x7f42cc06e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.165+0000 7f42d29a9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc0c1e20 0x7f42cc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.165+0000 7f42d29a9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f42cc06f010 con 0x7f42cc1584a0 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.165+0000 7f42d29a9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f42cc06eab0 con 0x7f42cc140d40 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.165+0000 7f42d29a9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42cc1588b0 con 0x7f42cc0c1e20 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42cc1584a0 0x7f42cc06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cbfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42cc140d40 0x7f42cc0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f42cc1584a0 0x7f42cc06e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39210/0 (socket says 172.21.15.46:39210) 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1239899978 learned_addr learned my addr 172.21.15.46:0/1239899978 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42d0f46640 1 --2- 172.21.15.46:0/1239899978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc0c1e20 0x7f42cc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1239899978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc0c1e20 msgr2=0x7f42cc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 --2- 172.21.15.46:0/1239899978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc0c1e20 0x7f42cc0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1239899978 >> v2:172.21.15.107:3300/0 conn(0x7f42cc140d40 msgr2=0x7f42cc0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 --2- 172.21.15.46:0/1239899978 >> v2:172.21.15.107:3300/0 conn(0x7f42cc140d40 0x7f42cc0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1239899978 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc06ed30 con 0x7f42cc1584a0 2024-05-09T02:22:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.166+0000 7f42cbfff640 1 --2- 172.21.15.46:0/1239899978 >> v2:172.21.15.107:3300/0 conn(0x7f42cc140d40 0x7f42cc0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:22:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.167+0000 7f42cb7fe640 1 --2- 172.21.15.46:0/1239899978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc1584a0 0x7f42cc06e570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0ca9e0 tx=0x7f42c002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2578de4daeb294a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.167+0000 7f42caffd640 1 -- 172.21.15.46:0/1239899978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0037070 con 0x7f42cc1584a0 2024-05-09T02:22:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.167+0000 7f42caffd640 1 -- 172.21.15.46:0/1239899978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c0032440 con 0x7f42cc1584a0 2024-05-09T02:22:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.167+0000 7f42caffd640 1 -- 172.21.15.46:0/1239899978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0032810 con 0x7f42cc1584a0 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 -- 172.21.15.46:0/1239899978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc1584a0 msgr2=0x7f42cc06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1239899978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc1584a0 0x7f42cc06e570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0ca9e0 tx=0x7f42c002a140 comp rx=0 tx=0).stop 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 -- 172.21.15.46:0/1239899978 shutdown_connections 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1239899978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc0c1e20 0x7f42cc0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1239899978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc1584a0 0x7f42cc06e570 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1239899978 >> v2:172.21.15.107:3300/0 conn(0x7f42cc140d40 0x7f42cc0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 -- 172.21.15.46:0/1239899978 >> 172.21.15.46:0/1239899978 conn(0x7f42cc068e00 msgr2=0x7f42cc0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 -- 172.21.15.46:0/1239899978 shutdown_connections 2024-05-09T02:22:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.168+0000 7f42d29a9640 1 -- 172.21.15.46:0/1239899978 wait complete. 2024-05-09T02:22:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.169+0000 7f42d29a9640 1 Processor -- start 2024-05-09T02:22:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.170+0000 7f42d29a9640 1 -- start start 2024-05-09T02:22:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d29a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42cc0c1e20 0x7f42cc1e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d29a9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 0x7f42cc0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d29a9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc1584a0 0x7f42cc1397f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d29a9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc0c7ef0 con 0x7f42cc140d40 2024-05-09T02:22:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d29a9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc0c7c10 con 0x7f42cc0c1e20 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d29a9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42cc0c9120 con 0x7f42cc1584a0 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 0x7f42cc0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 0x7f42cc0c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39222/0 (socket says 172.21.15.46:39222) 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1836300323 learned_addr learned my addr 172.21.15.46:0/1836300323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42d0f46640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc1584a0 0x7f42cc1397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cbfff640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42cc0c1e20 0x7f42cc1e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc1584a0 msgr2=0x7f42cc1397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc1584a0 0x7f42cc1397f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42cc0c1e20 msgr2=0x7f42cc1e1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42cc0c1e20 0x7f42cc1e1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.171+0000 7f42cb7fe640 1 -- 172.21.15.46:0/1836300323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc13b030 con 0x7f42cc140d40 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.172+0000 7f42cb7fe640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 0x7f42cc0c6460 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f42c002a180 tx=0x7f42c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:59.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.172+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0041020 con 0x7f42cc140d40 2024-05-09T02:22:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.172+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c003d620 con 0x7f42cc140d40 2024-05-09T02:22:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.172+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0037040 con 0x7f42cc140d40 2024-05-09T02:22:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.172+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc0c69a0 con 0x7f42cc140d40 2024-05-09T02:22:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.172+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc13a250 con 0x7f42cc140d40 2024-05-09T02:22:59.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.173+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc06a330 con 0x7f42cc140d40 2024-05-09T02:22:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.174+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42c0044020 con 0x7f42cc140d40 2024-05-09T02:22:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.174+0000 7f42c8ff9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42b80762d0 0x7f42b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:22:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.174+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f42c00b8500 con 0x7f42cc140d40 2024-05-09T02:22:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.175+0000 7f42cbfff640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42b80762d0 0x7f42b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:22:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.175+0000 7f42cbfff640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42b80762d0 0x7f42b80787e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009560 tx=0x7f42bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:22:59.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.178+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42c004b030 con 0x7f42cc140d40 2024-05-09T02:22:59.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.410+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42cc0c89c0 con 0x7f42cc140d40 2024-05-09T02:22:59.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.410+0000 7f42c8ff9640 1 -- 172.21.15.46:0/1836300323 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5662 (secure 0 0 0) 0x7f42c0081340 con 0x7f42cc140d40 2024-05-09T02:22:59.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:22:59.413 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:56.976941+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5292,"qdb_cluster":[5292]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:22:59.414 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 41 2024-05-09T02:22:59.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42b80762d0 msgr2=0x7f42b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:59.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42b80762d0 0x7f42b80787e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009560 tx=0x7f42bc009190 comp rx=0 tx=0).stop 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 msgr2=0x7f42cc0c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 0x7f42cc0c6460 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f42c002a180 tx=0x7f42c00046c0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 shutdown_connections 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f42b80762d0 0x7f42b80787e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42cc1584a0 0x7f42cc1397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42cc140d40 0x7f42cc0c6460 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 --2- 172.21.15.46:0/1836300323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42cc0c1e20 0x7f42cc1e1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.412+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 >> 172.21.15.46:0/1836300323 conn(0x7f42cc068e00 msgr2=0x7f42cc0c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.413+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 shutdown_connections 2024-05-09T02:22:59.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:22:59.413+0000 7f42d29a9640 1 -- 172.21.15.46:0/1836300323 wait complete. 2024-05-09T02:22:59.427 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-09T02:23:01.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:23:01.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.555+0000 7f14dc0b1640 1 Processor -- start 2024-05-09T02:23:01.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.555+0000 7f14dc0b1640 1 -- start start 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14dc0b1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 0x7f14d40c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14dc0b1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d4158490 con 0x7f14d40c9840 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14dc0b1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d4158750 con 0x7f14d40c4d60 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14dc0b1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14d40c4600 con 0x7f14d40c8ef0 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14da64e640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f14d40c9840 0x7f14d4071be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52104/0 (socket says 172.21.15.46:52104) 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14da64e640 1 -- 172.21.15.46:0/1930239159 learned_addr learned my addr 172.21.15.46:0/1930239159 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d964c640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 0x7f14d40c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410780281 0 0) 0x7f14d4158490 con 0x7f14d40c9840 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14c0003520 con 0x7f14d40c9840 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576584897 0 0) 0x7f14d4158750 con 0x7f14d40c4d60 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d4158490 con 0x7f14d40c4d60 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1377159794 0 0) 0x7f14c0003520 con 0x7f14d40c9840 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 msgr2=0x7f14d40c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 0x7f14d40c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.557+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 >> v1:172.21.15.107:6789/0 conn(0x7f14d40c4d60 legacy=0x7f14d40c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d40c4290 con 0x7f14d40c9840 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f14cc001a70 con 0x7f14d40c9840 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 >> v1:172.21.15.46:6789/0 conn(0x7f14d40c9840 legacy=0x7f14d4071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14c0003c60 0x7f14c00040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0004800 0x7f14c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 0x7f14c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14c00054f0 con 0x7f14c0003c60 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14c000bf00 con 0x7f14c0004800 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14c000c080 con 0x7f14d40c8ef0 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14c0003c60 0x7f14c00040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d964c640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0004800 0x7f14c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14da64e640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 0x7f14c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d9e4d640 1 -- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 msgr2=0x7f14c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d40c8ef0 0x7f14c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d9e4d640 1 -- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0004800 msgr2=0x7f14c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0004800 0x7f14c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.558+0000 7f14d9e4d640 1 -- 172.21.15.46:0/1930239159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c0003520 con 0x7f14c0003c60 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.559+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14c0003c60 0x7f14c00040b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f14d00018d0 tx=0x7f14c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d9678350d404d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.559+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0001520 con 0x7f14c0003c60 2024-05-09T02:23:01.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.559+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d002acb0 con 0x7f14c0003c60 2024-05-09T02:23:01.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.559+0000 7f14d8e4b640 1 -- 172.21.15.46:0/1930239159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0005310 con 0x7f14c0003c60 2024-05-09T02:23:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14dc0b1640 1 -- 172.21.15.46:0/1930239159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14c0003c60 msgr2=0x7f14c00040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/1930239159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14c0003c60 0x7f14c00040b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f14d00018d0 tx=0x7f14c0005830 comp rx=0 tx=0).stop 2024-05-09T02:23:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14da64e640 1 -- 172.21.15.46:0/1930239159 reap_dead start 2024-05-09T02:23:01.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14dc0b1640 1 -- 172.21.15.46:0/1930239159 shutdown_connections 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14dc0b1640 1 -- 172.21.15.46:0/1930239159 >> 172.21.15.46:0/1930239159 conn(0x7f14d4068c70 msgr2=0x7f14d40ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14dc0b1640 1 -- 172.21.15.46:0/1930239159 shutdown_connections 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.560+0000 7f14dc0b1640 1 -- 172.21.15.46:0/1930239159 wait complete. 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.562+0000 7f14dc0b1640 1 Processor -- start 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.562+0000 7f14dc0b1640 1 -- start start 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14dc0b1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0003c60 0x7f14d415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14dc0b1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d4155110 0x7f14d40abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14dc0b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 0x7f14d414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14dc0b1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40c9300 con 0x7f14d414cfd0 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14dc0b1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40c4040 con 0x7f14c0003c60 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14dc0b1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14d40c9480 con 0x7f14d4155110 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 0x7f14d414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 0x7f14d414d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39238/0 (socket says 172.21.15.46:39238) 2024-05-09T02:23:01.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 -- 172.21.15.46:0/3622626989 learned_addr learned my addr 172.21.15.46:0/3622626989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0003c60 0x7f14d415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14d964c640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d4155110 0x7f14d40abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 -- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d4155110 msgr2=0x7f14d40abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d4155110 0x7f14d40abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 -- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0003c60 msgr2=0x7f14d415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0003c60 0x7f14d415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.563+0000 7f14da64e640 1 -- 172.21.15.46:0/3622626989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d415bdf0 con 0x7f14d414cfd0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.564+0000 7f14da64e640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 0x7f14d414d3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f14d40caac0 tx=0x7f14cc007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.564+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00aa70 con 0x7f14d414cfd0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.564+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14cc019070 con 0x7f14d414cfd0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.564+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d40af7c0 con 0x7f14d414cfd0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.564+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0133f0 con 0x7f14d414cfd0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.564+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d41ede60 con 0x7f14d414cfd0 2024-05-09T02:23:01.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.565+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d406a330 con 0x7f14d414cfd0 2024-05-09T02:23:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.566+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f14cc013590 con 0x7f14d414cfd0 2024-05-09T02:23:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.567+0000 7f14ca7fc640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14b80762d0 0x7f14b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:01.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.567+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f14cc098980 con 0x7f14d414cfd0 2024-05-09T02:23:01.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.567+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14b80762d0 0x7f14b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:01.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.568+0000 7f14d9e4d640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14b80762d0 0x7f14b80787e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14d0031000 tx=0x7f14d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:01.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.571+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f14cc061e10 con 0x7f14d414cfd0 2024-05-09T02:23:01.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.803+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14d40c7020 con 0x7f14d414cfd0 2024-05-09T02:23:01.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.803+0000 7f14ca7fc640 1 -- 172.21.15.46:0/3622626989 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6490 (secure 0 0 0) 0x7f14cc061710 con 0x7f14d414cfd0 2024-05-09T02:23:01.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:01.807 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3313737822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3313737822},{"type":"v1","addr":"172.21.15.107:6836","nonce":3313737822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:56.976941+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5292,"qdb_cluster":[5292]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:23:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 42 2024-05-09T02:23:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.805+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14b80762d0 msgr2=0x7f14b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.805+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14b80762d0 0x7f14b80787e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14d0031000 tx=0x7f14d002e000 comp rx=0 tx=0).stop 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.805+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 msgr2=0x7f14d414d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.805+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 0x7f14d414d3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f14d40caac0 tx=0x7f14cc007aa0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 shutdown_connections 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14b80762d0 0x7f14b80787e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d414cfd0 0x7f14d414d3e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14d4155110 0x7f14d40abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 --2- 172.21.15.46:0/3622626989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14c0003c60 0x7f14d415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 >> 172.21.15.46:0/3622626989 conn(0x7f14d4068c70 msgr2=0x7f14d4151870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 shutdown_connections 2024-05-09T02:23:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:01.806+0000 7f14dc0b1640 1 -- 172.21.15.46:0/3622626989 wait complete. 2024-05-09T02:23:01.820 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-05-09T02:23:01.821 INFO:tasks.mds_thrash.fs.[a]:waiting for 79 secs before thrashing 2024-05-09T02:23:04.114 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:23:04.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:04.114 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T02:23:04.151 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:23:04.151 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:23:04.172 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:23:04.172 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:23:04.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T02:23:04.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.357+0000 7ff5fdd3f640 1 Processor -- start 2024-05-09T02:23:04.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.357+0000 7ff5fdd3f640 1 -- start start 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5fdd3f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff5f80c3d60 0x7ff5f81584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5fdd3f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f80c8e40 con 0x7ff5f80c25a0 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5fdd3f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f815b100 con 0x7ff5f80c9230 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5fdd3f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f815bd10 con 0x7ff5f80c3d60 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5f7fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff5f80c25a0 0x7ff5f80c29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52116/0 (socket says 172.21.15.46:52116) 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5f7fff640 1 -- 172.21.15.46:0/1047540218 learned_addr learned my addr 172.21.15.46:0/1047540218 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5f6ffd640 1 --2- 172.21.15.46:0/1047540218 >> v2:172.21.15.107:3300/0 conn(0x7ff5f80c3d60 0x7ff5f81584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5f67fc640 1 -- 172.21.15.46:0/1047540218 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268371348 0 0) 0x7ff5f80c8e40 con 0x7ff5f80c25a0 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.359+0000 7ff5f67fc640 1 -- 172.21.15.46:0/1047540218 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e0003520 con 0x7ff5f80c25a0 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.360+0000 7ff5f67fc640 1 -- 172.21.15.46:0/1047540218 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2408687919 0 0) 0x7ff5e0003520 con 0x7ff5f80c25a0 2024-05-09T02:23:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.360+0000 7ff5f6ffd640 1 -- 172.21.15.46:0/1047540218 >> v1:172.21.15.107:6789/0 conn(0x7ff5f80c9230 legacy=0x7ff5f806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.360+0000 7ff5f6ffd640 1 -- 172.21.15.46:0/1047540218 >> v1:172.21.15.46:6789/0 conn(0x7ff5f80c25a0 legacy=0x7ff5f80c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.360+0000 7ff5f6ffd640 1 -- 172.21.15.46:0/1047540218 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f815b3e0 con 0x7ff5f80c3d60 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.360+0000 7ff5f6ffd640 1 --2- 172.21.15.46:0/1047540218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c3d60 0x7ff5f81584f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009790 tx=0x7ff5ec02a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b2509384c71d0b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5f67fc640 1 -- 172.21.15.46:0/1047540218 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec037070 con 0x7ff5f80c3d60 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5f67fc640 1 -- 172.21.15.46:0/1047540218 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec02aad0 con 0x7ff5f80c3d60 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5f67fc640 1 -- 172.21.15.46:0/1047540218 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0001a90 con 0x7ff5f80c3d60 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/1047540218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c3d60 msgr2=0x7ff5f81584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/1047540218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c3d60 0x7ff5f81584f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009790 tx=0x7ff5ec02a040 comp rx=0 tx=0).stop 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/1047540218 shutdown_connections 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/1047540218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c3d60 0x7ff5f81584f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/1047540218 >> 172.21.15.46:0/1047540218 conn(0x7ff5f80ccec0 msgr2=0x7ff5f80cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/1047540218 shutdown_connections 2024-05-09T02:23:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.361+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/1047540218 wait complete. 2024-05-09T02:23:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.363+0000 7ff5fdd3f640 1 Processor -- start 2024-05-09T02:23:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.363+0000 7ff5fdd3f640 1 -- start start 2024-05-09T02:23:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5fdd3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c25a0 0x7ff5f8156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5fdd3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5f80c3d60 0x7ff5f80aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5fdd3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 0x7ff5f813c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5fdd3f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f815b9a0 con 0x7ff5f80c9230 2024-05-09T02:23:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5fdd3f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f806ef50 con 0x7ff5f80c25a0 2024-05-09T02:23:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5fdd3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f806f0d0 con 0x7ff5f80c3d60 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 0x7ff5f813c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 0x7ff5f813c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39240/0 (socket says 172.21.15.46:39240) 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 -- 172.21.15.46:0/383411789 learned_addr learned my addr 172.21.15.46:0/383411789 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f6ffd640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5f80c3d60 0x7ff5f80aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f77fe640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c25a0 0x7ff5f8156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 -- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5f80c3d60 msgr2=0x7ff5f80aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5f80c3d60 0x7ff5f80aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 -- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c25a0 msgr2=0x7ff5f8156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c25a0 0x7ff5f8156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 -- 172.21.15.46:0/383411789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f8152780 con 0x7ff5f80c9230 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5f7fff640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 0x7ff5f813c750 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c760 tx=0x7ff5f000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0018070 con 0x7ff5f80c9230 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.365+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f000a640 con 0x7ff5f80c9230 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.366+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000aa30 con 0x7ff5f80c9230 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.366+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f81524a0 con 0x7ff5f80c9230 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.366+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f8156670 con 0x7ff5f80c9230 2024-05-09T02:23:04.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.366+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f8152210 con 0x7ff5f80c9230 2024-05-09T02:23:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.367+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff5f001b070 con 0x7ff5f80c9230 2024-05-09T02:23:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.368+0000 7ff5dffff640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff5e4076300 0x7ff5e4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.368+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ff5f0097290 con 0x7ff5f80c9230 2024-05-09T02:23:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.368+0000 7ff5f77fe640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff5e4076300 0x7ff5e4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.369+0000 7ff5f77fe640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff5e4076300 0x7ff5e4078810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8000f60 tx=0x7ff5e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:04.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.372+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5f0060160 con 0x7ff5f80c9230 2024-05-09T02:23:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.575+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff5f806a330 con 0x7ff5f80c9230 2024-05-09T02:23:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.575+0000 7ff5dffff640 1 -- 172.21.15.46:0/383411789 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v33) ==== 81+0+730 (secure 0 0 0) 0x7ff5f0064460 con 0x7ff5f80c9230 2024-05-09T02:23:04.578 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6834/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:23:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:23:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:23:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6835/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:23:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6834/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:23:04.579 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:23:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:23:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:23:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6836/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:23:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:23:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:23:04.580 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:23:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:listed 12 entries 2024-05-09T02:23:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff5e4076300 msgr2=0x7ff5e4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff5e4076300 0x7ff5e4078810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8000f60 tx=0x7ff5e8009040 comp rx=0 tx=0).stop 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 msgr2=0x7ff5f813c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 0x7ff5f813c750 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c760 tx=0x7ff5f000cc20 comp rx=0 tx=0).stop 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 shutdown_connections 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff5e4076300 0x7ff5e4078810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5f80c9230 0x7ff5f813c750 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff5f80c3d60 0x7ff5f80aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 --2- 172.21.15.46:0/383411789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5f80c25a0 0x7ff5f8156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 >> 172.21.15.46:0/383411789 conn(0x7ff5f80ccec0 msgr2=0x7ff5f80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 shutdown_connections 2024-05-09T02:23:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.577+0000 7ff5fdd3f640 1 -- 172.21.15.46:0/383411789 wait complete. 2024-05-09T02:23:04.593 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:23:04.593 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:23:04.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T02:23:04.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.725+0000 7f03bc973640 1 Processor -- start 2024-05-09T02:23:04.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.725+0000 7f03bc973640 1 -- start start 2024-05-09T02:23:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03bc973640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b8158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03bc973640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f03b8151dd0 0x7f03b806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03bc973640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b81521e0 con 0x7f03b80c3ef0 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03bc973640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f03b8074730 con 0x7f03b8151dd0 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03bc973640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f03b80acef0 con 0x7f03b80aef30 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03affff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f03b80c3ef0 0x7f03b8154790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52126/0 (socket says 172.21.15.46:52126) 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03affff640 1 -- 172.21.15.46:0/3681812922 learned_addr learned my addr 172.21.15.46:0/3681812922 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.726+0000 7f03b6d9d640 1 --2- 172.21.15.46:0/3681812922 >> v2:172.21.15.46:3300/0 conn(0x7f03b8151dd0 0x7f03b806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b659c640 1 --2- 172.21.15.46:0/3681812922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b6d9d640 1 -- 172.21.15.46:0/3681812922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 msgr2=0x7f03b8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b6d9d640 1 --2- 172.21.15.46:0/3681812922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b8158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b6d9d640 1 -- 172.21.15.46:0/3681812922 >> v1:172.21.15.46:6789/0 conn(0x7f03b80c3ef0 legacy=0x7f03b8154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b6d9d640 1 -- 172.21.15.46:0/3681812922 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b8074c60 con 0x7f03b8151dd0 2024-05-09T02:23:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b5d9b640 1 -- 172.21.15.46:0/3681812922 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361014085 0 0) 0x7f03b81521e0 con 0x7f03b80c3ef0 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.727+0000 7f03b6d9d640 1 --2- 172.21.15.46:0/3681812922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b806d850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009d90 tx=0x7f03b002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7eaa5ae1cda67d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03b5d9b640 1 -- 172.21.15.46:0/3681812922 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0007740 con 0x7f03b8151dd0 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03b5d9b640 1 -- 172.21.15.46:0/3681812922 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b00078e0 con 0x7f03b8151dd0 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03b5d9b640 1 -- 172.21.15.46:0/3681812922 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0007cb0 con 0x7f03b8151dd0 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 -- 172.21.15.46:0/3681812922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 msgr2=0x7f03b806d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 --2- 172.21.15.46:0/3681812922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b806d850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009d90 tx=0x7f03b002a560 comp rx=0 tx=0).stop 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 -- 172.21.15.46:0/3681812922 shutdown_connections 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 --2- 172.21.15.46:0/3681812922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b806d850 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 --2- 172.21.15.46:0/3681812922 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 -- 172.21.15.46:0/3681812922 >> 172.21.15.46:0/3681812922 conn(0x7f03b80c9e50 msgr2=0x7f03b80ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.728+0000 7f03bc973640 1 -- 172.21.15.46:0/3681812922 shutdown_connections 2024-05-09T02:23:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.729+0000 7f03bc973640 1 -- 172.21.15.46:0/3681812922 wait complete. 2024-05-09T02:23:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.730+0000 7f03bc973640 1 Processor -- start 2024-05-09T02:23:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.730+0000 7f03bc973640 1 -- start start 2024-05-09T02:23:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.731+0000 7f03bc973640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.731+0000 7f03bc973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03b80c3ef0 0x7f03b81eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03bc973640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b81ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03bc973640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f03b8158100 con 0x7f03b8151dd0 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03bc973640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f03b8157e20 con 0x7f03b80c3ef0 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03bc973640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f03b81583e0 con 0x7f03b80aef30 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b81ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b81ef280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39270/0 (socket says 172.21.15.46:39270) 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b6d9d640 1 -- 172.21.15.46:0/1885465299 learned_addr learned my addr 172.21.15.46:0/1885465299 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03affff640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03b80c3ef0 0x7f03b81eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 -- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03b80c3ef0 msgr2=0x7f03b81eed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03b80c3ef0 0x7f03b81eed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 -- 172.21.15.46:0/1885465299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 msgr2=0x7f03b81ef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b81ef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 -- 172.21.15.46:0/1885465299 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b80abc90 con 0x7f03b80aef30 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b6d9d640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b81ef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.732+0000 7f03b659c640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b80c6960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e870 tx=0x7f03a800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.733+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8017070 con 0x7f03b80aef30 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.733+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a800ee60 con 0x7f03b80aef30 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.733+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b81df830 con 0x7f03b80aef30 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.733+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a800cb80 con 0x7f03b80aef30 2024-05-09T02:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.733+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b81e14d0 con 0x7f03b80aef30 2024-05-09T02:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.733+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b806a330 con 0x7f03b80aef30 2024-05-09T02:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.735+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f03a801a070 con 0x7f03b80aef30 2024-05-09T02:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.735+0000 7f03aeffd640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0398076300 0x7f0398078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.735+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f03a8098000 con 0x7f03b80aef30 2024-05-09T02:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.735+0000 7f03affff640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0398076300 0x7f0398078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.736+0000 7f03affff640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0398076300 0x7f0398078810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03b81e1e00 tx=0x7f03a0007e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:04.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.740+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f03a8060e40 con 0x7f03b80aef30 2024-05-09T02:23:04.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.940+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f03b80a9070 con 0x7f03b80aef30 2024-05-09T02:23:04.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.941+0000 7f03aeffd640 1 -- 172.21.15.46:0/1885465299 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v33) ==== 81+0+730 (secure 0 0 0) 0x7f03a8065140 con 0x7f03b80aef30 2024-05-09T02:23:04.944 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6834/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:23:04.944 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:23:04.944 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/3794663718 2024-05-10T02:22:39.920164+0000 2024-05-09T02:23:04.944 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6835/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6834/687229870 2024-05-10T02:20:29.906793+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6833/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6832/268323982 2024-05-10T02:19:54.895024+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6836/1968918469 2024-05-10T02:22:53.964723+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/3709209674 2024-05-10T02:20:29.900468+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6837/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.107:6835/16654146 2024-05-10T02:19:04.887047+0000 2024-05-09T02:23:04.945 INFO:teuthology.orchestra.run.smithi046.stderr:listed 12 entries 2024-05-09T02:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0398076300 msgr2=0x7f0398078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0398076300 0x7f0398078810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03b81e1e00 tx=0x7f03a0007e20 comp rx=0 tx=0).stop 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 msgr2=0x7f03b80c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b80c6960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e870 tx=0x7f03a800ed30 comp rx=0 tx=0).stop 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 shutdown_connections 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f0398076300 0x7f0398078810 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03b8151dd0 0x7f03b81ef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03b80c3ef0 0x7f03b81eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 --2- 172.21.15.46:0/1885465299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03b80aef30 0x7f03b80c6960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 >> 172.21.15.46:0/1885465299 conn(0x7f03b80c9e50 msgr2=0x7f03b814c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 shutdown_connections 2024-05-09T02:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:04.943+0000 7f03bc973640 1 -- 172.21.15.46:0/1885465299 wait complete. 2024-05-09T02:23:04.958 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2024-05-09T02:23:04.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:04.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-09T02:23:04.990 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:23:04.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[41829]: fuse finished with error 0 and tester_r 0 2024-05-09T02:23:11.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:23:11.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.092 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T02:23:11.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.128 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-05-09T02:23:11.148 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T02:23:11.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T02:23:11.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-05-09T02:23:11.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.317 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-09T02:23:11.337 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T02:23:11.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.338 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T02:23:11.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:23:11.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-09T02:23:11.506 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T02:23:11.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T02:23:11.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:23:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.640+0000 7f9423746640 1 Processor -- start 2024-05-09T02:23:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.640+0000 7f9423746640 1 -- start start 2024-05-09T02:23:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f9423746640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f941c151ef0 0x7f941c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f9423746640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c154720 0x7f941c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f9423746640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f941c0733b0 con 0x7f941c0a91e0 2024-05-09T02:23:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f9423746640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f941c0ab290 con 0x7f941c151ef0 2024-05-09T02:23:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f9423746640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f941c0ab570 con 0x7f941c154720 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f941c151ef0 0x7f941c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f941c151ef0 0x7f941c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59306/0 (socket says 172.21.15.46:59306) 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 -- 172.21.15.46:0/2596270842 learned_addr learned my addr 172.21.15.46:0/2596270842 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f9421ce3640 1 --2- 172.21.15.46:0/2596270842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c154720 0x7f941c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 -- 172.21.15.46:0/2596270842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c154720 msgr2=0x7f941c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 --2- 172.21.15.46:0/2596270842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c154720 0x7f941c0c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 -- 172.21.15.46:0/2596270842 >> v1:172.21.15.107:6789/0 conn(0x7f941c0a91e0 legacy=0x7f941c073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:11.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.642+0000 7f94214e2640 1 -- 172.21.15.46:0/2596270842 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c073620 con 0x7f941c151ef0 2024-05-09T02:23:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.643+0000 7f94214e2640 1 --2- 172.21.15.46:0/2596270842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c0aac90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f941800bb10 tx=0x7f941802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39aac863101c9dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.643+0000 7f9413fff640 1 -- 172.21.15.46:0/2596270842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418036020 con 0x7f941c151ef0 2024-05-09T02:23:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.643+0000 7f9413fff640 1 -- 172.21.15.46:0/2596270842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9418032820 con 0x7f941c151ef0 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.643+0000 7f9413fff640 1 -- 172.21.15.46:0/2596270842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418032bf0 con 0x7f941c151ef0 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 -- 172.21.15.46:0/2596270842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 msgr2=0x7f941c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 --2- 172.21.15.46:0/2596270842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c0aac90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f941800bb10 tx=0x7f941802c920 comp rx=0 tx=0).stop 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 -- 172.21.15.46:0/2596270842 shutdown_connections 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 --2- 172.21.15.46:0/2596270842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c154720 0x7f941c0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 --2- 172.21.15.46:0/2596270842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c0aac90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 -- 172.21.15.46:0/2596270842 >> 172.21.15.46:0/2596270842 conn(0x7f941c0c5940 msgr2=0x7f941c0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 -- 172.21.15.46:0/2596270842 shutdown_connections 2024-05-09T02:23:11.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.644+0000 7f9423746640 1 -- 172.21.15.46:0/2596270842 wait complete. 2024-05-09T02:23:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.646+0000 7f9423746640 1 Processor -- start 2024-05-09T02:23:11.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.646+0000 7f9423746640 1 -- start start 2024-05-09T02:23:11.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9423746640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c0a91e0 0x7f941c0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:11.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9423746640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c1e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:11.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9423746640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f941c154720 0x7f941c1ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:11.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9423746640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0c55e0 con 0x7f941c151ef0 2024-05-09T02:23:11.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9423746640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0c5460 con 0x7f941c154720 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9423746640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f941c154b30 con 0x7f941c0a91e0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9420ce1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c1e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9420ce1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c1e9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59312/0 (socket says 172.21.15.46:59312) 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9420ce1640 1 -- 172.21.15.46:0/3310020218 learned_addr learned my addr 172.21.15.46:0/3310020218 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f94214e2640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c0a91e0 0x7f941c0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.647+0000 7f9421ce3640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f941c154720 0x7f941c1ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9420ce1640 1 -- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c0a91e0 msgr2=0x7f941c0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9420ce1640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c0a91e0 0x7f941c0c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9420ce1640 1 -- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f941c154720 msgr2=0x7f941c1ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9420ce1640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f941c154720 0x7f941c1ddd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9420ce1640 1 -- 172.21.15.46:0/3310020218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c155dc0 con 0x7f941c151ef0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9420ce1640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c1e9f60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f940c00c370 tx=0x7f940c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0052d0 con 0x7f941c151ef0 2024-05-09T02:23:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940c007020 con 0x7f941c151ef0 2024-05-09T02:23:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c1dfdd0 con 0x7f941c151ef0 2024-05-09T02:23:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0054b0 con 0x7f941c151ef0 2024-05-09T02:23:11.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.648+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c1e0390 con 0x7f941c151ef0 2024-05-09T02:23:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.649+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c1edb90 con 0x7f941c151ef0 2024-05-09T02:23:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.650+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f940c007410 con 0x7f941c151ef0 2024-05-09T02:23:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.650+0000 7f9411ffb640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f94000762d0 0x7f94000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.651+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f940c096fa0 con 0x7f941c151ef0 2024-05-09T02:23:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.651+0000 7f94214e2640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f94000762d0 0x7f94000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:11.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.651+0000 7f94214e2640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f94000762d0 0x7f94000787e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9418037000 tx=0x7f9418032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:11.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.655+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f940c05fcf0 con 0x7f941c151ef0 2024-05-09T02:23:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.844+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f941c06a330 con 0x7f94000762d0 2024-05-09T02:23:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.856+0000 7f9411ffb640 1 -- 172.21.15.46:0/3310020218 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492398 (secure 0 0 0) 0x7f941c06a330 con 0x7f94000762d0 2024-05-09T02:23:11.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f94000762d0 msgr2=0x7f94000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f94000762d0 0x7f94000787e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9418037000 tx=0x7f9418032000 comp rx=0 tx=0).stop 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 msgr2=0x7f941c1e9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c1e9f60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f940c00c370 tx=0x7f940c00c830 comp rx=0 tx=0).stop 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 shutdown_connections 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f94000762d0 0x7f94000787e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f941c154720 0x7f941c1ddd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f941c151ef0 0x7f941c1e9f60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 --2- 172.21.15.46:0/3310020218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f941c0a91e0 0x7f941c0c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:11.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 >> 172.21.15.46:0/3310020218 conn(0x7f941c0c5940 msgr2=0x7f941c154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:11.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 shutdown_connections 2024-05-09T02:23:11.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:11.861+0000 7f9423746640 1 -- 172.21.15.46:0/3310020218 wait complete. 2024-05-09T02:23:11.876 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-05-09T02:23:10.588270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018636,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":546,"num_read_kb":945,"num_write":18928,"num_write_kb":50333845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18909,"ondisk_log_size":18909,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415408,"kb_used_data":4976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754559312,"statfs":{"total":773094113280,"available":772668735488,"internally_reserved":0,"allocated":5095424,"data_stored":3325928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":420204083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14884,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":69,"num_write":25,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004215"},"pg_stats":[{"pgid":"5.18","version":"32'162","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969855+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:22:53.969855+0000","last_peered":"2024-05-09T02:22:53.969855+0000","last_clean":"2024-05-09T02:22:53.969855+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:22:53.969855+0000","last_undegraded":"2024-05-09T02:22:53.969855+0000","last_fullsized":"2024-05-09T02:22:53.969855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"33'7","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996769+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:22:53.996769+0000","last_peered":"2024-05-09T02:22:53.996769+0000","last_clean":"2024-05-09T02:22:53.996769+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:22:53.996769+0000","last_undegraded":"2024-05-09T02:22:53.996769+0000","last_fullsized":"2024-05-09T02:22:53.996769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986226+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:22:53.986226+0000","last_peered":"2024-05-09T02:22:53.986226+0000","last_clean":"2024-05-09T02:22:53.986226+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:22:53.986226+0000","last_undegraded":"2024-05-09T02:22:53.986226+0000","last_fullsized":"2024-05-09T02:22:53.986226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984493+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:22:53.984493+0000","last_peered":"2024-05-09T02:22:53.984493+0000","last_clean":"2024-05-09T02:22:53.984493+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:22:53.984493+0000","last_undegraded":"2024-05-09T02:22:53.984493+0000","last_fullsized":"2024-05-09T02:22:53.984493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"32'147","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970416+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:22:53.970416+0000","last_peered":"2024-05-09T02:22:53.970416+0000","last_clean":"2024-05-09T02:22:53.970416+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:22:53.970416+0000","last_undegraded":"2024-05-09T02:22:53.970416+0000","last_fullsized":"2024-05-09T02:22:53.970416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986511+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:22:53.986511+0000","last_peered":"2024-05-09T02:22:53.986511+0000","last_clean":"2024-05-09T02:22:53.986511+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:22:53.986511+0000","last_undegraded":"2024-05-09T02:22:53.986511+0000","last_fullsized":"2024-05-09T02:22:53.986511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969340+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:22:53.969340+0000","last_peered":"2024-05-09T02:22:53.969340+0000","last_clean":"2024-05-09T02:22:53.969340+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:22:53.969340+0000","last_undegraded":"2024-05-09T02:22:53.969340+0000","last_fullsized":"2024-05-09T02:22:53.969340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969867+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:22:53.969867+0000","last_peered":"2024-05-09T02:22:53.969867+0000","last_clean":"2024-05-09T02:22:53.969867+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:22:53.969867+0000","last_undegraded":"2024-05-09T02:22:53.969867+0000","last_fullsized":"2024-05-09T02:22:53.969867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976679+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:22:53.976679+0000","last_peered":"2024-05-09T02:22:53.976679+0000","last_clean":"2024-05-09T02:22:53.976679+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:22:53.976679+0000","last_undegraded":"2024-05-09T02:22:53.976679+0000","last_fullsized":"2024-05-09T02:22:53.976679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.988297+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:22:56.988297+0000","last_peered":"2024-05-09T02:22:56.988297+0000","last_clean":"2024-05-09T02:22:56.988297+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:22:56.988297+0000","last_undegraded":"2024-05-09T02:22:56.988297+0000","last_fullsized":"2024-05-09T02:22:56.988297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'132","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108425+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:22:54.108425+0000","last_peered":"2024-05-09T02:22:54.108425+0000","last_clean":"2024-05-09T02:22:54.108425+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:22:54.108425+0000","last_undegraded":"2024-05-09T02:22:54.108425+0000","last_fullsized":"2024-05-09T02:22:54.108425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970514+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:22:53.970514+0000","last_peered":"2024-05-09T02:22:53.970514+0000","last_clean":"2024-05-09T02:22:53.970514+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:22:53.970514+0000","last_undegraded":"2024-05-09T02:22:53.970514+0000","last_fullsized":"2024-05-09T02:22:53.970514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107050+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:22:54.107050+0000","last_peered":"2024-05-09T02:22:54.107050+0000","last_clean":"2024-05-09T02:22:54.107050+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:22:54.107050+0000","last_undegraded":"2024-05-09T02:22:54.107050+0000","last_fullsized":"2024-05-09T02:22:54.107050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984071+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:22:56.984071+0000","last_peered":"2024-05-09T02:22:56.984071+0000","last_clean":"2024-05-09T02:22:56.984071+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:22:56.984071+0000","last_undegraded":"2024-05-09T02:22:56.984071+0000","last_fullsized":"2024-05-09T02:22:56.984071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'168","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108041+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:22:54.108041+0000","last_peered":"2024-05-09T02:22:54.108041+0000","last_clean":"2024-05-09T02:22:54.108041+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:22:54.108041+0000","last_undegraded":"2024-05-09T02:22:54.108041+0000","last_fullsized":"2024-05-09T02:22:54.108041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971555+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:22:53.971555+0000","last_peered":"2024-05-09T02:22:53.971555+0000","last_clean":"2024-05-09T02:22:53.971555+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:22:53.971555+0000","last_undegraded":"2024-05-09T02:22:53.971555+0000","last_fullsized":"2024-05-09T02:22:53.971555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971155+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:22:53.971155+0000","last_peered":"2024-05-09T02:22:53.971155+0000","last_clean":"2024-05-09T02:22:53.971155+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:22:53.971155+0000","last_undegraded":"2024-05-09T02:22:53.971155+0000","last_fullsized":"2024-05-09T02:22:53.971155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981206+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:22:53.981206+0000","last_peered":"2024-05-09T02:22:53.981206+0000","last_clean":"2024-05-09T02:22:53.981206+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:22:53.981206+0000","last_undegraded":"2024-05-09T02:22:53.981206+0000","last_fullsized":"2024-05-09T02:22:53.981206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'7","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996527+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:22:53.996527+0000","last_peered":"2024-05-09T02:22:53.996527+0000","last_clean":"2024-05-09T02:22:53.996527+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:22:53.996527+0000","last_undegraded":"2024-05-09T02:22:53.996527+0000","last_fullsized":"2024-05-09T02:22:53.996527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970513+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:22:53.970513+0000","last_peered":"2024-05-09T02:22:53.970513+0000","last_clean":"2024-05-09T02:22:53.970513+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:22:53.970513+0000","last_undegraded":"2024-05-09T02:22:53.970513+0000","last_fullsized":"2024-05-09T02:22:53.970513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978415+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:22:53.978415+0000","last_peered":"2024-05-09T02:22:53.978415+0000","last_clean":"2024-05-09T02:22:53.978415+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:22:53.978415+0000","last_undegraded":"2024-05-09T02:22:53.978415+0000","last_fullsized":"2024-05-09T02:22:53.978415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'135","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985777+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:22:53.985777+0000","last_peered":"2024-05-09T02:22:53.985777+0000","last_clean":"2024-05-09T02:22:53.985777+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:22:53.985777+0000","last_undegraded":"2024-05-09T02:22:53.985777+0000","last_fullsized":"2024-05-09T02:22:53.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971841+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:22:53.971841+0000","last_peered":"2024-05-09T02:22:53.971841+0000","last_clean":"2024-05-09T02:22:53.971841+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:22:53.971841+0000","last_undegraded":"2024-05-09T02:22:53.971841+0000","last_fullsized":"2024-05-09T02:22:53.971841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971018+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:22:53.971018+0000","last_peered":"2024-05-09T02:22:53.971018+0000","last_clean":"2024-05-09T02:22:53.971018+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:22:53.971018+0000","last_undegraded":"2024-05-09T02:22:53.971018+0000","last_fullsized":"2024-05-09T02:22:53.971018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970419+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:22:53.970419+0000","last_peered":"2024-05-09T02:22:53.970419+0000","last_clean":"2024-05-09T02:22:53.970419+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:22:53.970419+0000","last_undegraded":"2024-05-09T02:22:53.970419+0000","last_fullsized":"2024-05-09T02:22:53.970419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985368+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:22:53.985368+0000","last_peered":"2024-05-09T02:22:53.985368+0000","last_clean":"2024-05-09T02:22:53.985368+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:22:53.985368+0000","last_undegraded":"2024-05-09T02:22:53.985368+0000","last_fullsized":"2024-05-09T02:22:53.985368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972195+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:22:53.972195+0000","last_peered":"2024-05-09T02:22:53.972195+0000","last_clean":"2024-05-09T02:22:53.972195+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:22:53.972195+0000","last_undegraded":"2024-05-09T02:22:53.972195+0000","last_fullsized":"2024-05-09T02:22:53.972195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975149+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:22:53.975149+0000","last_peered":"2024-05-09T02:22:53.975149+0000","last_clean":"2024-05-09T02:22:53.975149+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:22:53.975149+0000","last_undegraded":"2024-05-09T02:22:53.975149+0000","last_fullsized":"2024-05-09T02:22:53.975149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108475+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:22:54.108475+0000","last_peered":"2024-05-09T02:22:54.108475+0000","last_clean":"2024-05-09T02:22:54.108475+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:22:54.108475+0000","last_undegraded":"2024-05-09T02:22:54.108475+0000","last_fullsized":"2024-05-09T02:22:54.108475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971430+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:22:53.971430+0000","last_peered":"2024-05-09T02:22:53.971430+0000","last_clean":"2024-05-09T02:22:53.971430+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:22:53.971430+0000","last_undegraded":"2024-05-09T02:22:53.971430+0000","last_fullsized":"2024-05-09T02:22:53.971430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977614+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:22:53.977614+0000","last_peered":"2024-05-09T02:22:53.977614+0000","last_clean":"2024-05-09T02:22:53.977614+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:22:53.977614+0000","last_undegraded":"2024-05-09T02:22:53.977614+0000","last_fullsized":"2024-05-09T02:22:53.977614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970761+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:22:53.970761+0000","last_peered":"2024-05-09T02:22:53.970761+0000","last_clean":"2024-05-09T02:22:53.970761+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:22:53.970761+0000","last_undegraded":"2024-05-09T02:22:53.970761+0000","last_fullsized":"2024-05-09T02:22:53.970761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984174+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:22:53.984174+0000","last_peered":"2024-05-09T02:22:53.984174+0000","last_clean":"2024-05-09T02:22:53.984174+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:22:53.984174+0000","last_undegraded":"2024-05-09T02:22:53.984174+0000","last_fullsized":"2024-05-09T02:22:53.984174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971160+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:22:53.971160+0000","last_peered":"2024-05-09T02:22:53.971160+0000","last_clean":"2024-05-09T02:22:53.971160+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:22:53.971160+0000","last_undegraded":"2024-05-09T02:22:53.971160+0000","last_fullsized":"2024-05-09T02:22:53.971160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.985077+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:22:56.985077+0000","last_peered":"2024-05-09T02:22:56.985077+0000","last_clean":"2024-05-09T02:22:56.985077+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:22:56.985077+0000","last_undegraded":"2024-05-09T02:22:56.985077+0000","last_fullsized":"2024-05-09T02:22:56.985077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.936277+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:23:01.936277+0000","last_peered":"2024-05-09T02:23:01.936277+0000","last_clean":"2024-05-09T02:23:01.936277+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:23:01.936277+0000","last_undegraded":"2024-05-09T02:23:01.936277+0000","last_fullsized":"2024-05-09T02:23:01.936277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969835+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:22:53.969835+0000","last_peered":"2024-05-09T02:22:53.969835+0000","last_clean":"2024-05-09T02:22:53.969835+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:22:53.969835+0000","last_undegraded":"2024-05-09T02:22:53.969835+0000","last_fullsized":"2024-05-09T02:22:53.969835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985416+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:22:53.985416+0000","last_peered":"2024-05-09T02:22:53.985416+0000","last_clean":"2024-05-09T02:22:53.985416+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:22:53.985416+0000","last_undegraded":"2024-05-09T02:22:53.985416+0000","last_fullsized":"2024-05-09T02:22:53.985416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'21","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.976097+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:22:58.976097+0000","last_peered":"2024-05-09T02:22:58.976097+0000","last_clean":"2024-05-09T02:22:58.976097+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:22:58.976097+0000","last_undegraded":"2024-05-09T02:22:58.976097+0000","last_fullsized":"2024-05-09T02:22:58.976097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984244+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:22:53.984244+0000","last_peered":"2024-05-09T02:22:53.984244+0000","last_clean":"2024-05-09T02:22:53.984244+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:22:53.984244+0000","last_undegraded":"2024-05-09T02:22:53.984244+0000","last_fullsized":"2024-05-09T02:22:53.984244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'150","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980650+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:22:53.980650+0000","last_peered":"2024-05-09T02:22:53.980650+0000","last_clean":"2024-05-09T02:22:53.980650+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:22:53.980650+0000","last_undegraded":"2024-05-09T02:22:53.980650+0000","last_fullsized":"2024-05-09T02:22:53.980650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"31'135","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971639+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:22:53.971639+0000","last_peered":"2024-05-09T02:22:53.971639+0000","last_clean":"2024-05-09T02:22:53.971639+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:22:53.971639+0000","last_undegraded":"2024-05-09T02:22:53.971639+0000","last_fullsized":"2024-05-09T02:22:53.971639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979037+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:22:53.979037+0000","last_peered":"2024-05-09T02:22:53.979037+0000","last_clean":"2024-05-09T02:22:53.979037+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:22:53.979037+0000","last_undegraded":"2024-05-09T02:22:53.979037+0000","last_fullsized":"2024-05-09T02:22:53.979037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970261+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:22:53.970261+0000","last_peered":"2024-05-09T02:22:53.970261+0000","last_clean":"2024-05-09T02:22:53.970261+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:22:53.970261+0000","last_undegraded":"2024-05-09T02:22:53.970261+0000","last_fullsized":"2024-05-09T02:22:53.970261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970935+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:22:53.970935+0000","last_peered":"2024-05-09T02:22:53.970935+0000","last_clean":"2024-05-09T02:22:53.970935+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:22:53.970935+0000","last_undegraded":"2024-05-09T02:22:53.970935+0000","last_fullsized":"2024-05-09T02:22:53.970935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108245+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:22:54.108245+0000","last_peered":"2024-05-09T02:22:54.108245+0000","last_clean":"2024-05-09T02:22:54.108245+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:22:54.108245+0000","last_undegraded":"2024-05-09T02:22:54.108245+0000","last_fullsized":"2024-05-09T02:22:54.108245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.973716+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:22:53.973716+0000","last_peered":"2024-05-09T02:22:53.973716+0000","last_clean":"2024-05-09T02:22:53.973716+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:22:53.973716+0000","last_undegraded":"2024-05-09T02:22:53.973716+0000","last_fullsized":"2024-05-09T02:22:53.973716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971133+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:22:53.971133+0000","last_peered":"2024-05-09T02:22:53.971133+0000","last_clean":"2024-05-09T02:22:53.971133+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:22:53.971133+0000","last_undegraded":"2024-05-09T02:22:53.971133+0000","last_fullsized":"2024-05-09T02:22:53.971133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969454+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:22:53.969454+0000","last_peered":"2024-05-09T02:22:53.969454+0000","last_clean":"2024-05-09T02:22:53.969454+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:22:53.969454+0000","last_undegraded":"2024-05-09T02:22:53.969454+0000","last_fullsized":"2024-05-09T02:22:53.969454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970783+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:22:53.970783+0000","last_peered":"2024-05-09T02:22:53.970783+0000","last_clean":"2024-05-09T02:22:53.970783+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:22:53.970783+0000","last_undegraded":"2024-05-09T02:22:53.970783+0000","last_fullsized":"2024-05-09T02:22:53.970783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108236+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:22:54.108236+0000","last_peered":"2024-05-09T02:22:54.108236+0000","last_clean":"2024-05-09T02:22:54.108236+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:22:54.108236+0000","last_undegraded":"2024-05-09T02:22:54.108236+0000","last_fullsized":"2024-05-09T02:22:54.108236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971514+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:22:53.971514+0000","last_peered":"2024-05-09T02:22:53.971514+0000","last_clean":"2024-05-09T02:22:53.971514+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:22:53.971514+0000","last_undegraded":"2024-05-09T02:22:53.971514+0000","last_fullsized":"2024-05-09T02:22:53.971514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"32'156","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979396+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:22:53.979396+0000","last_peered":"2024-05-09T02:22:53.979396+0000","last_clean":"2024-05-09T02:22:53.979396+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:22:53.979396+0000","last_undegraded":"2024-05-09T02:22:53.979396+0000","last_fullsized":"2024-05-09T02:22:53.979396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972577+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:22:53.972577+0000","last_peered":"2024-05-09T02:22:53.972577+0000","last_clean":"2024-05-09T02:22:53.972577+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:22:53.972577+0000","last_undegraded":"2024-05-09T02:22:53.972577+0000","last_fullsized":"2024-05-09T02:22:53.972577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'7","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.979322+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:22:58.979322+0000","last_peered":"2024-05-09T02:22:58.979322+0000","last_clean":"2024-05-09T02:22:58.979322+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:22:58.979322+0000","last_undegraded":"2024-05-09T02:22:58.979322+0000","last_fullsized":"2024-05-09T02:22:58.979322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975286+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:22:53.975286+0000","last_peered":"2024-05-09T02:22:53.975286+0000","last_clean":"2024-05-09T02:22:53.975286+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:22:53.975286+0000","last_undegraded":"2024-05-09T02:22:53.975286+0000","last_fullsized":"2024-05-09T02:22:53.975286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108653+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:22:54.108653+0000","last_peered":"2024-05-09T02:22:54.108653+0000","last_clean":"2024-05-09T02:22:54.108653+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:22:54.108653+0000","last_undegraded":"2024-05-09T02:22:54.108653+0000","last_fullsized":"2024-05-09T02:22:54.108653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969060+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:22:53.969060+0000","last_peered":"2024-05-09T02:22:53.969060+0000","last_clean":"2024-05-09T02:22:53.969060+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:22:53.969060+0000","last_undegraded":"2024-05-09T02:22:53.969060+0000","last_fullsized":"2024-05-09T02:22:53.969060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977964+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:22:53.977964+0000","last_peered":"2024-05-09T02:22:53.977964+0000","last_clean":"2024-05-09T02:22:53.977964+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:22:53.977964+0000","last_undegraded":"2024-05-09T02:22:53.977964+0000","last_fullsized":"2024-05-09T02:22:53.977964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'22","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:00.928540+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:23:00.928540+0000","last_peered":"2024-05-09T02:23:00.928540+0000","last_clean":"2024-05-09T02:23:00.928540+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:23:00.928540+0000","last_undegraded":"2024-05-09T02:23:00.928540+0000","last_fullsized":"2024-05-09T02:23:00.928540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'135","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977106+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:22:53.977106+0000","last_peered":"2024-05-09T02:22:53.977106+0000","last_clean":"2024-05-09T02:22:53.977106+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:22:53.977106+0000","last_undegraded":"2024-05-09T02:22:53.977106+0000","last_fullsized":"2024-05-09T02:22:53.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'150","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985827+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:22:53.985827+0000","last_peered":"2024-05-09T02:22:53.985827+0000","last_clean":"2024-05-09T02:22:53.985827+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:22:53.985827+0000","last_undegraded":"2024-05-09T02:22:53.985827+0000","last_fullsized":"2024-05-09T02:22:53.985827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107278+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:22:54.107278+0000","last_peered":"2024-05-09T02:22:54.107278+0000","last_clean":"2024-05-09T02:22:54.107278+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:22:54.107278+0000","last_undegraded":"2024-05-09T02:22:54.107278+0000","last_fullsized":"2024-05-09T02:22:54.107278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978232+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:22:53.978232+0000","last_peered":"2024-05-09T02:22:53.978232+0000","last_clean":"2024-05-09T02:22:53.978232+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:22:53.978232+0000","last_undegraded":"2024-05-09T02:22:53.978232+0000","last_fullsized":"2024-05-09T02:22:53.978232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980476+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:22:53.980476+0000","last_peered":"2024-05-09T02:22:53.980476+0000","last_clean":"2024-05-09T02:22:53.980476+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:22:53.980476+0000","last_undegraded":"2024-05-09T02:22:53.980476+0000","last_fullsized":"2024-05-09T02:22:53.980476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"32'135","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979276+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:22:53.979276+0000","last_peered":"2024-05-09T02:22:53.979276+0000","last_clean":"2024-05-09T02:22:53.979276+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:22:53.979276+0000","last_undegraded":"2024-05-09T02:22:53.979276+0000","last_fullsized":"2024-05-09T02:22:53.979276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978295+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:22:53.978295+0000","last_peered":"2024-05-09T02:22:53.978295+0000","last_clean":"2024-05-09T02:22:53.978295+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:22:53.978295+0000","last_undegraded":"2024-05-09T02:22:53.978295+0000","last_fullsized":"2024-05-09T02:22:53.978295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979181+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:22:53.979181+0000","last_peered":"2024-05-09T02:22:53.979181+0000","last_clean":"2024-05-09T02:22:53.979181+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:22:53.979181+0000","last_undegraded":"2024-05-09T02:22:53.979181+0000","last_fullsized":"2024-05-09T02:22:53.979181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980574+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:22:53.980574+0000","last_peered":"2024-05-09T02:22:53.980574+0000","last_clean":"2024-05-09T02:22:53.980574+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:22:53.980574+0000","last_undegraded":"2024-05-09T02:22:53.980574+0000","last_fullsized":"2024-05-09T02:22:53.980574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978092+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:22:53.978092+0000","last_peered":"2024-05-09T02:22:53.978092+0000","last_clean":"2024-05-09T02:22:53.978092+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:22:53.978092+0000","last_undegraded":"2024-05-09T02:22:53.978092+0000","last_fullsized":"2024-05-09T02:22:53.978092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'138","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978097+0000","last_change":"2024-05-09T02:18:55.756927+0000","last_active":"2024-05-09T02:22:53.978097+0000","last_peered":"2024-05-09T02:22:53.978097+0000","last_clean":"2024-05-09T02:22:53.978097+0000","last_became_active":"2024-05-09T02:18:55.756398+0000","last_became_peered":"2024-05-09T02:18:55.756398+0000","last_unstale":"2024-05-09T02:22:53.978097+0000","last_undegraded":"2024-05-09T02:22:53.978097+0000","last_fullsized":"2024-05-09T02:22:53.978097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975232+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:22:53.975232+0000","last_peered":"2024-05-09T02:22:53.975232+0000","last_clean":"2024-05-09T02:22:53.975232+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:22:53.975232+0000","last_undegraded":"2024-05-09T02:22:53.975232+0000","last_fullsized":"2024-05-09T02:22:53.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'7","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970048+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:22:53.970048+0000","last_peered":"2024-05-09T02:22:53.970048+0000","last_clean":"2024-05-09T02:22:53.970048+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:22:53.970048+0000","last_undegraded":"2024-05-09T02:22:53.970048+0000","last_fullsized":"2024-05-09T02:22:53.970048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976514+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:22:53.976514+0000","last_peered":"2024-05-09T02:22:53.976514+0000","last_clean":"2024-05-09T02:22:53.976514+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:22:53.976514+0000","last_undegraded":"2024-05-09T02:22:53.976514+0000","last_fullsized":"2024-05-09T02:22:53.976514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978683+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:22:53.978683+0000","last_peered":"2024-05-09T02:22:53.978683+0000","last_clean":"2024-05-09T02:22:53.978683+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:22:53.978683+0000","last_undegraded":"2024-05-09T02:22:53.978683+0000","last_fullsized":"2024-05-09T02:22:53.978683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984458+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:22:56.984458+0000","last_peered":"2024-05-09T02:22:56.984458+0000","last_clean":"2024-05-09T02:22:56.984458+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:22:56.984458+0000","last_undegraded":"2024-05-09T02:22:56.984458+0000","last_fullsized":"2024-05-09T02:22:56.984458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106855+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:22:54.106855+0000","last_peered":"2024-05-09T02:22:54.106855+0000","last_clean":"2024-05-09T02:22:54.106855+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:22:54.106855+0000","last_undegraded":"2024-05-09T02:22:54.106855+0000","last_fullsized":"2024-05-09T02:22:54.106855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977966+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:22:53.977966+0000","last_peered":"2024-05-09T02:22:53.977966+0000","last_clean":"2024-05-09T02:22:53.977966+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:22:53.977966+0000","last_undegraded":"2024-05-09T02:22:53.977966+0000","last_fullsized":"2024-05-09T02:22:53.977966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978422+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:22:53.978422+0000","last_peered":"2024-05-09T02:22:53.978422+0000","last_clean":"2024-05-09T02:22:53.978422+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:22:53.978422+0000","last_undegraded":"2024-05-09T02:22:53.978422+0000","last_fullsized":"2024-05-09T02:22:53.978422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971819+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:22:53.971819+0000","last_peered":"2024-05-09T02:22:53.971819+0000","last_clean":"2024-05-09T02:22:53.971819+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:22:53.971819+0000","last_undegraded":"2024-05-09T02:22:53.971819+0000","last_fullsized":"2024-05-09T02:22:53.971819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969924+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:22:53.969924+0000","last_peered":"2024-05-09T02:22:53.969924+0000","last_clean":"2024-05-09T02:22:53.969924+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:22:53.969924+0000","last_undegraded":"2024-05-09T02:22:53.969924+0000","last_fullsized":"2024-05-09T02:22:53.969924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"32'132","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984777+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:22:53.984777+0000","last_peered":"2024-05-09T02:22:53.984777+0000","last_clean":"2024-05-09T02:22:53.984777+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:22:53.984777+0000","last_undegraded":"2024-05-09T02:22:53.984777+0000","last_fullsized":"2024-05-09T02:22:53.984777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978087+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:22:53.978087+0000","last_peered":"2024-05-09T02:22:53.978087+0000","last_clean":"2024-05-09T02:22:53.978087+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:22:53.978087+0000","last_undegraded":"2024-05-09T02:22:53.978087+0000","last_fullsized":"2024-05-09T02:22:53.978087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'9","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.987000+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:22:56.987000+0000","last_peered":"2024-05-09T02:22:56.987000+0000","last_clean":"2024-05-09T02:22:56.987000+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:22:56.987000+0000","last_undegraded":"2024-05-09T02:22:56.987000+0000","last_fullsized":"2024-05-09T02:22:56.987000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971053+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:22:53.971053+0000","last_peered":"2024-05-09T02:22:53.971053+0000","last_clean":"2024-05-09T02:22:53.971053+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:22:53.971053+0000","last_undegraded":"2024-05-09T02:22:53.971053+0000","last_fullsized":"2024-05-09T02:22:53.971053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"32'219","reported_seq":247,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107776+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:22:54.107776+0000","last_peered":"2024-05-09T02:22:54.107776+0000","last_clean":"2024-05-09T02:22:54.107776+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:22:54.107776+0000","last_undegraded":"2024-05-09T02:22:54.107776+0000","last_fullsized":"2024-05-09T02:22:54.107776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980895+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:22:53.980895+0000","last_peered":"2024-05-09T02:22:53.980895+0000","last_clean":"2024-05-09T02:22:53.980895+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:22:53.980895+0000","last_undegraded":"2024-05-09T02:22:53.980895+0000","last_fullsized":"2024-05-09T02:22:53.980895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985168+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:22:53.985168+0000","last_peered":"2024-05-09T02:22:53.985168+0000","last_clean":"2024-05-09T02:22:53.985168+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:22:53.985168+0000","last_undegraded":"2024-05-09T02:22:53.985168+0000","last_fullsized":"2024-05-09T02:22:53.985168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107190+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:22:54.107190+0000","last_peered":"2024-05-09T02:22:54.107190+0000","last_clean":"2024-05-09T02:22:54.107190+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:22:54.107190+0000","last_undegraded":"2024-05-09T02:22:54.107190+0000","last_fullsized":"2024-05-09T02:22:54.107190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977431+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:22:53.977431+0000","last_peered":"2024-05-09T02:22:53.977431+0000","last_clean":"2024-05-09T02:22:53.977431+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:22:53.977431+0000","last_undegraded":"2024-05-09T02:22:53.977431+0000","last_fullsized":"2024-05-09T02:22:53.977431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108124+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:22:54.108124+0000","last_peered":"2024-05-09T02:22:54.108124+0000","last_clean":"2024-05-09T02:22:54.108124+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:22:54.108124+0000","last_undegraded":"2024-05-09T02:22:54.108124+0000","last_fullsized":"2024-05-09T02:22:54.108124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'111","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576573+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:23:01.576573+0000","last_peered":"2024-05-09T02:23:01.576573+0000","last_clean":"2024-05-09T02:23:01.576573+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:23:01.576573+0000","last_undegraded":"2024-05-09T02:23:01.576573+0000","last_fullsized":"2024-05-09T02:23:01.576573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":214,"num_write":106,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985967+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:22:53.985967+0000","last_peered":"2024-05-09T02:22:53.985967+0000","last_clean":"2024-05-09T02:22:53.985967+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:22:53.985967+0000","last_undegraded":"2024-05-09T02:22:53.985967+0000","last_fullsized":"2024-05-09T02:22:53.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'148","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969742+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:22:53.969742+0000","last_peered":"2024-05-09T02:22:53.969742+0000","last_clean":"2024-05-09T02:22:53.969742+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:22:53.969742+0000","last_undegraded":"2024-05-09T02:22:53.969742+0000","last_fullsized":"2024-05-09T02:22:53.969742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.577018+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:22:56.577018+0000","last_peered":"2024-05-09T02:22:56.577018+0000","last_clean":"2024-05-09T02:22:56.577018+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:22:56.577018+0000","last_undegraded":"2024-05-09T02:22:56.577018+0000","last_fullsized":"2024-05-09T02:22:56.577018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108115+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:22:54.108115+0000","last_peered":"2024-05-09T02:22:54.108115+0000","last_clean":"2024-05-09T02:22:54.108115+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:22:54.108115+0000","last_undegraded":"2024-05-09T02:22:54.108115+0000","last_fullsized":"2024-05-09T02:22:54.108115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"32'156","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984948+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:22:53.984948+0000","last_peered":"2024-05-09T02:22:53.984948+0000","last_clean":"2024-05-09T02:22:53.984948+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:22:53.984948+0000","last_undegraded":"2024-05-09T02:22:53.984948+0000","last_fullsized":"2024-05-09T02:22:53.984948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977657+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:22:53.977657+0000","last_peered":"2024-05-09T02:22:53.977657+0000","last_clean":"2024-05-09T02:22:53.977657+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:22:53.977657+0000","last_undegraded":"2024-05-09T02:22:53.977657+0000","last_fullsized":"2024-05-09T02:22:53.977657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'111","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:03.257459+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:23:03.257459+0000","last_peered":"2024-05-09T02:23:03.257459+0000","last_clean":"2024-05-09T02:23:03.257459+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:23:03.257459+0000","last_undegraded":"2024-05-09T02:23:03.257459+0000","last_fullsized":"2024-05-09T02:23:03.257459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":234,"num_write":106,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971080+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:22:53.971080+0000","last_peered":"2024-05-09T02:22:53.971080+0000","last_clean":"2024-05-09T02:22:53.971080+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:22:53.971080+0000","last_undegraded":"2024-05-09T02:22:53.971080+0000","last_fullsized":"2024-05-09T02:22:53.971080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"32'148","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971367+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:22:53.971367+0000","last_peered":"2024-05-09T02:22:53.971367+0000","last_clean":"2024-05-09T02:22:53.971367+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:22:53.971367+0000","last_undegraded":"2024-05-09T02:22:53.971367+0000","last_fullsized":"2024-05-09T02:22:53.971367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971892+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:22:53.971892+0000","last_peered":"2024-05-09T02:22:53.971892+0000","last_clean":"2024-05-09T02:22:53.971892+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:22:53.971892+0000","last_undegraded":"2024-05-09T02:22:53.971892+0000","last_fullsized":"2024-05-09T02:22:53.971892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.982899+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:22:58.982899+0000","last_peered":"2024-05-09T02:22:58.982899+0000","last_clean":"2024-05-09T02:22:58.982899+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:22:58.982899+0000","last_undegraded":"2024-05-09T02:22:58.982899+0000","last_fullsized":"2024-05-09T02:22:58.982899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970598+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:22:53.970598+0000","last_peered":"2024-05-09T02:22:53.970598+0000","last_clean":"2024-05-09T02:22:53.970598+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:22:53.970598+0000","last_undegraded":"2024-05-09T02:22:53.970598+0000","last_fullsized":"2024-05-09T02:22:53.970598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980486+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:22:53.980486+0000","last_peered":"2024-05-09T02:22:53.980486+0000","last_clean":"2024-05-09T02:22:53.980486+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:22:53.980486+0000","last_undegraded":"2024-05-09T02:22:53.980486+0000","last_fullsized":"2024-05-09T02:22:53.980486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969761+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:22:53.969761+0000","last_peered":"2024-05-09T02:22:53.969761+0000","last_clean":"2024-05-09T02:22:53.969761+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:22:53.969761+0000","last_undegraded":"2024-05-09T02:22:53.969761+0000","last_fullsized":"2024-05-09T02:22:53.969761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108042+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:22:54.108042+0000","last_peered":"2024-05-09T02:22:54.108042+0000","last_clean":"2024-05-09T02:22:54.108042+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:22:54.108042+0000","last_undegraded":"2024-05-09T02:22:54.108042+0000","last_fullsized":"2024-05-09T02:22:54.108042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576515+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:23:01.576515+0000","last_peered":"2024-05-09T02:23:01.576515+0000","last_clean":"2024-05-09T02:23:01.576515+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:23:01.576515+0000","last_undegraded":"2024-05-09T02:23:01.576515+0000","last_fullsized":"2024-05-09T02:23:01.576515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'159","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977100+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:22:53.977100+0000","last_peered":"2024-05-09T02:22:53.977100+0000","last_clean":"2024-05-09T02:22:53.977100+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:22:53.977100+0000","last_undegraded":"2024-05-09T02:22:53.977100+0000","last_fullsized":"2024-05-09T02:22:53.977100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'219","reported_seq":241,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978920+0000","last_change":"2024-05-09T02:18:55.680482+0000","last_active":"2024-05-09T02:22:53.978920+0000","last_peered":"2024-05-09T02:22:53.978920+0000","last_clean":"2024-05-09T02:22:53.978920+0000","last_became_active":"2024-05-09T02:18:55.680219+0000","last_became_peered":"2024-05-09T02:18:55.680219+0000","last_unstale":"2024-05-09T02:22:53.978920+0000","last_undegraded":"2024-05-09T02:22:53.978920+0000","last_fullsized":"2024-05-09T02:22:53.978920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:13.255019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.977541+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:22:58.977541+0000","last_peered":"2024-05-09T02:22:58.977541+0000","last_clean":"2024-05-09T02:22:58.977541+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:22:58.977541+0000","last_undegraded":"2024-05-09T02:22:58.977541+0000","last_fullsized":"2024-05-09T02:22:58.977541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984423+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:22:53.984423+0000","last_peered":"2024-05-09T02:22:53.984423+0000","last_clean":"2024-05-09T02:22:53.984423+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:22:53.984423+0000","last_undegraded":"2024-05-09T02:22:53.984423+0000","last_fullsized":"2024-05-09T02:22:53.984423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981396+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:22:53.981396+0000","last_peered":"2024-05-09T02:22:53.981396+0000","last_clean":"2024-05-09T02:22:53.981396+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:22:53.981396+0000","last_undegraded":"2024-05-09T02:22:53.981396+0000","last_fullsized":"2024-05-09T02:22:53.981396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970678+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:22:53.970678+0000","last_peered":"2024-05-09T02:22:53.970678+0000","last_clean":"2024-05-09T02:22:53.970678+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:22:53.970678+0000","last_undegraded":"2024-05-09T02:22:53.970678+0000","last_fullsized":"2024-05-09T02:22:53.970678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971820+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:22:53.971820+0000","last_peered":"2024-05-09T02:22:53.971820+0000","last_clean":"2024-05-09T02:22:53.971820+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:22:53.971820+0000","last_undegraded":"2024-05-09T02:22:53.971820+0000","last_fullsized":"2024-05-09T02:22:53.971820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107588+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:22:54.107588+0000","last_peered":"2024-05-09T02:22:54.107588+0000","last_clean":"2024-05-09T02:22:54.107588+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:22:54.107588+0000","last_undegraded":"2024-05-09T02:22:54.107588+0000","last_fullsized":"2024-05-09T02:22:54.107588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"32'147","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970333+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:22:53.970333+0000","last_peered":"2024-05-09T02:22:53.970333+0000","last_clean":"2024-05-09T02:22:53.970333+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:22:53.970333+0000","last_undegraded":"2024-05-09T02:22:53.970333+0000","last_fullsized":"2024-05-09T02:22:53.970333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981757+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:22:53.981757+0000","last_peered":"2024-05-09T02:22:53.981757+0000","last_clean":"2024-05-09T02:22:53.981757+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:22:53.981757+0000","last_undegraded":"2024-05-09T02:22:53.981757+0000","last_fullsized":"2024-05-09T02:22:53.981757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'162","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970351+0000","last_change":"2024-05-09T02:18:55.678178+0000","last_active":"2024-05-09T02:22:53.970351+0000","last_peered":"2024-05-09T02:22:53.970351+0000","last_clean":"2024-05-09T02:22:53.970351+0000","last_became_active":"2024-05-09T02:18:55.677782+0000","last_became_peered":"2024-05-09T02:18:55.677782+0000","last_unstale":"2024-05-09T02:22:53.970351+0000","last_undegraded":"2024-05-09T02:22:53.970351+0000","last_fullsized":"2024-05-09T02:22:53.970351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:03.517417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984692+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:22:53.984692+0000","last_peered":"2024-05-09T02:22:53.984692+0000","last_clean":"2024-05-09T02:22:53.984692+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:22:53.984692+0000","last_undegraded":"2024-05-09T02:22:53.984692+0000","last_fullsized":"2024-05-09T02:22:53.984692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'168","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974606+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:22:53.974606+0000","last_peered":"2024-05-09T02:22:53.974606+0000","last_clean":"2024-05-09T02:22:53.974606+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:22:53.974606+0000","last_undegraded":"2024-05-09T02:22:53.974606+0000","last_fullsized":"2024-05-09T02:22:53.974606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981322+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:22:53.981322+0000","last_peered":"2024-05-09T02:22:53.981322+0000","last_clean":"2024-05-09T02:22:53.981322+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:22:53.981322+0000","last_undegraded":"2024-05-09T02:22:53.981322+0000","last_fullsized":"2024-05-09T02:22:53.981322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'129","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971974+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:22:53.971974+0000","last_peered":"2024-05-09T02:22:53.971974+0000","last_clean":"2024-05-09T02:22:53.971974+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:22:53.971974+0000","last_undegraded":"2024-05-09T02:22:53.971974+0000","last_fullsized":"2024-05-09T02:22:53.971974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978910+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:22:53.978910+0000","last_peered":"2024-05-09T02:22:53.978910+0000","last_clean":"2024-05-09T02:22:53.978910+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:22:53.978910+0000","last_undegraded":"2024-05-09T02:22:53.978910+0000","last_fullsized":"2024-05-09T02:22:53.978910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970562+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:22:53.970562+0000","last_peered":"2024-05-09T02:22:53.970562+0000","last_clean":"2024-05-09T02:22:53.970562+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:22:53.970562+0000","last_undegraded":"2024-05-09T02:22:53.970562+0000","last_fullsized":"2024-05-09T02:22:53.970562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986431+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:22:53.986431+0000","last_peered":"2024-05-09T02:22:53.986431+0000","last_clean":"2024-05-09T02:22:53.986431+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:22:53.986431+0000","last_undegraded":"2024-05-09T02:22:53.986431+0000","last_fullsized":"2024-05-09T02:22:53.986431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971985+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:22:53.971985+0000","last_peered":"2024-05-09T02:22:53.971985+0000","last_clean":"2024-05-09T02:22:53.971985+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:22:53.971985+0000","last_undegraded":"2024-05-09T02:22:53.971985+0000","last_fullsized":"2024-05-09T02:22:53.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985776+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:22:53.985776+0000","last_peered":"2024-05-09T02:22:53.985776+0000","last_clean":"2024-05-09T02:22:53.985776+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:22:53.985776+0000","last_undegraded":"2024-05-09T02:22:53.985776+0000","last_fullsized":"2024-05-09T02:22:53.985776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985967+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:22:53.985967+0000","last_peered":"2024-05-09T02:22:53.985967+0000","last_clean":"2024-05-09T02:22:53.985967+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:22:53.985967+0000","last_undegraded":"2024-05-09T02:22:53.985967+0000","last_fullsized":"2024-05-09T02:22:53.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980177+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:22:53.980177+0000","last_peered":"2024-05-09T02:22:53.980177+0000","last_clean":"2024-05-09T02:22:53.980177+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:22:53.980177+0000","last_undegraded":"2024-05-09T02:22:53.980177+0000","last_fullsized":"2024-05-09T02:22:53.980177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974939+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:22:53.974939+0000","last_peered":"2024-05-09T02:22:53.974939+0000","last_clean":"2024-05-09T02:22:53.974939+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:22:53.974939+0000","last_undegraded":"2024-05-09T02:22:53.974939+0000","last_fullsized":"2024-05-09T02:22:53.974939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978061+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:22:53.978061+0000","last_peered":"2024-05-09T02:22:53.978061+0000","last_clean":"2024-05-09T02:22:53.978061+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:22:53.978061+0000","last_undegraded":"2024-05-09T02:22:53.978061+0000","last_fullsized":"2024-05-09T02:22:53.978061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107639+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:22:54.107639+0000","last_peered":"2024-05-09T02:22:54.107639+0000","last_clean":"2024-05-09T02:22:54.107639+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:22:54.107639+0000","last_undegraded":"2024-05-09T02:22:54.107639+0000","last_fullsized":"2024-05-09T02:22:54.107639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107926+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:22:54.107926+0000","last_peered":"2024-05-09T02:22:54.107926+0000","last_clean":"2024-05-09T02:22:54.107926+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:22:54.107926+0000","last_undegraded":"2024-05-09T02:22:54.107926+0000","last_fullsized":"2024-05-09T02:22:54.107926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974583+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:22:53.974583+0000","last_peered":"2024-05-09T02:22:53.974583+0000","last_clean":"2024-05-09T02:22:53.974583+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:22:53.974583+0000","last_undegraded":"2024-05-09T02:22:53.974583+0000","last_fullsized":"2024-05-09T02:22:53.974583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"31'111","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971307+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:22:53.971307+0000","last_peered":"2024-05-09T02:22:53.971307+0000","last_clean":"2024-05-09T02:22:53.971307+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:22:53.971307+0000","last_undegraded":"2024-05-09T02:22:53.971307+0000","last_fullsized":"2024-05-09T02:22:53.971307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"32'123","reported_seq":153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976759+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:22:53.976759+0000","last_peered":"2024-05-09T02:22:53.976759+0000","last_clean":"2024-05-09T02:22:53.976759+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:22:53.976759+0000","last_undegraded":"2024-05-09T02:22:53.976759+0000","last_fullsized":"2024-05-09T02:22:53.976759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"31'129","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986301+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:22:53.986301+0000","last_peered":"2024-05-09T02:22:53.986301+0000","last_clean":"2024-05-09T02:22:53.986301+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:22:53.986301+0000","last_undegraded":"2024-05-09T02:22:53.986301+0000","last_fullsized":"2024-05-09T02:22:53.986301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"32'111","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970144+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:22:53.970144+0000","last_peered":"2024-05-09T02:22:53.970144+0000","last_clean":"2024-05-09T02:22:53.970144+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:22:53.970144+0000","last_undegraded":"2024-05-09T02:22:53.970144+0000","last_fullsized":"2024-05-09T02:22:53.970144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975059+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:22:53.975059+0000","last_peered":"2024-05-09T02:22:53.975059+0000","last_clean":"2024-05-09T02:22:53.975059+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:22:53.975059+0000","last_undegraded":"2024-05-09T02:22:53.975059+0000","last_fullsized":"2024-05-09T02:22:53.975059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976427+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:22:53.976427+0000","last_peered":"2024-05-09T02:22:53.976427+0000","last_clean":"2024-05-09T02:22:53.976427+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:22:53.976427+0000","last_undegraded":"2024-05-09T02:22:53.976427+0000","last_fullsized":"2024-05-09T02:22:53.976427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981218+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:22:53.981218+0000","last_peered":"2024-05-09T02:22:53.981218+0000","last_clean":"2024-05-09T02:22:53.981218+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:22:53.981218+0000","last_undegraded":"2024-05-09T02:22:53.981218+0000","last_fullsized":"2024-05-09T02:22:53.981218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'132","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985334+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:22:53.985334+0000","last_peered":"2024-05-09T02:22:53.985334+0000","last_clean":"2024-05-09T02:22:53.985334+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:22:53.985334+0000","last_undegraded":"2024-05-09T02:22:53.985334+0000","last_fullsized":"2024-05-09T02:22:53.985334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"32'147","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985603+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:22:53.985603+0000","last_peered":"2024-05-09T02:22:53.985603+0000","last_clean":"2024-05-09T02:22:53.985603+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:22:53.985603+0000","last_undegraded":"2024-05-09T02:22:53.985603+0000","last_fullsized":"2024-05-09T02:22:53.985603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'174","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107316+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:22:54.107316+0000","last_peered":"2024-05-09T02:22:54.107316+0000","last_clean":"2024-05-09T02:22:54.107316+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:22:54.107316+0000","last_undegraded":"2024-05-09T02:22:54.107316+0000","last_fullsized":"2024-05-09T02:22:54.107316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978652+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:22:53.978652+0000","last_peered":"2024-05-09T02:22:53.978652+0000","last_clean":"2024-05-09T02:22:53.978652+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:22:53.978652+0000","last_undegraded":"2024-05-09T02:22:53.978652+0000","last_fullsized":"2024-05-09T02:22:53.978652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"31'126","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984607+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:22:53.984607+0000","last_peered":"2024-05-09T02:22:53.984607+0000","last_clean":"2024-05-09T02:22:53.984607+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:22:53.984607+0000","last_undegraded":"2024-05-09T02:22:53.984607+0000","last_fullsized":"2024-05-09T02:22:53.984607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"32'153","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978575+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:22:53.978575+0000","last_peered":"2024-05-09T02:22:53.978575+0000","last_clean":"2024-05-09T02:22:53.978575+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:22:53.978575+0000","last_undegraded":"2024-05-09T02:22:53.978575+0000","last_fullsized":"2024-05-09T02:22:53.978575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"31'156","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107220+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:22:54.107220+0000","last_peered":"2024-05-09T02:22:54.107220+0000","last_clean":"2024-05-09T02:22:54.107220+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:22:54.107220+0000","last_undegraded":"2024-05-09T02:22:54.107220+0000","last_fullsized":"2024-05-09T02:22:54.107220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"32'165","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984760+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:22:53.984760+0000","last_peered":"2024-05-09T02:22:53.984760+0000","last_clean":"2024-05-09T02:22:53.984760+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:22:53.984760+0000","last_undegraded":"2024-05-09T02:22:53.984760+0000","last_fullsized":"2024-05-09T02:22:53.984760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970590+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:22:53.970590+0000","last_peered":"2024-05-09T02:22:53.970590+0000","last_clean":"2024-05-09T02:22:53.970590+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:22:53.970590+0000","last_undegraded":"2024-05-09T02:22:53.970590+0000","last_fullsized":"2024-05-09T02:22:53.970590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"32'156","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971445+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:22:53.971445+0000","last_peered":"2024-05-09T02:22:53.971445+0000","last_clean":"2024-05-09T02:22:53.971445+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:22:53.971445+0000","last_undegraded":"2024-05-09T02:22:53.971445+0000","last_fullsized":"2024-05-09T02:22:53.971445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'153","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980789+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:22:53.980789+0000","last_peered":"2024-05-09T02:22:53.980789+0000","last_clean":"2024-05-09T02:22:53.980789+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:22:53.980789+0000","last_undegraded":"2024-05-09T02:22:53.980789+0000","last_fullsized":"2024-05-09T02:22:53.980789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970169+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:22:53.970169+0000","last_peered":"2024-05-09T02:22:53.970169+0000","last_clean":"2024-05-09T02:22:53.970169+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:22:53.970169+0000","last_undegraded":"2024-05-09T02:22:53.970169+0000","last_fullsized":"2024-05-09T02:22:53.970169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"31'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978983+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:22:53.978983+0000","last_peered":"2024-05-09T02:22:53.978983+0000","last_clean":"2024-05-09T02:22:53.978983+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:22:53.978983+0000","last_undegraded":"2024-05-09T02:22:53.978983+0000","last_fullsized":"2024-05-09T02:22:53.978983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"32'174","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106722+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:22:54.106722+0000","last_peered":"2024-05-09T02:22:54.106722+0000","last_clean":"2024-05-09T02:22:54.106722+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:22:54.106722+0000","last_undegraded":"2024-05-09T02:22:54.106722+0000","last_fullsized":"2024-05-09T02:22:54.106722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979771+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:22:53.979771+0000","last_peered":"2024-05-09T02:22:53.979771+0000","last_clean":"2024-05-09T02:22:53.979771+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:22:53.979771+0000","last_undegraded":"2024-05-09T02:22:53.979771+0000","last_fullsized":"2024-05-09T02:22:53.979771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.968919+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:22:53.968919+0000","last_peered":"2024-05-09T02:22:53.968919+0000","last_clean":"2024-05-09T02:22:53.968919+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:22:53.968919+0000","last_undegraded":"2024-05-09T02:22:53.968919+0000","last_fullsized":"2024-05-09T02:22:53.968919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"31'138","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979922+0000","last_change":"2024-05-09T02:18:55.680326+0000","last_active":"2024-05-09T02:22:53.979922+0000","last_peered":"2024-05-09T02:22:53.979922+0000","last_clean":"2024-05-09T02:22:53.979922+0000","last_became_active":"2024-05-09T02:18:55.680014+0000","last_became_peered":"2024-05-09T02:18:55.680014+0000","last_unstale":"2024-05-09T02:22:53.979922+0000","last_undegraded":"2024-05-09T02:22:53.979922+0000","last_fullsized":"2024-05-09T02:22:53.979922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:40.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"32'141","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974615+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:22:53.974615+0000","last_peered":"2024-05-09T02:22:53.974615+0000","last_clean":"2024-05-09T02:22:53.974615+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:22:53.974615+0000","last_undegraded":"2024-05-09T02:22:53.974615+0000","last_fullsized":"2024-05-09T02:22:53.974615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107142+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:22:54.107142+0000","last_peered":"2024-05-09T02:22:54.107142+0000","last_clean":"2024-05-09T02:22:54.107142+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:22:54.107142+0000","last_undegraded":"2024-05-09T02:22:54.107142+0000","last_fullsized":"2024-05-09T02:22:54.107142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971005+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:22:53.971005+0000","last_peered":"2024-05-09T02:22:53.971005+0000","last_clean":"2024-05-09T02:22:53.971005+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:22:53.971005+0000","last_undegraded":"2024-05-09T02:22:53.971005+0000","last_fullsized":"2024-05-09T02:22:53.971005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971840+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:22:53.971840+0000","last_peered":"2024-05-09T02:22:53.971840+0000","last_clean":"2024-05-09T02:22:53.971840+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:22:53.971840+0000","last_undegraded":"2024-05-09T02:22:53.971840+0000","last_fullsized":"2024-05-09T02:22:53.971840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"32'135","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107391+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:22:54.107391+0000","last_peered":"2024-05-09T02:22:54.107391+0000","last_clean":"2024-05-09T02:22:54.107391+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:22:54.107391+0000","last_undegraded":"2024-05-09T02:22:54.107391+0000","last_fullsized":"2024-05-09T02:22:54.107391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969430+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:22:53.969430+0000","last_peered":"2024-05-09T02:22:53.969430+0000","last_clean":"2024-05-09T02:22:53.969430+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:22:53.969430+0000","last_undegraded":"2024-05-09T02:22:53.969430+0000","last_fullsized":"2024-05-09T02:22:53.969430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977362+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:22:53.977362+0000","last_peered":"2024-05-09T02:22:53.977362+0000","last_clean":"2024-05-09T02:22:53.977362+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:22:53.977362+0000","last_undegraded":"2024-05-09T02:22:53.977362+0000","last_fullsized":"2024-05-09T02:22:53.977362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985367+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:22:53.985367+0000","last_peered":"2024-05-09T02:22:53.985367+0000","last_clean":"2024-05-09T02:22:53.985367+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:22:53.985367+0000","last_undegraded":"2024-05-09T02:22:53.985367+0000","last_fullsized":"2024-05-09T02:22:53.985367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985382+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:22:53.985382+0000","last_peered":"2024-05-09T02:22:53.985382+0000","last_clean":"2024-05-09T02:22:53.985382+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:22:53.985382+0000","last_undegraded":"2024-05-09T02:22:53.985382+0000","last_fullsized":"2024-05-09T02:22:53.985382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971405+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:22:53.971405+0000","last_peered":"2024-05-09T02:22:53.971405+0000","last_clean":"2024-05-09T02:22:53.971405+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:22:53.971405+0000","last_undegraded":"2024-05-09T02:22:53.971405+0000","last_fullsized":"2024-05-09T02:22:53.971405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"32'141","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978785+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:22:53.978785+0000","last_peered":"2024-05-09T02:22:53.978785+0000","last_clean":"2024-05-09T02:22:53.978785+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:22:53.978785+0000","last_undegraded":"2024-05-09T02:22:53.978785+0000","last_fullsized":"2024-05-09T02:22:53.978785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980636+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:22:53.980636+0000","last_peered":"2024-05-09T02:22:53.980636+0000","last_clean":"2024-05-09T02:22:53.980636+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:22:53.980636+0000","last_undegraded":"2024-05-09T02:22:53.980636+0000","last_fullsized":"2024-05-09T02:22:53.980636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981266+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:22:53.981266+0000","last_peered":"2024-05-09T02:22:53.981266+0000","last_clean":"2024-05-09T02:22:53.981266+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:22:53.981266+0000","last_undegraded":"2024-05-09T02:22:53.981266+0000","last_fullsized":"2024-05-09T02:22:53.981266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106954+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:22:54.106954+0000","last_peered":"2024-05-09T02:22:54.106954+0000","last_clean":"2024-05-09T02:22:54.106954+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:22:54.106954+0000","last_undegraded":"2024-05-09T02:22:54.106954+0000","last_fullsized":"2024-05-09T02:22:54.106954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"32'126","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985089+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:22:53.985089+0000","last_peered":"2024-05-09T02:22:53.985089+0000","last_clean":"2024-05-09T02:22:53.985089+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:22:53.985089+0000","last_undegraded":"2024-05-09T02:22:53.985089+0000","last_fullsized":"2024-05-09T02:22:53.985089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984760+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:22:53.984760+0000","last_peered":"2024-05-09T02:22:53.984760+0000","last_clean":"2024-05-09T02:22:53.984760+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:22:53.984760+0000","last_undegraded":"2024-05-09T02:22:53.984760+0000","last_fullsized":"2024-05-09T02:22:53.984760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981348+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:22:53.981348+0000","last_peered":"2024-05-09T02:22:53.981348+0000","last_clean":"2024-05-09T02:22:53.981348+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:22:53.981348+0000","last_undegraded":"2024-05-09T02:22:53.981348+0000","last_fullsized":"2024-05-09T02:22:53.981348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977532+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:22:53.977532+0000","last_peered":"2024-05-09T02:22:53.977532+0000","last_clean":"2024-05-09T02:22:53.977532+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:22:53.977532+0000","last_undegraded":"2024-05-09T02:22:53.977532+0000","last_fullsized":"2024-05-09T02:22:53.977532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"32'165","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970629+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:22:53.970629+0000","last_peered":"2024-05-09T02:22:53.970629+0000","last_clean":"2024-05-09T02:22:53.970629+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:22:53.970629+0000","last_undegraded":"2024-05-09T02:22:53.970629+0000","last_fullsized":"2024-05-09T02:22:53.970629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'129","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107103+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:22:54.107103+0000","last_peered":"2024-05-09T02:22:54.107103+0000","last_clean":"2024-05-09T02:22:54.107103+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:22:54.107103+0000","last_undegraded":"2024-05-09T02:22:54.107103+0000","last_fullsized":"2024-05-09T02:22:54.107103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107507+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:22:54.107507+0000","last_peered":"2024-05-09T02:22:54.107507+0000","last_clean":"2024-05-09T02:22:54.107507+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:22:54.107507+0000","last_undegraded":"2024-05-09T02:22:54.107507+0000","last_fullsized":"2024-05-09T02:22:54.107507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977075+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:22:53.977075+0000","last_peered":"2024-05-09T02:22:53.977075+0000","last_clean":"2024-05-09T02:22:53.977075+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:22:53.977075+0000","last_undegraded":"2024-05-09T02:22:53.977075+0000","last_fullsized":"2024-05-09T02:22:53.977075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984863+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:22:53.984863+0000","last_peered":"2024-05-09T02:22:53.984863+0000","last_clean":"2024-05-09T02:22:53.984863+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:22:53.984863+0000","last_undegraded":"2024-05-09T02:22:53.984863+0000","last_fullsized":"2024-05-09T02:22:53.984863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'165","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108415+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:22:54.108415+0000","last_peered":"2024-05-09T02:22:54.108415+0000","last_clean":"2024-05-09T02:22:54.108415+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:22:54.108415+0000","last_undegraded":"2024-05-09T02:22:54.108415+0000","last_fullsized":"2024-05-09T02:22:54.108415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978390+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:22:53.978390+0000","last_peered":"2024-05-09T02:22:53.978390+0000","last_clean":"2024-05-09T02:22:53.978390+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:22:53.978390+0000","last_undegraded":"2024-05-09T02:22:53.978390+0000","last_fullsized":"2024-05-09T02:22:53.978390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969841+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:22:53.969841+0000","last_peered":"2024-05-09T02:22:53.969841+0000","last_clean":"2024-05-09T02:22:53.969841+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:22:53.969841+0000","last_undegraded":"2024-05-09T02:22:53.969841+0000","last_fullsized":"2024-05-09T02:22:53.969841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"32'177","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976418+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:22:53.976418+0000","last_peered":"2024-05-09T02:22:53.976418+0000","last_clean":"2024-05-09T02:22:53.976418+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:22:53.976418+0000","last_undegraded":"2024-05-09T02:22:53.976418+0000","last_fullsized":"2024-05-09T02:22:53.976418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"31'126","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974807+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:22:53.974807+0000","last_peered":"2024-05-09T02:22:53.974807+0000","last_clean":"2024-05-09T02:22:53.974807+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:22:53.974807+0000","last_undegraded":"2024-05-09T02:22:53.974807+0000","last_fullsized":"2024-05-09T02:22:53.974807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"32'159","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976524+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:22:53.976524+0000","last_peered":"2024-05-09T02:22:53.976524+0000","last_clean":"2024-05-09T02:22:53.976524+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:22:53.976524+0000","last_undegraded":"2024-05-09T02:22:53.976524+0000","last_fullsized":"2024-05-09T02:22:53.976524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977969+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:22:53.977969+0000","last_peered":"2024-05-09T02:22:53.977969+0000","last_clean":"2024-05-09T02:22:53.977969+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:22:53.977969+0000","last_undegraded":"2024-05-09T02:22:53.977969+0000","last_fullsized":"2024-05-09T02:22:53.977969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":211620,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":435,"num_write":199,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":423240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216648,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":455,"num_write":196,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":433296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":966656,"data_stored":752122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58128,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313712,"statfs":{"total":96636764160,"available":96577241088,"internally_reserved":0,"allocated":598016,"data_stored":377043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":380928,"data_stored":162349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45444,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326396,"statfs":{"total":96636764160,"available":96590229504,"internally_reserved":0,"allocated":389120,"data_stored":161817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54184,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317656,"statfs":{"total":96636764160,"available":96581279744,"internally_reserved":0,"allocated":819200,"data_stored":587271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":372736,"data_stored":161657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49808,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":598016,"data_stored":371581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50172,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321668,"statfs":{"total":96636764160,"available":96585388032,"internally_reserved":0,"allocated":970752,"data_stored":752088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":215850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":215345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:23:11.885 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:23:12.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.028+0000 7fbf3110d640 1 Processor -- start 2024-05-09T02:23:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.028+0000 7fbf3110d640 1 -- start start 2024-05-09T02:23:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf3110d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c071c10 0x7fbf2c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf3110d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbf2c0c57d0 0x7fbf2c153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf3110d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2c155c90 con 0x7fbf2c0c7650 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf3110d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c0caac0 con 0x7fbf2c0c57d0 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf3110d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c0ca2b0 con 0x7fbf2c071c10 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf2b59e640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbf2c0c7650 0x7fbf2c156170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45044/0 (socket says 172.21.15.46:45044) 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf2b59e640 1 -- 172.21.15.46:0/1723791173 learned_addr learned my addr 172.21.15.46:0/1723791173 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf2ad9d640 1 --2- 172.21.15.46:0/1723791173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c071c10 0x7fbf2c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf2a59c640 1 --2- 172.21.15.46:0/1723791173 >> v2:172.21.15.107:3300/0 conn(0x7fbf2c0c57d0 0x7fbf2c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf29d9b640 1 -- 172.21.15.46:0/1723791173 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 462699468 0 0) 0x7fbf2c155c90 con 0x7fbf2c0c7650 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf29d9b640 1 -- 172.21.15.46:0/1723791173 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf18003520 con 0x7fbf2c0c7650 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/1723791173 >> v2:172.21.15.107:3300/0 conn(0x7fbf2c0c57d0 msgr2=0x7fbf2c153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.029+0000 7fbf2ad9d640 1 --2- 172.21.15.46:0/1723791173 >> v2:172.21.15.107:3300/0 conn(0x7fbf2c0c57d0 0x7fbf2c153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.030+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/1723791173 >> v1:172.21.15.46:6789/0 conn(0x7fbf2c0c7650 legacy=0x7fbf2c156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.030+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/1723791173 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c0ca500 con 0x7fbf2c071c10 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.030+0000 7fbf2ad9d640 1 --2- 172.21.15.46:0/1723791173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c071c10 0x7fbf2c159a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0097a0 tx=0x7fbf1c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde324e81f8f7b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.030+0000 7fbf29d9b640 1 -- 172.21.15.46:0/1723791173 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c037070 con 0x7fbf2c071c10 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.030+0000 7fbf29d9b640 1 -- 172.21.15.46:0/1723791173 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c02ae50 con 0x7fbf2c071c10 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf29d9b640 1 -- 172.21.15.46:0/1723791173 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c032660 con 0x7fbf2c071c10 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 -- 172.21.15.46:0/1723791173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c071c10 msgr2=0x7fbf2c159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 --2- 172.21.15.46:0/1723791173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c071c10 0x7fbf2c159a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0097a0 tx=0x7fbf1c02a100 comp rx=0 tx=0).stop 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 -- 172.21.15.46:0/1723791173 shutdown_connections 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 --2- 172.21.15.46:0/1723791173 >> v2:172.21.15.107:3300/0 conn(0x7fbf2c0c57d0 0x7fbf2c153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 --2- 172.21.15.46:0/1723791173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c071c10 0x7fbf2c159a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 -- 172.21.15.46:0/1723791173 >> 172.21.15.46:0/1723791173 conn(0x7fbf2c0ac930 msgr2=0x7fbf2c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 -- 172.21.15.46:0/1723791173 shutdown_connections 2024-05-09T02:23:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.031+0000 7fbf3110d640 1 -- 172.21.15.46:0/1723791173 wait complete. 2024-05-09T02:23:12.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.033+0000 7fbf3110d640 1 Processor -- start 2024-05-09T02:23:12.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.033+0000 7fbf3110d640 1 -- start start 2024-05-09T02:23:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf3110d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 0x7fbf2c1f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf3110d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c0c57d0 0x7fbf2c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf3110d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2c0c7650 0x7fbf2c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf3110d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c0c6040 con 0x7fbf2c071c10 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf3110d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c153640 con 0x7fbf2c0c7650 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf3110d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c156880 con 0x7fbf2c0c57d0 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf2ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 0x7fbf2c1f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.034+0000 7fbf2ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 0x7fbf2c1f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59318/0 (socket says 172.21.15.46:59318) 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/296325537 learned_addr learned my addr 172.21.15.46:0/296325537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2b59e640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2c0c7650 0x7fbf2c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2a59c640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c0c57d0 0x7fbf2c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c0c57d0 msgr2=0x7fbf2c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c0c57d0 0x7fbf2c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2c0c7650 msgr2=0x7fbf2c14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2c0c7650 0x7fbf2c14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 -- 172.21.15.46:0/296325537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c1f0860 con 0x7fbf2c071c10 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf2ad9d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 0x7fbf2c1f1340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0098c0 tx=0x7fbf1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c042070 con 0x7fbf2c071c10 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c03e460 con 0x7fbf2c071c10 2024-05-09T02:23:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c1f0b40 con 0x7fbf2c071c10 2024-05-09T02:23:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c037040 con 0x7fbf2c071c10 2024-05-09T02:23:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.035+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c1ed770 con 0x7fbf2c071c10 2024-05-09T02:23:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.036+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c06a330 con 0x7fbf2c071c10 2024-05-09T02:23:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.037+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf1c045070 con 0x7fbf2c071c10 2024-05-09T02:23:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.038+0000 7fbf237fe640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbf0c076300 0x7fbf0c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.038+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fbf1c0b8060 con 0x7fbf2c071c10 2024-05-09T02:23:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.038+0000 7fbf2a59c640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbf0c076300 0x7fbf0c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.038+0000 7fbf2a59c640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbf0c076300 0x7fbf0c078810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c150730 tx=0x7fbf14009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.042+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf1c080dd0 con 0x7fbf2c071c10 2024-05-09T02:23:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.230+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf2c1ed9a0 con 0x7fbf0c076300 2024-05-09T02:23:12.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.242+0000 7fbf237fe640 1 -- 172.21.15.46:0/296325537 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492398 (secure 0 0 0) 0x7fbf2c1ed9a0 con 0x7fbf0c076300 2024-05-09T02:23:12.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:23:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbf0c076300 msgr2=0x7fbf0c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbf0c076300 0x7fbf0c078810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c150730 tx=0x7fbf14009190 comp rx=0 tx=0).stop 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 msgr2=0x7fbf2c1f1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 0x7fbf2c1f1340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0098c0 tx=0x7fbf1c0046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 shutdown_connections 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fbf0c076300 0x7fbf0c078810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2c0c7650 0x7fbf2c14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf2c0c57d0 0x7fbf2c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 --2- 172.21.15.46:0/296325537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf2c071c10 0x7fbf2c1f1340 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 >> 172.21.15.46:0/296325537 conn(0x7fbf2c0ac930 msgr2=0x7fbf2c0c95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 shutdown_connections 2024-05-09T02:23:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.246+0000 7fbf3110d640 1 -- 172.21.15.46:0/296325537 wait complete. 2024-05-09T02:23:12.275 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-05-09T02:23:10.588270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018636,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":546,"num_read_kb":945,"num_write":18928,"num_write_kb":50333845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18909,"ondisk_log_size":18909,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415408,"kb_used_data":4976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754559312,"statfs":{"total":773094113280,"available":772668735488,"internally_reserved":0,"allocated":5095424,"data_stored":3325928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":420204083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14884,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":69,"num_write":25,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004215"},"pg_stats":[{"pgid":"5.18","version":"32'162","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969855+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:22:53.969855+0000","last_peered":"2024-05-09T02:22:53.969855+0000","last_clean":"2024-05-09T02:22:53.969855+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:22:53.969855+0000","last_undegraded":"2024-05-09T02:22:53.969855+0000","last_fullsized":"2024-05-09T02:22:53.969855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"33'7","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996769+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:22:53.996769+0000","last_peered":"2024-05-09T02:22:53.996769+0000","last_clean":"2024-05-09T02:22:53.996769+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:22:53.996769+0000","last_undegraded":"2024-05-09T02:22:53.996769+0000","last_fullsized":"2024-05-09T02:22:53.996769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986226+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:22:53.986226+0000","last_peered":"2024-05-09T02:22:53.986226+0000","last_clean":"2024-05-09T02:22:53.986226+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:22:53.986226+0000","last_undegraded":"2024-05-09T02:22:53.986226+0000","last_fullsized":"2024-05-09T02:22:53.986226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984493+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:22:53.984493+0000","last_peered":"2024-05-09T02:22:53.984493+0000","last_clean":"2024-05-09T02:22:53.984493+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:22:53.984493+0000","last_undegraded":"2024-05-09T02:22:53.984493+0000","last_fullsized":"2024-05-09T02:22:53.984493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"32'147","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970416+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:22:53.970416+0000","last_peered":"2024-05-09T02:22:53.970416+0000","last_clean":"2024-05-09T02:22:53.970416+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:22:53.970416+0000","last_undegraded":"2024-05-09T02:22:53.970416+0000","last_fullsized":"2024-05-09T02:22:53.970416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986511+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:22:53.986511+0000","last_peered":"2024-05-09T02:22:53.986511+0000","last_clean":"2024-05-09T02:22:53.986511+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:22:53.986511+0000","last_undegraded":"2024-05-09T02:22:53.986511+0000","last_fullsized":"2024-05-09T02:22:53.986511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969340+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:22:53.969340+0000","last_peered":"2024-05-09T02:22:53.969340+0000","last_clean":"2024-05-09T02:22:53.969340+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:22:53.969340+0000","last_undegraded":"2024-05-09T02:22:53.969340+0000","last_fullsized":"2024-05-09T02:22:53.969340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969867+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:22:53.969867+0000","last_peered":"2024-05-09T02:22:53.969867+0000","last_clean":"2024-05-09T02:22:53.969867+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:22:53.969867+0000","last_undegraded":"2024-05-09T02:22:53.969867+0000","last_fullsized":"2024-05-09T02:22:53.969867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976679+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:22:53.976679+0000","last_peered":"2024-05-09T02:22:53.976679+0000","last_clean":"2024-05-09T02:22:53.976679+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:22:53.976679+0000","last_undegraded":"2024-05-09T02:22:53.976679+0000","last_fullsized":"2024-05-09T02:22:53.976679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.988297+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:22:56.988297+0000","last_peered":"2024-05-09T02:22:56.988297+0000","last_clean":"2024-05-09T02:22:56.988297+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:22:56.988297+0000","last_undegraded":"2024-05-09T02:22:56.988297+0000","last_fullsized":"2024-05-09T02:22:56.988297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'132","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108425+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:22:54.108425+0000","last_peered":"2024-05-09T02:22:54.108425+0000","last_clean":"2024-05-09T02:22:54.108425+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:22:54.108425+0000","last_undegraded":"2024-05-09T02:22:54.108425+0000","last_fullsized":"2024-05-09T02:22:54.108425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970514+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:22:53.970514+0000","last_peered":"2024-05-09T02:22:53.970514+0000","last_clean":"2024-05-09T02:22:53.970514+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:22:53.970514+0000","last_undegraded":"2024-05-09T02:22:53.970514+0000","last_fullsized":"2024-05-09T02:22:53.970514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107050+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:22:54.107050+0000","last_peered":"2024-05-09T02:22:54.107050+0000","last_clean":"2024-05-09T02:22:54.107050+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:22:54.107050+0000","last_undegraded":"2024-05-09T02:22:54.107050+0000","last_fullsized":"2024-05-09T02:22:54.107050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984071+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:22:56.984071+0000","last_peered":"2024-05-09T02:22:56.984071+0000","last_clean":"2024-05-09T02:22:56.984071+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:22:56.984071+0000","last_undegraded":"2024-05-09T02:22:56.984071+0000","last_fullsized":"2024-05-09T02:22:56.984071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'168","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108041+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:22:54.108041+0000","last_peered":"2024-05-09T02:22:54.108041+0000","last_clean":"2024-05-09T02:22:54.108041+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:22:54.108041+0000","last_undegraded":"2024-05-09T02:22:54.108041+0000","last_fullsized":"2024-05-09T02:22:54.108041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971555+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:22:53.971555+0000","last_peered":"2024-05-09T02:22:53.971555+0000","last_clean":"2024-05-09T02:22:53.971555+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:22:53.971555+0000","last_undegraded":"2024-05-09T02:22:53.971555+0000","last_fullsized":"2024-05-09T02:22:53.971555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971155+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:22:53.971155+0000","last_peered":"2024-05-09T02:22:53.971155+0000","last_clean":"2024-05-09T02:22:53.971155+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:22:53.971155+0000","last_undegraded":"2024-05-09T02:22:53.971155+0000","last_fullsized":"2024-05-09T02:22:53.971155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981206+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:22:53.981206+0000","last_peered":"2024-05-09T02:22:53.981206+0000","last_clean":"2024-05-09T02:22:53.981206+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:22:53.981206+0000","last_undegraded":"2024-05-09T02:22:53.981206+0000","last_fullsized":"2024-05-09T02:22:53.981206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'7","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996527+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:22:53.996527+0000","last_peered":"2024-05-09T02:22:53.996527+0000","last_clean":"2024-05-09T02:22:53.996527+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:22:53.996527+0000","last_undegraded":"2024-05-09T02:22:53.996527+0000","last_fullsized":"2024-05-09T02:22:53.996527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970513+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:22:53.970513+0000","last_peered":"2024-05-09T02:22:53.970513+0000","last_clean":"2024-05-09T02:22:53.970513+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:22:53.970513+0000","last_undegraded":"2024-05-09T02:22:53.970513+0000","last_fullsized":"2024-05-09T02:22:53.970513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978415+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:22:53.978415+0000","last_peered":"2024-05-09T02:22:53.978415+0000","last_clean":"2024-05-09T02:22:53.978415+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:22:53.978415+0000","last_undegraded":"2024-05-09T02:22:53.978415+0000","last_fullsized":"2024-05-09T02:22:53.978415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'135","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985777+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:22:53.985777+0000","last_peered":"2024-05-09T02:22:53.985777+0000","last_clean":"2024-05-09T02:22:53.985777+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:22:53.985777+0000","last_undegraded":"2024-05-09T02:22:53.985777+0000","last_fullsized":"2024-05-09T02:22:53.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971841+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:22:53.971841+0000","last_peered":"2024-05-09T02:22:53.971841+0000","last_clean":"2024-05-09T02:22:53.971841+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:22:53.971841+0000","last_undegraded":"2024-05-09T02:22:53.971841+0000","last_fullsized":"2024-05-09T02:22:53.971841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971018+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:22:53.971018+0000","last_peered":"2024-05-09T02:22:53.971018+0000","last_clean":"2024-05-09T02:22:53.971018+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:22:53.971018+0000","last_undegraded":"2024-05-09T02:22:53.971018+0000","last_fullsized":"2024-05-09T02:22:53.971018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970419+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:22:53.970419+0000","last_peered":"2024-05-09T02:22:53.970419+0000","last_clean":"2024-05-09T02:22:53.970419+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:22:53.970419+0000","last_undegraded":"2024-05-09T02:22:53.970419+0000","last_fullsized":"2024-05-09T02:22:53.970419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985368+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:22:53.985368+0000","last_peered":"2024-05-09T02:22:53.985368+0000","last_clean":"2024-05-09T02:22:53.985368+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:22:53.985368+0000","last_undegraded":"2024-05-09T02:22:53.985368+0000","last_fullsized":"2024-05-09T02:22:53.985368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972195+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:22:53.972195+0000","last_peered":"2024-05-09T02:22:53.972195+0000","last_clean":"2024-05-09T02:22:53.972195+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:22:53.972195+0000","last_undegraded":"2024-05-09T02:22:53.972195+0000","last_fullsized":"2024-05-09T02:22:53.972195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975149+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:22:53.975149+0000","last_peered":"2024-05-09T02:22:53.975149+0000","last_clean":"2024-05-09T02:22:53.975149+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:22:53.975149+0000","last_undegraded":"2024-05-09T02:22:53.975149+0000","last_fullsized":"2024-05-09T02:22:53.975149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108475+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:22:54.108475+0000","last_peered":"2024-05-09T02:22:54.108475+0000","last_clean":"2024-05-09T02:22:54.108475+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:22:54.108475+0000","last_undegraded":"2024-05-09T02:22:54.108475+0000","last_fullsized":"2024-05-09T02:22:54.108475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971430+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:22:53.971430+0000","last_peered":"2024-05-09T02:22:53.971430+0000","last_clean":"2024-05-09T02:22:53.971430+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:22:53.971430+0000","last_undegraded":"2024-05-09T02:22:53.971430+0000","last_fullsized":"2024-05-09T02:22:53.971430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977614+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:22:53.977614+0000","last_peered":"2024-05-09T02:22:53.977614+0000","last_clean":"2024-05-09T02:22:53.977614+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:22:53.977614+0000","last_undegraded":"2024-05-09T02:22:53.977614+0000","last_fullsized":"2024-05-09T02:22:53.977614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970761+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:22:53.970761+0000","last_peered":"2024-05-09T02:22:53.970761+0000","last_clean":"2024-05-09T02:22:53.970761+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:22:53.970761+0000","last_undegraded":"2024-05-09T02:22:53.970761+0000","last_fullsized":"2024-05-09T02:22:53.970761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984174+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:22:53.984174+0000","last_peered":"2024-05-09T02:22:53.984174+0000","last_clean":"2024-05-09T02:22:53.984174+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:22:53.984174+0000","last_undegraded":"2024-05-09T02:22:53.984174+0000","last_fullsized":"2024-05-09T02:22:53.984174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971160+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:22:53.971160+0000","last_peered":"2024-05-09T02:22:53.971160+0000","last_clean":"2024-05-09T02:22:53.971160+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:22:53.971160+0000","last_undegraded":"2024-05-09T02:22:53.971160+0000","last_fullsized":"2024-05-09T02:22:53.971160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.985077+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:22:56.985077+0000","last_peered":"2024-05-09T02:22:56.985077+0000","last_clean":"2024-05-09T02:22:56.985077+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:22:56.985077+0000","last_undegraded":"2024-05-09T02:22:56.985077+0000","last_fullsized":"2024-05-09T02:22:56.985077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.936277+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:23:01.936277+0000","last_peered":"2024-05-09T02:23:01.936277+0000","last_clean":"2024-05-09T02:23:01.936277+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:23:01.936277+0000","last_undegraded":"2024-05-09T02:23:01.936277+0000","last_fullsized":"2024-05-09T02:23:01.936277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969835+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:22:53.969835+0000","last_peered":"2024-05-09T02:22:53.969835+0000","last_clean":"2024-05-09T02:22:53.969835+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:22:53.969835+0000","last_undegraded":"2024-05-09T02:22:53.969835+0000","last_fullsized":"2024-05-09T02:22:53.969835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985416+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:22:53.985416+0000","last_peered":"2024-05-09T02:22:53.985416+0000","last_clean":"2024-05-09T02:22:53.985416+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:22:53.985416+0000","last_undegraded":"2024-05-09T02:22:53.985416+0000","last_fullsized":"2024-05-09T02:22:53.985416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'21","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.976097+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:22:58.976097+0000","last_peered":"2024-05-09T02:22:58.976097+0000","last_clean":"2024-05-09T02:22:58.976097+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:22:58.976097+0000","last_undegraded":"2024-05-09T02:22:58.976097+0000","last_fullsized":"2024-05-09T02:22:58.976097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984244+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:22:53.984244+0000","last_peered":"2024-05-09T02:22:53.984244+0000","last_clean":"2024-05-09T02:22:53.984244+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:22:53.984244+0000","last_undegraded":"2024-05-09T02:22:53.984244+0000","last_fullsized":"2024-05-09T02:22:53.984244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'150","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980650+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:22:53.980650+0000","last_peered":"2024-05-09T02:22:53.980650+0000","last_clean":"2024-05-09T02:22:53.980650+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:22:53.980650+0000","last_undegraded":"2024-05-09T02:22:53.980650+0000","last_fullsized":"2024-05-09T02:22:53.980650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"31'135","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971639+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:22:53.971639+0000","last_peered":"2024-05-09T02:22:53.971639+0000","last_clean":"2024-05-09T02:22:53.971639+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:22:53.971639+0000","last_undegraded":"2024-05-09T02:22:53.971639+0000","last_fullsized":"2024-05-09T02:22:53.971639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979037+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:22:53.979037+0000","last_peered":"2024-05-09T02:22:53.979037+0000","last_clean":"2024-05-09T02:22:53.979037+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:22:53.979037+0000","last_undegraded":"2024-05-09T02:22:53.979037+0000","last_fullsized":"2024-05-09T02:22:53.979037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970261+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:22:53.970261+0000","last_peered":"2024-05-09T02:22:53.970261+0000","last_clean":"2024-05-09T02:22:53.970261+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:22:53.970261+0000","last_undegraded":"2024-05-09T02:22:53.970261+0000","last_fullsized":"2024-05-09T02:22:53.970261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970935+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:22:53.970935+0000","last_peered":"2024-05-09T02:22:53.970935+0000","last_clean":"2024-05-09T02:22:53.970935+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:22:53.970935+0000","last_undegraded":"2024-05-09T02:22:53.970935+0000","last_fullsized":"2024-05-09T02:22:53.970935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108245+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:22:54.108245+0000","last_peered":"2024-05-09T02:22:54.108245+0000","last_clean":"2024-05-09T02:22:54.108245+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:22:54.108245+0000","last_undegraded":"2024-05-09T02:22:54.108245+0000","last_fullsized":"2024-05-09T02:22:54.108245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.973716+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:22:53.973716+0000","last_peered":"2024-05-09T02:22:53.973716+0000","last_clean":"2024-05-09T02:22:53.973716+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:22:53.973716+0000","last_undegraded":"2024-05-09T02:22:53.973716+0000","last_fullsized":"2024-05-09T02:22:53.973716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971133+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:22:53.971133+0000","last_peered":"2024-05-09T02:22:53.971133+0000","last_clean":"2024-05-09T02:22:53.971133+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:22:53.971133+0000","last_undegraded":"2024-05-09T02:22:53.971133+0000","last_fullsized":"2024-05-09T02:22:53.971133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969454+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:22:53.969454+0000","last_peered":"2024-05-09T02:22:53.969454+0000","last_clean":"2024-05-09T02:22:53.969454+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:22:53.969454+0000","last_undegraded":"2024-05-09T02:22:53.969454+0000","last_fullsized":"2024-05-09T02:22:53.969454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970783+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:22:53.970783+0000","last_peered":"2024-05-09T02:22:53.970783+0000","last_clean":"2024-05-09T02:22:53.970783+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:22:53.970783+0000","last_undegraded":"2024-05-09T02:22:53.970783+0000","last_fullsized":"2024-05-09T02:22:53.970783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108236+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:22:54.108236+0000","last_peered":"2024-05-09T02:22:54.108236+0000","last_clean":"2024-05-09T02:22:54.108236+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:22:54.108236+0000","last_undegraded":"2024-05-09T02:22:54.108236+0000","last_fullsized":"2024-05-09T02:22:54.108236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971514+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:22:53.971514+0000","last_peered":"2024-05-09T02:22:53.971514+0000","last_clean":"2024-05-09T02:22:53.971514+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:22:53.971514+0000","last_undegraded":"2024-05-09T02:22:53.971514+0000","last_fullsized":"2024-05-09T02:22:53.971514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"32'156","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979396+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:22:53.979396+0000","last_peered":"2024-05-09T02:22:53.979396+0000","last_clean":"2024-05-09T02:22:53.979396+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:22:53.979396+0000","last_undegraded":"2024-05-09T02:22:53.979396+0000","last_fullsized":"2024-05-09T02:22:53.979396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972577+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:22:53.972577+0000","last_peered":"2024-05-09T02:22:53.972577+0000","last_clean":"2024-05-09T02:22:53.972577+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:22:53.972577+0000","last_undegraded":"2024-05-09T02:22:53.972577+0000","last_fullsized":"2024-05-09T02:22:53.972577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'7","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.979322+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:22:58.979322+0000","last_peered":"2024-05-09T02:22:58.979322+0000","last_clean":"2024-05-09T02:22:58.979322+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:22:58.979322+0000","last_undegraded":"2024-05-09T02:22:58.979322+0000","last_fullsized":"2024-05-09T02:22:58.979322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975286+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:22:53.975286+0000","last_peered":"2024-05-09T02:22:53.975286+0000","last_clean":"2024-05-09T02:22:53.975286+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:22:53.975286+0000","last_undegraded":"2024-05-09T02:22:53.975286+0000","last_fullsized":"2024-05-09T02:22:53.975286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108653+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:22:54.108653+0000","last_peered":"2024-05-09T02:22:54.108653+0000","last_clean":"2024-05-09T02:22:54.108653+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:22:54.108653+0000","last_undegraded":"2024-05-09T02:22:54.108653+0000","last_fullsized":"2024-05-09T02:22:54.108653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969060+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:22:53.969060+0000","last_peered":"2024-05-09T02:22:53.969060+0000","last_clean":"2024-05-09T02:22:53.969060+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:22:53.969060+0000","last_undegraded":"2024-05-09T02:22:53.969060+0000","last_fullsized":"2024-05-09T02:22:53.969060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977964+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:22:53.977964+0000","last_peered":"2024-05-09T02:22:53.977964+0000","last_clean":"2024-05-09T02:22:53.977964+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:22:53.977964+0000","last_undegraded":"2024-05-09T02:22:53.977964+0000","last_fullsized":"2024-05-09T02:22:53.977964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'22","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:00.928540+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:23:00.928540+0000","last_peered":"2024-05-09T02:23:00.928540+0000","last_clean":"2024-05-09T02:23:00.928540+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:23:00.928540+0000","last_undegraded":"2024-05-09T02:23:00.928540+0000","last_fullsized":"2024-05-09T02:23:00.928540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'135","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977106+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:22:53.977106+0000","last_peered":"2024-05-09T02:22:53.977106+0000","last_clean":"2024-05-09T02:22:53.977106+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:22:53.977106+0000","last_undegraded":"2024-05-09T02:22:53.977106+0000","last_fullsized":"2024-05-09T02:22:53.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'150","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985827+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:22:53.985827+0000","last_peered":"2024-05-09T02:22:53.985827+0000","last_clean":"2024-05-09T02:22:53.985827+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:22:53.985827+0000","last_undegraded":"2024-05-09T02:22:53.985827+0000","last_fullsized":"2024-05-09T02:22:53.985827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107278+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:22:54.107278+0000","last_peered":"2024-05-09T02:22:54.107278+0000","last_clean":"2024-05-09T02:22:54.107278+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:22:54.107278+0000","last_undegraded":"2024-05-09T02:22:54.107278+0000","last_fullsized":"2024-05-09T02:22:54.107278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978232+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:22:53.978232+0000","last_peered":"2024-05-09T02:22:53.978232+0000","last_clean":"2024-05-09T02:22:53.978232+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:22:53.978232+0000","last_undegraded":"2024-05-09T02:22:53.978232+0000","last_fullsized":"2024-05-09T02:22:53.978232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980476+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:22:53.980476+0000","last_peered":"2024-05-09T02:22:53.980476+0000","last_clean":"2024-05-09T02:22:53.980476+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:22:53.980476+0000","last_undegraded":"2024-05-09T02:22:53.980476+0000","last_fullsized":"2024-05-09T02:22:53.980476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"32'135","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979276+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:22:53.979276+0000","last_peered":"2024-05-09T02:22:53.979276+0000","last_clean":"2024-05-09T02:22:53.979276+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:22:53.979276+0000","last_undegraded":"2024-05-09T02:22:53.979276+0000","last_fullsized":"2024-05-09T02:22:53.979276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978295+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:22:53.978295+0000","last_peered":"2024-05-09T02:22:53.978295+0000","last_clean":"2024-05-09T02:22:53.978295+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:22:53.978295+0000","last_undegraded":"2024-05-09T02:22:53.978295+0000","last_fullsized":"2024-05-09T02:22:53.978295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979181+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:22:53.979181+0000","last_peered":"2024-05-09T02:22:53.979181+0000","last_clean":"2024-05-09T02:22:53.979181+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:22:53.979181+0000","last_undegraded":"2024-05-09T02:22:53.979181+0000","last_fullsized":"2024-05-09T02:22:53.979181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980574+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:22:53.980574+0000","last_peered":"2024-05-09T02:22:53.980574+0000","last_clean":"2024-05-09T02:22:53.980574+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:22:53.980574+0000","last_undegraded":"2024-05-09T02:22:53.980574+0000","last_fullsized":"2024-05-09T02:22:53.980574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978092+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:22:53.978092+0000","last_peered":"2024-05-09T02:22:53.978092+0000","last_clean":"2024-05-09T02:22:53.978092+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:22:53.978092+0000","last_undegraded":"2024-05-09T02:22:53.978092+0000","last_fullsized":"2024-05-09T02:22:53.978092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'138","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978097+0000","last_change":"2024-05-09T02:18:55.756927+0000","last_active":"2024-05-09T02:22:53.978097+0000","last_peered":"2024-05-09T02:22:53.978097+0000","last_clean":"2024-05-09T02:22:53.978097+0000","last_became_active":"2024-05-09T02:18:55.756398+0000","last_became_peered":"2024-05-09T02:18:55.756398+0000","last_unstale":"2024-05-09T02:22:53.978097+0000","last_undegraded":"2024-05-09T02:22:53.978097+0000","last_fullsized":"2024-05-09T02:22:53.978097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975232+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:22:53.975232+0000","last_peered":"2024-05-09T02:22:53.975232+0000","last_clean":"2024-05-09T02:22:53.975232+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:22:53.975232+0000","last_undegraded":"2024-05-09T02:22:53.975232+0000","last_fullsized":"2024-05-09T02:22:53.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'7","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970048+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:22:53.970048+0000","last_peered":"2024-05-09T02:22:53.970048+0000","last_clean":"2024-05-09T02:22:53.970048+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:22:53.970048+0000","last_undegraded":"2024-05-09T02:22:53.970048+0000","last_fullsized":"2024-05-09T02:22:53.970048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976514+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:22:53.976514+0000","last_peered":"2024-05-09T02:22:53.976514+0000","last_clean":"2024-05-09T02:22:53.976514+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:22:53.976514+0000","last_undegraded":"2024-05-09T02:22:53.976514+0000","last_fullsized":"2024-05-09T02:22:53.976514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978683+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:22:53.978683+0000","last_peered":"2024-05-09T02:22:53.978683+0000","last_clean":"2024-05-09T02:22:53.978683+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:22:53.978683+0000","last_undegraded":"2024-05-09T02:22:53.978683+0000","last_fullsized":"2024-05-09T02:22:53.978683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984458+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:22:56.984458+0000","last_peered":"2024-05-09T02:22:56.984458+0000","last_clean":"2024-05-09T02:22:56.984458+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:22:56.984458+0000","last_undegraded":"2024-05-09T02:22:56.984458+0000","last_fullsized":"2024-05-09T02:22:56.984458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106855+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:22:54.106855+0000","last_peered":"2024-05-09T02:22:54.106855+0000","last_clean":"2024-05-09T02:22:54.106855+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:22:54.106855+0000","last_undegraded":"2024-05-09T02:22:54.106855+0000","last_fullsized":"2024-05-09T02:22:54.106855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977966+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:22:53.977966+0000","last_peered":"2024-05-09T02:22:53.977966+0000","last_clean":"2024-05-09T02:22:53.977966+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:22:53.977966+0000","last_undegraded":"2024-05-09T02:22:53.977966+0000","last_fullsized":"2024-05-09T02:22:53.977966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978422+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:22:53.978422+0000","last_peered":"2024-05-09T02:22:53.978422+0000","last_clean":"2024-05-09T02:22:53.978422+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:22:53.978422+0000","last_undegraded":"2024-05-09T02:22:53.978422+0000","last_fullsized":"2024-05-09T02:22:53.978422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971819+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:22:53.971819+0000","last_peered":"2024-05-09T02:22:53.971819+0000","last_clean":"2024-05-09T02:22:53.971819+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:22:53.971819+0000","last_undegraded":"2024-05-09T02:22:53.971819+0000","last_fullsized":"2024-05-09T02:22:53.971819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969924+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:22:53.969924+0000","last_peered":"2024-05-09T02:22:53.969924+0000","last_clean":"2024-05-09T02:22:53.969924+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:22:53.969924+0000","last_undegraded":"2024-05-09T02:22:53.969924+0000","last_fullsized":"2024-05-09T02:22:53.969924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"32'132","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984777+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:22:53.984777+0000","last_peered":"2024-05-09T02:22:53.984777+0000","last_clean":"2024-05-09T02:22:53.984777+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:22:53.984777+0000","last_undegraded":"2024-05-09T02:22:53.984777+0000","last_fullsized":"2024-05-09T02:22:53.984777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978087+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:22:53.978087+0000","last_peered":"2024-05-09T02:22:53.978087+0000","last_clean":"2024-05-09T02:22:53.978087+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:22:53.978087+0000","last_undegraded":"2024-05-09T02:22:53.978087+0000","last_fullsized":"2024-05-09T02:22:53.978087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'9","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.987000+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:22:56.987000+0000","last_peered":"2024-05-09T02:22:56.987000+0000","last_clean":"2024-05-09T02:22:56.987000+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:22:56.987000+0000","last_undegraded":"2024-05-09T02:22:56.987000+0000","last_fullsized":"2024-05-09T02:22:56.987000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971053+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:22:53.971053+0000","last_peered":"2024-05-09T02:22:53.971053+0000","last_clean":"2024-05-09T02:22:53.971053+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:22:53.971053+0000","last_undegraded":"2024-05-09T02:22:53.971053+0000","last_fullsized":"2024-05-09T02:22:53.971053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"32'219","reported_seq":247,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107776+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:22:54.107776+0000","last_peered":"2024-05-09T02:22:54.107776+0000","last_clean":"2024-05-09T02:22:54.107776+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:22:54.107776+0000","last_undegraded":"2024-05-09T02:22:54.107776+0000","last_fullsized":"2024-05-09T02:22:54.107776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980895+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:22:53.980895+0000","last_peered":"2024-05-09T02:22:53.980895+0000","last_clean":"2024-05-09T02:22:53.980895+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:22:53.980895+0000","last_undegraded":"2024-05-09T02:22:53.980895+0000","last_fullsized":"2024-05-09T02:22:53.980895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985168+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:22:53.985168+0000","last_peered":"2024-05-09T02:22:53.985168+0000","last_clean":"2024-05-09T02:22:53.985168+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:22:53.985168+0000","last_undegraded":"2024-05-09T02:22:53.985168+0000","last_fullsized":"2024-05-09T02:22:53.985168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107190+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:22:54.107190+0000","last_peered":"2024-05-09T02:22:54.107190+0000","last_clean":"2024-05-09T02:22:54.107190+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:22:54.107190+0000","last_undegraded":"2024-05-09T02:22:54.107190+0000","last_fullsized":"2024-05-09T02:22:54.107190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977431+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:22:53.977431+0000","last_peered":"2024-05-09T02:22:53.977431+0000","last_clean":"2024-05-09T02:22:53.977431+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:22:53.977431+0000","last_undegraded":"2024-05-09T02:22:53.977431+0000","last_fullsized":"2024-05-09T02:22:53.977431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108124+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:22:54.108124+0000","last_peered":"2024-05-09T02:22:54.108124+0000","last_clean":"2024-05-09T02:22:54.108124+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:22:54.108124+0000","last_undegraded":"2024-05-09T02:22:54.108124+0000","last_fullsized":"2024-05-09T02:22:54.108124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'111","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576573+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:23:01.576573+0000","last_peered":"2024-05-09T02:23:01.576573+0000","last_clean":"2024-05-09T02:23:01.576573+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:23:01.576573+0000","last_undegraded":"2024-05-09T02:23:01.576573+0000","last_fullsized":"2024-05-09T02:23:01.576573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":214,"num_write":106,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985967+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:22:53.985967+0000","last_peered":"2024-05-09T02:22:53.985967+0000","last_clean":"2024-05-09T02:22:53.985967+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:22:53.985967+0000","last_undegraded":"2024-05-09T02:22:53.985967+0000","last_fullsized":"2024-05-09T02:22:53.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'148","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969742+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:22:53.969742+0000","last_peered":"2024-05-09T02:22:53.969742+0000","last_clean":"2024-05-09T02:22:53.969742+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:22:53.969742+0000","last_undegraded":"2024-05-09T02:22:53.969742+0000","last_fullsized":"2024-05-09T02:22:53.969742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.577018+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:22:56.577018+0000","last_peered":"2024-05-09T02:22:56.577018+0000","last_clean":"2024-05-09T02:22:56.577018+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:22:56.577018+0000","last_undegraded":"2024-05-09T02:22:56.577018+0000","last_fullsized":"2024-05-09T02:22:56.577018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108115+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:22:54.108115+0000","last_peered":"2024-05-09T02:22:54.108115+0000","last_clean":"2024-05-09T02:22:54.108115+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:22:54.108115+0000","last_undegraded":"2024-05-09T02:22:54.108115+0000","last_fullsized":"2024-05-09T02:22:54.108115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"32'156","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984948+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:22:53.984948+0000","last_peered":"2024-05-09T02:22:53.984948+0000","last_clean":"2024-05-09T02:22:53.984948+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:22:53.984948+0000","last_undegraded":"2024-05-09T02:22:53.984948+0000","last_fullsized":"2024-05-09T02:22:53.984948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977657+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:22:53.977657+0000","last_peered":"2024-05-09T02:22:53.977657+0000","last_clean":"2024-05-09T02:22:53.977657+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:22:53.977657+0000","last_undegraded":"2024-05-09T02:22:53.977657+0000","last_fullsized":"2024-05-09T02:22:53.977657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'111","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:03.257459+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:23:03.257459+0000","last_peered":"2024-05-09T02:23:03.257459+0000","last_clean":"2024-05-09T02:23:03.257459+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:23:03.257459+0000","last_undegraded":"2024-05-09T02:23:03.257459+0000","last_fullsized":"2024-05-09T02:23:03.257459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":234,"num_write":106,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971080+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:22:53.971080+0000","last_peered":"2024-05-09T02:22:53.971080+0000","last_clean":"2024-05-09T02:22:53.971080+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:22:53.971080+0000","last_undegraded":"2024-05-09T02:22:53.971080+0000","last_fullsized":"2024-05-09T02:22:53.971080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"32'148","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971367+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:22:53.971367+0000","last_peered":"2024-05-09T02:22:53.971367+0000","last_clean":"2024-05-09T02:22:53.971367+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:22:53.971367+0000","last_undegraded":"2024-05-09T02:22:53.971367+0000","last_fullsized":"2024-05-09T02:22:53.971367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971892+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:22:53.971892+0000","last_peered":"2024-05-09T02:22:53.971892+0000","last_clean":"2024-05-09T02:22:53.971892+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:22:53.971892+0000","last_undegraded":"2024-05-09T02:22:53.971892+0000","last_fullsized":"2024-05-09T02:22:53.971892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.982899+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:22:58.982899+0000","last_peered":"2024-05-09T02:22:58.982899+0000","last_clean":"2024-05-09T02:22:58.982899+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:22:58.982899+0000","last_undegraded":"2024-05-09T02:22:58.982899+0000","last_fullsized":"2024-05-09T02:22:58.982899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970598+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:22:53.970598+0000","last_peered":"2024-05-09T02:22:53.970598+0000","last_clean":"2024-05-09T02:22:53.970598+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:22:53.970598+0000","last_undegraded":"2024-05-09T02:22:53.970598+0000","last_fullsized":"2024-05-09T02:22:53.970598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980486+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:22:53.980486+0000","last_peered":"2024-05-09T02:22:53.980486+0000","last_clean":"2024-05-09T02:22:53.980486+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:22:53.980486+0000","last_undegraded":"2024-05-09T02:22:53.980486+0000","last_fullsized":"2024-05-09T02:22:53.980486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969761+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:22:53.969761+0000","last_peered":"2024-05-09T02:22:53.969761+0000","last_clean":"2024-05-09T02:22:53.969761+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:22:53.969761+0000","last_undegraded":"2024-05-09T02:22:53.969761+0000","last_fullsized":"2024-05-09T02:22:53.969761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108042+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:22:54.108042+0000","last_peered":"2024-05-09T02:22:54.108042+0000","last_clean":"2024-05-09T02:22:54.108042+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:22:54.108042+0000","last_undegraded":"2024-05-09T02:22:54.108042+0000","last_fullsized":"2024-05-09T02:22:54.108042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576515+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:23:01.576515+0000","last_peered":"2024-05-09T02:23:01.576515+0000","last_clean":"2024-05-09T02:23:01.576515+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:23:01.576515+0000","last_undegraded":"2024-05-09T02:23:01.576515+0000","last_fullsized":"2024-05-09T02:23:01.576515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'159","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977100+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:22:53.977100+0000","last_peered":"2024-05-09T02:22:53.977100+0000","last_clean":"2024-05-09T02:22:53.977100+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:22:53.977100+0000","last_undegraded":"2024-05-09T02:22:53.977100+0000","last_fullsized":"2024-05-09T02:22:53.977100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'219","reported_seq":241,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978920+0000","last_change":"2024-05-09T02:18:55.680482+0000","last_active":"2024-05-09T02:22:53.978920+0000","last_peered":"2024-05-09T02:22:53.978920+0000","last_clean":"2024-05-09T02:22:53.978920+0000","last_became_active":"2024-05-09T02:18:55.680219+0000","last_became_peered":"2024-05-09T02:18:55.680219+0000","last_unstale":"2024-05-09T02:22:53.978920+0000","last_undegraded":"2024-05-09T02:22:53.978920+0000","last_fullsized":"2024-05-09T02:22:53.978920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:13.255019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.977541+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:22:58.977541+0000","last_peered":"2024-05-09T02:22:58.977541+0000","last_clean":"2024-05-09T02:22:58.977541+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:22:58.977541+0000","last_undegraded":"2024-05-09T02:22:58.977541+0000","last_fullsized":"2024-05-09T02:22:58.977541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984423+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:22:53.984423+0000","last_peered":"2024-05-09T02:22:53.984423+0000","last_clean":"2024-05-09T02:22:53.984423+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:22:53.984423+0000","last_undegraded":"2024-05-09T02:22:53.984423+0000","last_fullsized":"2024-05-09T02:22:53.984423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981396+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:22:53.981396+0000","last_peered":"2024-05-09T02:22:53.981396+0000","last_clean":"2024-05-09T02:22:53.981396+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:22:53.981396+0000","last_undegraded":"2024-05-09T02:22:53.981396+0000","last_fullsized":"2024-05-09T02:22:53.981396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970678+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:22:53.970678+0000","last_peered":"2024-05-09T02:22:53.970678+0000","last_clean":"2024-05-09T02:22:53.970678+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:22:53.970678+0000","last_undegraded":"2024-05-09T02:22:53.970678+0000","last_fullsized":"2024-05-09T02:22:53.970678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971820+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:22:53.971820+0000","last_peered":"2024-05-09T02:22:53.971820+0000","last_clean":"2024-05-09T02:22:53.971820+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:22:53.971820+0000","last_undegraded":"2024-05-09T02:22:53.971820+0000","last_fullsized":"2024-05-09T02:22:53.971820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107588+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:22:54.107588+0000","last_peered":"2024-05-09T02:22:54.107588+0000","last_clean":"2024-05-09T02:22:54.107588+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:22:54.107588+0000","last_undegraded":"2024-05-09T02:22:54.107588+0000","last_fullsized":"2024-05-09T02:22:54.107588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"32'147","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970333+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:22:53.970333+0000","last_peered":"2024-05-09T02:22:53.970333+0000","last_clean":"2024-05-09T02:22:53.970333+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:22:53.970333+0000","last_undegraded":"2024-05-09T02:22:53.970333+0000","last_fullsized":"2024-05-09T02:22:53.970333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981757+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:22:53.981757+0000","last_peered":"2024-05-09T02:22:53.981757+0000","last_clean":"2024-05-09T02:22:53.981757+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:22:53.981757+0000","last_undegraded":"2024-05-09T02:22:53.981757+0000","last_fullsized":"2024-05-09T02:22:53.981757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'162","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970351+0000","last_change":"2024-05-09T02:18:55.678178+0000","last_active":"2024-05-09T02:22:53.970351+0000","last_peered":"2024-05-09T02:22:53.970351+0000","last_clean":"2024-05-09T02:22:53.970351+0000","last_became_active":"2024-05-09T02:18:55.677782+0000","last_became_peered":"2024-05-09T02:18:55.677782+0000","last_unstale":"2024-05-09T02:22:53.970351+0000","last_undegraded":"2024-05-09T02:22:53.970351+0000","last_fullsized":"2024-05-09T02:22:53.970351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:03.517417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984692+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:22:53.984692+0000","last_peered":"2024-05-09T02:22:53.984692+0000","last_clean":"2024-05-09T02:22:53.984692+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:22:53.984692+0000","last_undegraded":"2024-05-09T02:22:53.984692+0000","last_fullsized":"2024-05-09T02:22:53.984692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'168","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974606+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:22:53.974606+0000","last_peered":"2024-05-09T02:22:53.974606+0000","last_clean":"2024-05-09T02:22:53.974606+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:22:53.974606+0000","last_undegraded":"2024-05-09T02:22:53.974606+0000","last_fullsized":"2024-05-09T02:22:53.974606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981322+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:22:53.981322+0000","last_peered":"2024-05-09T02:22:53.981322+0000","last_clean":"2024-05-09T02:22:53.981322+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:22:53.981322+0000","last_undegraded":"2024-05-09T02:22:53.981322+0000","last_fullsized":"2024-05-09T02:22:53.981322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'129","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971974+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:22:53.971974+0000","last_peered":"2024-05-09T02:22:53.971974+0000","last_clean":"2024-05-09T02:22:53.971974+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:22:53.971974+0000","last_undegraded":"2024-05-09T02:22:53.971974+0000","last_fullsized":"2024-05-09T02:22:53.971974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978910+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:22:53.978910+0000","last_peered":"2024-05-09T02:22:53.978910+0000","last_clean":"2024-05-09T02:22:53.978910+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:22:53.978910+0000","last_undegraded":"2024-05-09T02:22:53.978910+0000","last_fullsized":"2024-05-09T02:22:53.978910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970562+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:22:53.970562+0000","last_peered":"2024-05-09T02:22:53.970562+0000","last_clean":"2024-05-09T02:22:53.970562+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:22:53.970562+0000","last_undegraded":"2024-05-09T02:22:53.970562+0000","last_fullsized":"2024-05-09T02:22:53.970562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986431+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:22:53.986431+0000","last_peered":"2024-05-09T02:22:53.986431+0000","last_clean":"2024-05-09T02:22:53.986431+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:22:53.986431+0000","last_undegraded":"2024-05-09T02:22:53.986431+0000","last_fullsized":"2024-05-09T02:22:53.986431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971985+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:22:53.971985+0000","last_peered":"2024-05-09T02:22:53.971985+0000","last_clean":"2024-05-09T02:22:53.971985+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:22:53.971985+0000","last_undegraded":"2024-05-09T02:22:53.971985+0000","last_fullsized":"2024-05-09T02:22:53.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985776+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:22:53.985776+0000","last_peered":"2024-05-09T02:22:53.985776+0000","last_clean":"2024-05-09T02:22:53.985776+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:22:53.985776+0000","last_undegraded":"2024-05-09T02:22:53.985776+0000","last_fullsized":"2024-05-09T02:22:53.985776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985967+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:22:53.985967+0000","last_peered":"2024-05-09T02:22:53.985967+0000","last_clean":"2024-05-09T02:22:53.985967+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:22:53.985967+0000","last_undegraded":"2024-05-09T02:22:53.985967+0000","last_fullsized":"2024-05-09T02:22:53.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980177+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:22:53.980177+0000","last_peered":"2024-05-09T02:22:53.980177+0000","last_clean":"2024-05-09T02:22:53.980177+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:22:53.980177+0000","last_undegraded":"2024-05-09T02:22:53.980177+0000","last_fullsized":"2024-05-09T02:22:53.980177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974939+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:22:53.974939+0000","last_peered":"2024-05-09T02:22:53.974939+0000","last_clean":"2024-05-09T02:22:53.974939+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:22:53.974939+0000","last_undegraded":"2024-05-09T02:22:53.974939+0000","last_fullsized":"2024-05-09T02:22:53.974939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978061+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:22:53.978061+0000","last_peered":"2024-05-09T02:22:53.978061+0000","last_clean":"2024-05-09T02:22:53.978061+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:22:53.978061+0000","last_undegraded":"2024-05-09T02:22:53.978061+0000","last_fullsized":"2024-05-09T02:22:53.978061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107639+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:22:54.107639+0000","last_peered":"2024-05-09T02:22:54.107639+0000","last_clean":"2024-05-09T02:22:54.107639+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:22:54.107639+0000","last_undegraded":"2024-05-09T02:22:54.107639+0000","last_fullsized":"2024-05-09T02:22:54.107639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107926+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:22:54.107926+0000","last_peered":"2024-05-09T02:22:54.107926+0000","last_clean":"2024-05-09T02:22:54.107926+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:22:54.107926+0000","last_undegraded":"2024-05-09T02:22:54.107926+0000","last_fullsized":"2024-05-09T02:22:54.107926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974583+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:22:53.974583+0000","last_peered":"2024-05-09T02:22:53.974583+0000","last_clean":"2024-05-09T02:22:53.974583+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:22:53.974583+0000","last_undegraded":"2024-05-09T02:22:53.974583+0000","last_fullsized":"2024-05-09T02:22:53.974583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"31'111","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971307+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:22:53.971307+0000","last_peered":"2024-05-09T02:22:53.971307+0000","last_clean":"2024-05-09T02:22:53.971307+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:22:53.971307+0000","last_undegraded":"2024-05-09T02:22:53.971307+0000","last_fullsized":"2024-05-09T02:22:53.971307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"32'123","reported_seq":153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976759+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:22:53.976759+0000","last_peered":"2024-05-09T02:22:53.976759+0000","last_clean":"2024-05-09T02:22:53.976759+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:22:53.976759+0000","last_undegraded":"2024-05-09T02:22:53.976759+0000","last_fullsized":"2024-05-09T02:22:53.976759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"31'129","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986301+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:22:53.986301+0000","last_peered":"2024-05-09T02:22:53.986301+0000","last_clean":"2024-05-09T02:22:53.986301+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:22:53.986301+0000","last_undegraded":"2024-05-09T02:22:53.986301+0000","last_fullsized":"2024-05-09T02:22:53.986301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"32'111","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970144+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:22:53.970144+0000","last_peered":"2024-05-09T02:22:53.970144+0000","last_clean":"2024-05-09T02:22:53.970144+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:22:53.970144+0000","last_undegraded":"2024-05-09T02:22:53.970144+0000","last_fullsized":"2024-05-09T02:22:53.970144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975059+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:22:53.975059+0000","last_peered":"2024-05-09T02:22:53.975059+0000","last_clean":"2024-05-09T02:22:53.975059+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:22:53.975059+0000","last_undegraded":"2024-05-09T02:22:53.975059+0000","last_fullsized":"2024-05-09T02:22:53.975059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976427+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:22:53.976427+0000","last_peered":"2024-05-09T02:22:53.976427+0000","last_clean":"2024-05-09T02:22:53.976427+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:22:53.976427+0000","last_undegraded":"2024-05-09T02:22:53.976427+0000","last_fullsized":"2024-05-09T02:22:53.976427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981218+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:22:53.981218+0000","last_peered":"2024-05-09T02:22:53.981218+0000","last_clean":"2024-05-09T02:22:53.981218+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:22:53.981218+0000","last_undegraded":"2024-05-09T02:22:53.981218+0000","last_fullsized":"2024-05-09T02:22:53.981218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'132","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985334+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:22:53.985334+0000","last_peered":"2024-05-09T02:22:53.985334+0000","last_clean":"2024-05-09T02:22:53.985334+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:22:53.985334+0000","last_undegraded":"2024-05-09T02:22:53.985334+0000","last_fullsized":"2024-05-09T02:22:53.985334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"32'147","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985603+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:22:53.985603+0000","last_peered":"2024-05-09T02:22:53.985603+0000","last_clean":"2024-05-09T02:22:53.985603+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:22:53.985603+0000","last_undegraded":"2024-05-09T02:22:53.985603+0000","last_fullsized":"2024-05-09T02:22:53.985603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'174","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107316+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:22:54.107316+0000","last_peered":"2024-05-09T02:22:54.107316+0000","last_clean":"2024-05-09T02:22:54.107316+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:22:54.107316+0000","last_undegraded":"2024-05-09T02:22:54.107316+0000","last_fullsized":"2024-05-09T02:22:54.107316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978652+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:22:53.978652+0000","last_peered":"2024-05-09T02:22:53.978652+0000","last_clean":"2024-05-09T02:22:53.978652+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:22:53.978652+0000","last_undegraded":"2024-05-09T02:22:53.978652+0000","last_fullsized":"2024-05-09T02:22:53.978652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"31'126","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984607+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:22:53.984607+0000","last_peered":"2024-05-09T02:22:53.984607+0000","last_clean":"2024-05-09T02:22:53.984607+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:22:53.984607+0000","last_undegraded":"2024-05-09T02:22:53.984607+0000","last_fullsized":"2024-05-09T02:22:53.984607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"32'153","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978575+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:22:53.978575+0000","last_peered":"2024-05-09T02:22:53.978575+0000","last_clean":"2024-05-09T02:22:53.978575+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:22:53.978575+0000","last_undegraded":"2024-05-09T02:22:53.978575+0000","last_fullsized":"2024-05-09T02:22:53.978575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"31'156","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107220+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:22:54.107220+0000","last_peered":"2024-05-09T02:22:54.107220+0000","last_clean":"2024-05-09T02:22:54.107220+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:22:54.107220+0000","last_undegraded":"2024-05-09T02:22:54.107220+0000","last_fullsized":"2024-05-09T02:22:54.107220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"32'165","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984760+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:22:53.984760+0000","last_peered":"2024-05-09T02:22:53.984760+0000","last_clean":"2024-05-09T02:22:53.984760+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:22:53.984760+0000","last_undegraded":"2024-05-09T02:22:53.984760+0000","last_fullsized":"2024-05-09T02:22:53.984760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970590+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:22:53.970590+0000","last_peered":"2024-05-09T02:22:53.970590+0000","last_clean":"2024-05-09T02:22:53.970590+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:22:53.970590+0000","last_undegraded":"2024-05-09T02:22:53.970590+0000","last_fullsized":"2024-05-09T02:22:53.970590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"32'156","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971445+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:22:53.971445+0000","last_peered":"2024-05-09T02:22:53.971445+0000","last_clean":"2024-05-09T02:22:53.971445+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:22:53.971445+0000","last_undegraded":"2024-05-09T02:22:53.971445+0000","last_fullsized":"2024-05-09T02:22:53.971445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'153","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980789+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:22:53.980789+0000","last_peered":"2024-05-09T02:22:53.980789+0000","last_clean":"2024-05-09T02:22:53.980789+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:22:53.980789+0000","last_undegraded":"2024-05-09T02:22:53.980789+0000","last_fullsized":"2024-05-09T02:22:53.980789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970169+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:22:53.970169+0000","last_peered":"2024-05-09T02:22:53.970169+0000","last_clean":"2024-05-09T02:22:53.970169+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:22:53.970169+0000","last_undegraded":"2024-05-09T02:22:53.970169+0000","last_fullsized":"2024-05-09T02:22:53.970169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"31'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978983+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:22:53.978983+0000","last_peered":"2024-05-09T02:22:53.978983+0000","last_clean":"2024-05-09T02:22:53.978983+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:22:53.978983+0000","last_undegraded":"2024-05-09T02:22:53.978983+0000","last_fullsized":"2024-05-09T02:22:53.978983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"32'174","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106722+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:22:54.106722+0000","last_peered":"2024-05-09T02:22:54.106722+0000","last_clean":"2024-05-09T02:22:54.106722+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:22:54.106722+0000","last_undegraded":"2024-05-09T02:22:54.106722+0000","last_fullsized":"2024-05-09T02:22:54.106722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979771+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:22:53.979771+0000","last_peered":"2024-05-09T02:22:53.979771+0000","last_clean":"2024-05-09T02:22:53.979771+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:22:53.979771+0000","last_undegraded":"2024-05-09T02:22:53.979771+0000","last_fullsized":"2024-05-09T02:22:53.979771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.968919+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:22:53.968919+0000","last_peered":"2024-05-09T02:22:53.968919+0000","last_clean":"2024-05-09T02:22:53.968919+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:22:53.968919+0000","last_undegraded":"2024-05-09T02:22:53.968919+0000","last_fullsized":"2024-05-09T02:22:53.968919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"31'138","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979922+0000","last_change":"2024-05-09T02:18:55.680326+0000","last_active":"2024-05-09T02:22:53.979922+0000","last_peered":"2024-05-09T02:22:53.979922+0000","last_clean":"2024-05-09T02:22:53.979922+0000","last_became_active":"2024-05-09T02:18:55.680014+0000","last_became_peered":"2024-05-09T02:18:55.680014+0000","last_unstale":"2024-05-09T02:22:53.979922+0000","last_undegraded":"2024-05-09T02:22:53.979922+0000","last_fullsized":"2024-05-09T02:22:53.979922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:40.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"32'141","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974615+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:22:53.974615+0000","last_peered":"2024-05-09T02:22:53.974615+0000","last_clean":"2024-05-09T02:22:53.974615+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:22:53.974615+0000","last_undegraded":"2024-05-09T02:22:53.974615+0000","last_fullsized":"2024-05-09T02:22:53.974615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107142+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:22:54.107142+0000","last_peered":"2024-05-09T02:22:54.107142+0000","last_clean":"2024-05-09T02:22:54.107142+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:22:54.107142+0000","last_undegraded":"2024-05-09T02:22:54.107142+0000","last_fullsized":"2024-05-09T02:22:54.107142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971005+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:22:53.971005+0000","last_peered":"2024-05-09T02:22:53.971005+0000","last_clean":"2024-05-09T02:22:53.971005+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:22:53.971005+0000","last_undegraded":"2024-05-09T02:22:53.971005+0000","last_fullsized":"2024-05-09T02:22:53.971005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971840+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:22:53.971840+0000","last_peered":"2024-05-09T02:22:53.971840+0000","last_clean":"2024-05-09T02:22:53.971840+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:22:53.971840+0000","last_undegraded":"2024-05-09T02:22:53.971840+0000","last_fullsized":"2024-05-09T02:22:53.971840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"32'135","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107391+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:22:54.107391+0000","last_peered":"2024-05-09T02:22:54.107391+0000","last_clean":"2024-05-09T02:22:54.107391+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:22:54.107391+0000","last_undegraded":"2024-05-09T02:22:54.107391+0000","last_fullsized":"2024-05-09T02:22:54.107391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969430+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:22:53.969430+0000","last_peered":"2024-05-09T02:22:53.969430+0000","last_clean":"2024-05-09T02:22:53.969430+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:22:53.969430+0000","last_undegraded":"2024-05-09T02:22:53.969430+0000","last_fullsized":"2024-05-09T02:22:53.969430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977362+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:22:53.977362+0000","last_peered":"2024-05-09T02:22:53.977362+0000","last_clean":"2024-05-09T02:22:53.977362+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:22:53.977362+0000","last_undegraded":"2024-05-09T02:22:53.977362+0000","last_fullsized":"2024-05-09T02:22:53.977362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985367+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:22:53.985367+0000","last_peered":"2024-05-09T02:22:53.985367+0000","last_clean":"2024-05-09T02:22:53.985367+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:22:53.985367+0000","last_undegraded":"2024-05-09T02:22:53.985367+0000","last_fullsized":"2024-05-09T02:22:53.985367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985382+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:22:53.985382+0000","last_peered":"2024-05-09T02:22:53.985382+0000","last_clean":"2024-05-09T02:22:53.985382+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:22:53.985382+0000","last_undegraded":"2024-05-09T02:22:53.985382+0000","last_fullsized":"2024-05-09T02:22:53.985382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971405+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:22:53.971405+0000","last_peered":"2024-05-09T02:22:53.971405+0000","last_clean":"2024-05-09T02:22:53.971405+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:22:53.971405+0000","last_undegraded":"2024-05-09T02:22:53.971405+0000","last_fullsized":"2024-05-09T02:22:53.971405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"32'141","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978785+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:22:53.978785+0000","last_peered":"2024-05-09T02:22:53.978785+0000","last_clean":"2024-05-09T02:22:53.978785+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:22:53.978785+0000","last_undegraded":"2024-05-09T02:22:53.978785+0000","last_fullsized":"2024-05-09T02:22:53.978785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980636+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:22:53.980636+0000","last_peered":"2024-05-09T02:22:53.980636+0000","last_clean":"2024-05-09T02:22:53.980636+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:22:53.980636+0000","last_undegraded":"2024-05-09T02:22:53.980636+0000","last_fullsized":"2024-05-09T02:22:53.980636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981266+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:22:53.981266+0000","last_peered":"2024-05-09T02:22:53.981266+0000","last_clean":"2024-05-09T02:22:53.981266+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:22:53.981266+0000","last_undegraded":"2024-05-09T02:22:53.981266+0000","last_fullsized":"2024-05-09T02:22:53.981266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106954+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:22:54.106954+0000","last_peered":"2024-05-09T02:22:54.106954+0000","last_clean":"2024-05-09T02:22:54.106954+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:22:54.106954+0000","last_undegraded":"2024-05-09T02:22:54.106954+0000","last_fullsized":"2024-05-09T02:22:54.106954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"32'126","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985089+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:22:53.985089+0000","last_peered":"2024-05-09T02:22:53.985089+0000","last_clean":"2024-05-09T02:22:53.985089+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:22:53.985089+0000","last_undegraded":"2024-05-09T02:22:53.985089+0000","last_fullsized":"2024-05-09T02:22:53.985089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984760+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:22:53.984760+0000","last_peered":"2024-05-09T02:22:53.984760+0000","last_clean":"2024-05-09T02:22:53.984760+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:22:53.984760+0000","last_undegraded":"2024-05-09T02:22:53.984760+0000","last_fullsized":"2024-05-09T02:22:53.984760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981348+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:22:53.981348+0000","last_peered":"2024-05-09T02:22:53.981348+0000","last_clean":"2024-05-09T02:22:53.981348+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:22:53.981348+0000","last_undegraded":"2024-05-09T02:22:53.981348+0000","last_fullsized":"2024-05-09T02:22:53.981348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977532+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:22:53.977532+0000","last_peered":"2024-05-09T02:22:53.977532+0000","last_clean":"2024-05-09T02:22:53.977532+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:22:53.977532+0000","last_undegraded":"2024-05-09T02:22:53.977532+0000","last_fullsized":"2024-05-09T02:22:53.977532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"32'165","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970629+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:22:53.970629+0000","last_peered":"2024-05-09T02:22:53.970629+0000","last_clean":"2024-05-09T02:22:53.970629+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:22:53.970629+0000","last_undegraded":"2024-05-09T02:22:53.970629+0000","last_fullsized":"2024-05-09T02:22:53.970629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'129","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107103+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:22:54.107103+0000","last_peered":"2024-05-09T02:22:54.107103+0000","last_clean":"2024-05-09T02:22:54.107103+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:22:54.107103+0000","last_undegraded":"2024-05-09T02:22:54.107103+0000","last_fullsized":"2024-05-09T02:22:54.107103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107507+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:22:54.107507+0000","last_peered":"2024-05-09T02:22:54.107507+0000","last_clean":"2024-05-09T02:22:54.107507+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:22:54.107507+0000","last_undegraded":"2024-05-09T02:22:54.107507+0000","last_fullsized":"2024-05-09T02:22:54.107507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977075+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:22:53.977075+0000","last_peered":"2024-05-09T02:22:53.977075+0000","last_clean":"2024-05-09T02:22:53.977075+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:22:53.977075+0000","last_undegraded":"2024-05-09T02:22:53.977075+0000","last_fullsized":"2024-05-09T02:22:53.977075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984863+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:22:53.984863+0000","last_peered":"2024-05-09T02:22:53.984863+0000","last_clean":"2024-05-09T02:22:53.984863+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:22:53.984863+0000","last_undegraded":"2024-05-09T02:22:53.984863+0000","last_fullsized":"2024-05-09T02:22:53.984863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'165","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108415+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:22:54.108415+0000","last_peered":"2024-05-09T02:22:54.108415+0000","last_clean":"2024-05-09T02:22:54.108415+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:22:54.108415+0000","last_undegraded":"2024-05-09T02:22:54.108415+0000","last_fullsized":"2024-05-09T02:22:54.108415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978390+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:22:53.978390+0000","last_peered":"2024-05-09T02:22:53.978390+0000","last_clean":"2024-05-09T02:22:53.978390+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:22:53.978390+0000","last_undegraded":"2024-05-09T02:22:53.978390+0000","last_fullsized":"2024-05-09T02:22:53.978390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969841+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:22:53.969841+0000","last_peered":"2024-05-09T02:22:53.969841+0000","last_clean":"2024-05-09T02:22:53.969841+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:22:53.969841+0000","last_undegraded":"2024-05-09T02:22:53.969841+0000","last_fullsized":"2024-05-09T02:22:53.969841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"32'177","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976418+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:22:53.976418+0000","last_peered":"2024-05-09T02:22:53.976418+0000","last_clean":"2024-05-09T02:22:53.976418+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:22:53.976418+0000","last_undegraded":"2024-05-09T02:22:53.976418+0000","last_fullsized":"2024-05-09T02:22:53.976418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"31'126","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974807+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:22:53.974807+0000","last_peered":"2024-05-09T02:22:53.974807+0000","last_clean":"2024-05-09T02:22:53.974807+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:22:53.974807+0000","last_undegraded":"2024-05-09T02:22:53.974807+0000","last_fullsized":"2024-05-09T02:22:53.974807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"32'159","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976524+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:22:53.976524+0000","last_peered":"2024-05-09T02:22:53.976524+0000","last_clean":"2024-05-09T02:22:53.976524+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:22:53.976524+0000","last_undegraded":"2024-05-09T02:22:53.976524+0000","last_fullsized":"2024-05-09T02:22:53.976524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977969+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:22:53.977969+0000","last_peered":"2024-05-09T02:22:53.977969+0000","last_clean":"2024-05-09T02:22:53.977969+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:22:53.977969+0000","last_undegraded":"2024-05-09T02:22:53.977969+0000","last_fullsized":"2024-05-09T02:22:53.977969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":211620,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":435,"num_write":199,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":423240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216648,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":455,"num_write":196,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":433296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":966656,"data_stored":752122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58128,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313712,"statfs":{"total":96636764160,"available":96577241088,"internally_reserved":0,"allocated":598016,"data_stored":377043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":380928,"data_stored":162349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45444,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326396,"statfs":{"total":96636764160,"available":96590229504,"internally_reserved":0,"allocated":389120,"data_stored":161817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54184,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317656,"statfs":{"total":96636764160,"available":96581279744,"internally_reserved":0,"allocated":819200,"data_stored":587271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":372736,"data_stored":161657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49808,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":598016,"data_stored":371581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50172,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321668,"statfs":{"total":96636764160,"available":96585388032,"internally_reserved":0,"allocated":970752,"data_stored":752088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":215850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":215345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:23:12.282 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T02:23:12.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:23:12.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.394+0000 7ffad00ee640 1 Processor -- start 2024-05-09T02:23:12.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.395+0000 7ffad00ee640 1 -- start start 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffad00ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffac8140d40 0x7ffac80c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffad00ee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffac80c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffad00ee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac81588b0 con 0x7ffac81584a0 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffad00ee640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ffac806f010 con 0x7ffac8140d40 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffad00ee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffac806ed30 con 0x7ffac80c1e20 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffacd689640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffac81584a0 0x7ffac806e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45058/0 (socket says 172.21.15.46:45058) 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffacd689640 1 -- 172.21.15.46:0/1840793074 learned_addr learned my addr 172.21.15.46:0/1840793074 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffacde8a640 1 --2- 172.21.15.46:0/1840793074 >> v2:172.21.15.107:3300/0 conn(0x7ffac8140d40 0x7ffac80c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7fface68b640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffac80c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790230790 0 0) 0x7ffac81588b0 con 0x7ffac81584a0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.396+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab4003520 con 0x7ffac81584a0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1654964493 0 0) 0x7ffab4003520 con 0x7ffac81584a0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 msgr2=0x7ffac80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffac80c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 >> v2:172.21.15.107:3300/0 conn(0x7ffac8140d40 msgr2=0x7ffac80c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 --2- 172.21.15.46:0/1840793074 >> v2:172.21.15.107:3300/0 conn(0x7ffac8140d40 0x7ffac80c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac80c7930 con 0x7ffac81584a0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7ffab80016f0 con 0x7ffac81584a0 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7fface68b640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffac80c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 >> v1:172.21.15.46:6789/0 conn(0x7ffac81584a0 legacy=0x7ffac806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffab4003a00 0x7ffab4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffab4004800 0x7ffab4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffab4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffac806f010 con 0x7ffab4003a00 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffac806ed30 con 0x7ffab4004800 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffab400baa0 con 0x7ffac80c1e20 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacde8a640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffab4003a00 0x7ffab4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacd689640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffab4004800 0x7ffab4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7fface68b640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffab4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacde8a640 1 -- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 msgr2=0x7ffab4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacde8a640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffac80c1e20 0x7ffab4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacde8a640 1 -- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffab4004800 msgr2=0x7ffab4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacde8a640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffab4004800 0x7ffab4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.397+0000 7ffacde8a640 1 -- 172.21.15.46:0/1840793074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab4003520 con 0x7ffab4003a00 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.398+0000 7ffacde8a640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffab4003a00 0x7ffab4003e70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffac806f990 tx=0x7ffab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c901716fd82d78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.398+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4036070 con 0x7ffab4003a00 2024-05-09T02:23:12.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.398+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4031400 con 0x7ffab4003a00 2024-05-09T02:23:12.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.398+0000 7ffacce88640 1 -- 172.21.15.46:0/1840793074 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4009690 con 0x7ffab4003a00 2024-05-09T02:23:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7ffad00ee640 1 -- 172.21.15.46:0/1840793074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffab4003a00 msgr2=0x7ffab4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7ffad00ee640 1 --2- 172.21.15.46:0/1840793074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffab4003a00 0x7ffab4003e70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffac806f990 tx=0x7ffab4005830 comp rx=0 tx=0).stop 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7fface68b640 1 -- 172.21.15.46:0/1840793074 reap_dead start 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7ffad00ee640 1 -- 172.21.15.46:0/1840793074 shutdown_connections 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7ffad00ee640 1 -- 172.21.15.46:0/1840793074 >> 172.21.15.46:0/1840793074 conn(0x7ffac8068e00 msgr2=0x7ffac80c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7ffad00ee640 1 -- 172.21.15.46:0/1840793074 shutdown_connections 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.399+0000 7ffad00ee640 1 -- 172.21.15.46:0/1840793074 wait complete. 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.401+0000 7ffad00ee640 1 Processor -- start 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.401+0000 7ffad00ee640 1 -- start start 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffad00ee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffab4003a00 0x7ffac813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffad00ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac81ee750 0x7ffac80c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffad00ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 0x7ffac815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffad00ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80c2230 con 0x7ffac80c5d70 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffad00ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80c7ef0 con 0x7ffac81ee750 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffad00ee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ffac80c23b0 con 0x7ffab4003a00 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 0x7ffac815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 0x7ffac815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59344/0 (socket says 172.21.15.46:59344) 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 -- 172.21.15.46:0/2615855029 learned_addr learned my addr 172.21.15.46:0/2615855029 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffacd689640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac81ee750 0x7ffac80c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffacde8a640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffab4003a00 0x7ffac813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 -- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffab4003a00 msgr2=0x7ffac813f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffab4003a00 0x7ffac813f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 -- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac81ee750 msgr2=0x7ffac80c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac81ee750 0x7ffac80c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7fface68b640 1 -- 172.21.15.46:0/2615855029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac815be50 con 0x7ffac80c5d70 2024-05-09T02:23:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.402+0000 7ffacd689640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac81ee750 0x7ffac80c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.403+0000 7fface68b640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 0x7ffac815aa60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffac80c98b0 tx=0x7ffac0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.403+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011dd0 con 0x7ffac80c5d70 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.403+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac001b070 con 0x7ffac80c5d70 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.403+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac815b890 con 0x7ffac80c5d70 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.403+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0003990 con 0x7ffac80c5d70 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.403+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac80c5030 con 0x7ffac80c5d70 2024-05-09T02:23:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.404+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac806d030 con 0x7ffac80c5d70 2024-05-09T02:23:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.405+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffac0003b30 con 0x7ffac80c5d70 2024-05-09T02:23:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.405+0000 7ffabe7fc640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ffaac076300 0x7ffaac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.405+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ffac00983f0 con 0x7ffac80c5d70 2024-05-09T02:23:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.405+0000 7ffacde8a640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ffaac076300 0x7ffaac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.406+0000 7ffacde8a640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ffaac076300 0x7ffaac078810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffac4033000 tx=0x7ffac4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.410+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffac0003e20 con 0x7ffac80c5d70 2024-05-09T02:23:12.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.602+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffac81eec50 con 0x7ffaac076300 2024-05-09T02:23:12.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.615+0000 7ffabe7fc640 1 -- 172.21.15.46:0/2615855029 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492398 (secure 0 0 0) 0x7ffac81eec50 con 0x7ffaac076300 2024-05-09T02:23:12.623 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:12.627 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:23:12.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ffaac076300 msgr2=0x7ffaac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ffaac076300 0x7ffaac078810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffac4033000 tx=0x7ffac4008030 comp rx=0 tx=0).stop 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 msgr2=0x7ffac815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 0x7ffac815aa60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffac80c98b0 tx=0x7ffac0009f90 comp rx=0 tx=0).stop 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 shutdown_connections 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ffaac076300 0x7ffaac078810 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac80c5d70 0x7ffac815aa60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac81ee750 0x7ffac80c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 --2- 172.21.15.46:0/2615855029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffab4003a00 0x7ffac813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 >> 172.21.15.46:0/2615855029 conn(0x7ffac8068e00 msgr2=0x7ffac8155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 shutdown_connections 2024-05-09T02:23:12.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.619+0000 7ffad00ee640 1 -- 172.21.15.46:0/2615855029 wait complete. 2024-05-09T02:23:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-09T02:23:12.588958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018636,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":546,"num_read_kb":945,"num_write":18928,"num_write_kb":50333845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18909,"ondisk_log_size":18909,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415408,"kb_used_data":4976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754559312,"statfs":{"total":773094113280,"available":772668735488,"internally_reserved":0,"allocated":5095424,"data_stored":3325928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":420204083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14884,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":69,"num_write":25,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004103"},"pg_stats":[{"pgid":"5.18","version":"32'162","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969855+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:22:53.969855+0000","last_peered":"2024-05-09T02:22:53.969855+0000","last_clean":"2024-05-09T02:22:53.969855+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:22:53.969855+0000","last_undegraded":"2024-05-09T02:22:53.969855+0000","last_fullsized":"2024-05-09T02:22:53.969855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"33'7","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996769+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:22:53.996769+0000","last_peered":"2024-05-09T02:22:53.996769+0000","last_clean":"2024-05-09T02:22:53.996769+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:22:53.996769+0000","last_undegraded":"2024-05-09T02:22:53.996769+0000","last_fullsized":"2024-05-09T02:22:53.996769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:46.679852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986226+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:22:53.986226+0000","last_peered":"2024-05-09T02:22:53.986226+0000","last_clean":"2024-05-09T02:22:53.986226+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:22:53.986226+0000","last_undegraded":"2024-05-09T02:22:53.986226+0000","last_fullsized":"2024-05-09T02:22:53.986226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984541+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:22:53.984541+0000","last_peered":"2024-05-09T02:22:53.984541+0000","last_clean":"2024-05-09T02:22:53.984541+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:22:53.984541+0000","last_undegraded":"2024-05-09T02:22:53.984541+0000","last_fullsized":"2024-05-09T02:22:53.984541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:25.540838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"32'147","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970416+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:22:53.970416+0000","last_peered":"2024-05-09T02:22:53.970416+0000","last_clean":"2024-05-09T02:22:53.970416+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:22:53.970416+0000","last_undegraded":"2024-05-09T02:22:53.970416+0000","last_fullsized":"2024-05-09T02:22:53.970416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986511+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:22:53.986511+0000","last_peered":"2024-05-09T02:22:53.986511+0000","last_clean":"2024-05-09T02:22:53.986511+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:22:53.986511+0000","last_undegraded":"2024-05-09T02:22:53.986511+0000","last_fullsized":"2024-05-09T02:22:53.986511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969340+0000","last_change":"2024-05-09T02:18:14.153931+0000","last_active":"2024-05-09T02:22:53.969340+0000","last_peered":"2024-05-09T02:22:53.969340+0000","last_clean":"2024-05-09T02:22:53.969340+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:22:53.969340+0000","last_undegraded":"2024-05-09T02:22:53.969340+0000","last_fullsized":"2024-05-09T02:22:53.969340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:03.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969945+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:22:53.969945+0000","last_peered":"2024-05-09T02:22:53.969945+0000","last_clean":"2024-05-09T02:22:53.969945+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:22:53.969945+0000","last_undegraded":"2024-05-09T02:22:53.969945+0000","last_fullsized":"2024-05-09T02:22:53.969945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976679+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:22:53.976679+0000","last_peered":"2024-05-09T02:22:53.976679+0000","last_clean":"2024-05-09T02:22:53.976679+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:22:53.976679+0000","last_undegraded":"2024-05-09T02:22:53.976679+0000","last_fullsized":"2024-05-09T02:22:53.976679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.988297+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:22:56.988297+0000","last_peered":"2024-05-09T02:22:56.988297+0000","last_clean":"2024-05-09T02:22:56.988297+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:22:56.988297+0000","last_undegraded":"2024-05-09T02:22:56.988297+0000","last_fullsized":"2024-05-09T02:22:56.988297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'132","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108425+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:22:54.108425+0000","last_peered":"2024-05-09T02:22:54.108425+0000","last_clean":"2024-05-09T02:22:54.108425+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:22:54.108425+0000","last_undegraded":"2024-05-09T02:22:54.108425+0000","last_fullsized":"2024-05-09T02:22:54.108425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970514+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:22:53.970514+0000","last_peered":"2024-05-09T02:22:53.970514+0000","last_clean":"2024-05-09T02:22:53.970514+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:22:53.970514+0000","last_undegraded":"2024-05-09T02:22:53.970514+0000","last_fullsized":"2024-05-09T02:22:53.970514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107050+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:22:54.107050+0000","last_peered":"2024-05-09T02:22:54.107050+0000","last_clean":"2024-05-09T02:22:54.107050+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:22:54.107050+0000","last_undegraded":"2024-05-09T02:22:54.107050+0000","last_fullsized":"2024-05-09T02:22:54.107050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984071+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:22:56.984071+0000","last_peered":"2024-05-09T02:22:56.984071+0000","last_clean":"2024-05-09T02:22:56.984071+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:22:56.984071+0000","last_undegraded":"2024-05-09T02:22:56.984071+0000","last_fullsized":"2024-05-09T02:22:56.984071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'168","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108041+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:22:54.108041+0000","last_peered":"2024-05-09T02:22:54.108041+0000","last_clean":"2024-05-09T02:22:54.108041+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:22:54.108041+0000","last_undegraded":"2024-05-09T02:22:54.108041+0000","last_fullsized":"2024-05-09T02:22:54.108041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971555+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:22:53.971555+0000","last_peered":"2024-05-09T02:22:53.971555+0000","last_clean":"2024-05-09T02:22:53.971555+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:22:53.971555+0000","last_undegraded":"2024-05-09T02:22:53.971555+0000","last_fullsized":"2024-05-09T02:22:53.971555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971155+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:22:53.971155+0000","last_peered":"2024-05-09T02:22:53.971155+0000","last_clean":"2024-05-09T02:22:53.971155+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:22:53.971155+0000","last_undegraded":"2024-05-09T02:22:53.971155+0000","last_fullsized":"2024-05-09T02:22:53.971155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:21.846373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981206+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:22:53.981206+0000","last_peered":"2024-05-09T02:22:53.981206+0000","last_clean":"2024-05-09T02:22:53.981206+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:22:53.981206+0000","last_undegraded":"2024-05-09T02:22:53.981206+0000","last_fullsized":"2024-05-09T02:22:53.981206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'7","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996527+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:22:53.996527+0000","last_peered":"2024-05-09T02:22:53.996527+0000","last_clean":"2024-05-09T02:22:53.996527+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:22:53.996527+0000","last_undegraded":"2024-05-09T02:22:53.996527+0000","last_fullsized":"2024-05-09T02:22:53.996527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970513+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:22:53.970513+0000","last_peered":"2024-05-09T02:22:53.970513+0000","last_clean":"2024-05-09T02:22:53.970513+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:22:53.970513+0000","last_undegraded":"2024-05-09T02:22:53.970513+0000","last_fullsized":"2024-05-09T02:22:53.970513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978415+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:22:53.978415+0000","last_peered":"2024-05-09T02:22:53.978415+0000","last_clean":"2024-05-09T02:22:53.978415+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:22:53.978415+0000","last_undegraded":"2024-05-09T02:22:53.978415+0000","last_fullsized":"2024-05-09T02:22:53.978415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:43.227458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'135","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985777+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:22:53.985777+0000","last_peered":"2024-05-09T02:22:53.985777+0000","last_clean":"2024-05-09T02:22:53.985777+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:22:53.985777+0000","last_undegraded":"2024-05-09T02:22:53.985777+0000","last_fullsized":"2024-05-09T02:22:53.985777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971841+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:22:53.971841+0000","last_peered":"2024-05-09T02:22:53.971841+0000","last_clean":"2024-05-09T02:22:53.971841+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:22:53.971841+0000","last_undegraded":"2024-05-09T02:22:53.971841+0000","last_fullsized":"2024-05-09T02:22:53.971841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971018+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:22:53.971018+0000","last_peered":"2024-05-09T02:22:53.971018+0000","last_clean":"2024-05-09T02:22:53.971018+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:22:53.971018+0000","last_undegraded":"2024-05-09T02:22:53.971018+0000","last_fullsized":"2024-05-09T02:22:53.971018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970419+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:22:53.970419+0000","last_peered":"2024-05-09T02:22:53.970419+0000","last_clean":"2024-05-09T02:22:53.970419+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:22:53.970419+0000","last_undegraded":"2024-05-09T02:22:53.970419+0000","last_fullsized":"2024-05-09T02:22:53.970419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985368+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:22:53.985368+0000","last_peered":"2024-05-09T02:22:53.985368+0000","last_clean":"2024-05-09T02:22:53.985368+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:22:53.985368+0000","last_undegraded":"2024-05-09T02:22:53.985368+0000","last_fullsized":"2024-05-09T02:22:53.985368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972195+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:22:53.972195+0000","last_peered":"2024-05-09T02:22:53.972195+0000","last_clean":"2024-05-09T02:22:53.972195+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:22:53.972195+0000","last_undegraded":"2024-05-09T02:22:53.972195+0000","last_fullsized":"2024-05-09T02:22:53.972195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975149+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:22:53.975149+0000","last_peered":"2024-05-09T02:22:53.975149+0000","last_clean":"2024-05-09T02:22:53.975149+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:22:53.975149+0000","last_undegraded":"2024-05-09T02:22:53.975149+0000","last_fullsized":"2024-05-09T02:22:53.975149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108475+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:22:54.108475+0000","last_peered":"2024-05-09T02:22:54.108475+0000","last_clean":"2024-05-09T02:22:54.108475+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:22:54.108475+0000","last_undegraded":"2024-05-09T02:22:54.108475+0000","last_fullsized":"2024-05-09T02:22:54.108475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971430+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:22:53.971430+0000","last_peered":"2024-05-09T02:22:53.971430+0000","last_clean":"2024-05-09T02:22:53.971430+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:22:53.971430+0000","last_undegraded":"2024-05-09T02:22:53.971430+0000","last_fullsized":"2024-05-09T02:22:53.971430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977614+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:22:53.977614+0000","last_peered":"2024-05-09T02:22:53.977614+0000","last_clean":"2024-05-09T02:22:53.977614+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:22:53.977614+0000","last_undegraded":"2024-05-09T02:22:53.977614+0000","last_fullsized":"2024-05-09T02:22:53.977614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970761+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:22:53.970761+0000","last_peered":"2024-05-09T02:22:53.970761+0000","last_clean":"2024-05-09T02:22:53.970761+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:22:53.970761+0000","last_undegraded":"2024-05-09T02:22:53.970761+0000","last_fullsized":"2024-05-09T02:22:53.970761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984174+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:22:53.984174+0000","last_peered":"2024-05-09T02:22:53.984174+0000","last_clean":"2024-05-09T02:22:53.984174+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:22:53.984174+0000","last_undegraded":"2024-05-09T02:22:53.984174+0000","last_fullsized":"2024-05-09T02:22:53.984174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971160+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:22:53.971160+0000","last_peered":"2024-05-09T02:22:53.971160+0000","last_clean":"2024-05-09T02:22:53.971160+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:22:53.971160+0000","last_undegraded":"2024-05-09T02:22:53.971160+0000","last_fullsized":"2024-05-09T02:22:53.971160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.985077+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:22:56.985077+0000","last_peered":"2024-05-09T02:22:56.985077+0000","last_clean":"2024-05-09T02:22:56.985077+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:22:56.985077+0000","last_undegraded":"2024-05-09T02:22:56.985077+0000","last_fullsized":"2024-05-09T02:22:56.985077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.936277+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:23:01.936277+0000","last_peered":"2024-05-09T02:23:01.936277+0000","last_clean":"2024-05-09T02:23:01.936277+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:23:01.936277+0000","last_undegraded":"2024-05-09T02:23:01.936277+0000","last_fullsized":"2024-05-09T02:23:01.936277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969835+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:22:53.969835+0000","last_peered":"2024-05-09T02:22:53.969835+0000","last_clean":"2024-05-09T02:22:53.969835+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:22:53.969835+0000","last_undegraded":"2024-05-09T02:22:53.969835+0000","last_fullsized":"2024-05-09T02:22:53.969835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985416+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:22:53.985416+0000","last_peered":"2024-05-09T02:22:53.985416+0000","last_clean":"2024-05-09T02:22:53.985416+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:22:53.985416+0000","last_undegraded":"2024-05-09T02:22:53.985416+0000","last_fullsized":"2024-05-09T02:22:53.985416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'21","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.976097+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:22:58.976097+0000","last_peered":"2024-05-09T02:22:58.976097+0000","last_clean":"2024-05-09T02:22:58.976097+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:22:58.976097+0000","last_undegraded":"2024-05-09T02:22:58.976097+0000","last_fullsized":"2024-05-09T02:22:58.976097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984244+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:22:53.984244+0000","last_peered":"2024-05-09T02:22:53.984244+0000","last_clean":"2024-05-09T02:22:53.984244+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:22:53.984244+0000","last_undegraded":"2024-05-09T02:22:53.984244+0000","last_fullsized":"2024-05-09T02:22:53.984244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'150","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980650+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:22:53.980650+0000","last_peered":"2024-05-09T02:22:53.980650+0000","last_clean":"2024-05-09T02:22:53.980650+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:22:53.980650+0000","last_undegraded":"2024-05-09T02:22:53.980650+0000","last_fullsized":"2024-05-09T02:22:53.980650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"31'135","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971639+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:22:53.971639+0000","last_peered":"2024-05-09T02:22:53.971639+0000","last_clean":"2024-05-09T02:22:53.971639+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:22:53.971639+0000","last_undegraded":"2024-05-09T02:22:53.971639+0000","last_fullsized":"2024-05-09T02:22:53.971639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979037+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:22:53.979037+0000","last_peered":"2024-05-09T02:22:53.979037+0000","last_clean":"2024-05-09T02:22:53.979037+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:22:53.979037+0000","last_undegraded":"2024-05-09T02:22:53.979037+0000","last_fullsized":"2024-05-09T02:22:53.979037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970261+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:22:53.970261+0000","last_peered":"2024-05-09T02:22:53.970261+0000","last_clean":"2024-05-09T02:22:53.970261+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:22:53.970261+0000","last_undegraded":"2024-05-09T02:22:53.970261+0000","last_fullsized":"2024-05-09T02:22:53.970261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970935+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:22:53.970935+0000","last_peered":"2024-05-09T02:22:53.970935+0000","last_clean":"2024-05-09T02:22:53.970935+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:22:53.970935+0000","last_undegraded":"2024-05-09T02:22:53.970935+0000","last_fullsized":"2024-05-09T02:22:53.970935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108245+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:22:54.108245+0000","last_peered":"2024-05-09T02:22:54.108245+0000","last_clean":"2024-05-09T02:22:54.108245+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:22:54.108245+0000","last_undegraded":"2024-05-09T02:22:54.108245+0000","last_fullsized":"2024-05-09T02:22:54.108245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.973716+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:22:53.973716+0000","last_peered":"2024-05-09T02:22:53.973716+0000","last_clean":"2024-05-09T02:22:53.973716+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:22:53.973716+0000","last_undegraded":"2024-05-09T02:22:53.973716+0000","last_fullsized":"2024-05-09T02:22:53.973716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971133+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:22:53.971133+0000","last_peered":"2024-05-09T02:22:53.971133+0000","last_clean":"2024-05-09T02:22:53.971133+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:22:53.971133+0000","last_undegraded":"2024-05-09T02:22:53.971133+0000","last_fullsized":"2024-05-09T02:22:53.971133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969454+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:22:53.969454+0000","last_peered":"2024-05-09T02:22:53.969454+0000","last_clean":"2024-05-09T02:22:53.969454+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:22:53.969454+0000","last_undegraded":"2024-05-09T02:22:53.969454+0000","last_fullsized":"2024-05-09T02:22:53.969454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970783+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:22:53.970783+0000","last_peered":"2024-05-09T02:22:53.970783+0000","last_clean":"2024-05-09T02:22:53.970783+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:22:53.970783+0000","last_undegraded":"2024-05-09T02:22:53.970783+0000","last_fullsized":"2024-05-09T02:22:53.970783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108236+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:22:54.108236+0000","last_peered":"2024-05-09T02:22:54.108236+0000","last_clean":"2024-05-09T02:22:54.108236+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:22:54.108236+0000","last_undegraded":"2024-05-09T02:22:54.108236+0000","last_fullsized":"2024-05-09T02:22:54.108236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971514+0000","last_change":"2024-05-09T02:18:22.194682+0000","last_active":"2024-05-09T02:22:53.971514+0000","last_peered":"2024-05-09T02:22:53.971514+0000","last_clean":"2024-05-09T02:22:53.971514+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:22:53.971514+0000","last_undegraded":"2024-05-09T02:22:53.971514+0000","last_fullsized":"2024-05-09T02:22:53.971514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"32'156","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979396+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:22:53.979396+0000","last_peered":"2024-05-09T02:22:53.979396+0000","last_clean":"2024-05-09T02:22:53.979396+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:22:53.979396+0000","last_undegraded":"2024-05-09T02:22:53.979396+0000","last_fullsized":"2024-05-09T02:22:53.979396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:38.684694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972577+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:22:53.972577+0000","last_peered":"2024-05-09T02:22:53.972577+0000","last_clean":"2024-05-09T02:22:53.972577+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:22:53.972577+0000","last_undegraded":"2024-05-09T02:22:53.972577+0000","last_fullsized":"2024-05-09T02:22:53.972577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'7","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.979322+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:22:58.979322+0000","last_peered":"2024-05-09T02:22:58.979322+0000","last_clean":"2024-05-09T02:22:58.979322+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:22:58.979322+0000","last_undegraded":"2024-05-09T02:22:58.979322+0000","last_fullsized":"2024-05-09T02:22:58.979322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975286+0000","last_change":"2024-05-09T02:18:22.197113+0000","last_active":"2024-05-09T02:22:53.975286+0000","last_peered":"2024-05-09T02:22:53.975286+0000","last_clean":"2024-05-09T02:22:53.975286+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:22:53.975286+0000","last_undegraded":"2024-05-09T02:22:53.975286+0000","last_fullsized":"2024-05-09T02:22:53.975286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:43.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108653+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:22:54.108653+0000","last_peered":"2024-05-09T02:22:54.108653+0000","last_clean":"2024-05-09T02:22:54.108653+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:22:54.108653+0000","last_undegraded":"2024-05-09T02:22:54.108653+0000","last_fullsized":"2024-05-09T02:22:54.108653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969060+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:22:53.969060+0000","last_peered":"2024-05-09T02:22:53.969060+0000","last_clean":"2024-05-09T02:22:53.969060+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:22:53.969060+0000","last_undegraded":"2024-05-09T02:22:53.969060+0000","last_fullsized":"2024-05-09T02:22:53.969060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:28.944571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977964+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:22:53.977964+0000","last_peered":"2024-05-09T02:22:53.977964+0000","last_clean":"2024-05-09T02:22:53.977964+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:22:53.977964+0000","last_undegraded":"2024-05-09T02:22:53.977964+0000","last_fullsized":"2024-05-09T02:22:53.977964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'22","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:00.928540+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:23:00.928540+0000","last_peered":"2024-05-09T02:23:00.928540+0000","last_clean":"2024-05-09T02:23:00.928540+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:23:00.928540+0000","last_undegraded":"2024-05-09T02:23:00.928540+0000","last_fullsized":"2024-05-09T02:23:00.928540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:48:00.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'135","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977106+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:22:53.977106+0000","last_peered":"2024-05-09T02:22:53.977106+0000","last_clean":"2024-05-09T02:22:53.977106+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:22:53.977106+0000","last_undegraded":"2024-05-09T02:22:53.977106+0000","last_fullsized":"2024-05-09T02:22:53.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'150","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985827+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:22:53.985827+0000","last_peered":"2024-05-09T02:22:53.985827+0000","last_clean":"2024-05-09T02:22:53.985827+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:22:53.985827+0000","last_undegraded":"2024-05-09T02:22:53.985827+0000","last_fullsized":"2024-05-09T02:22:53.985827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107278+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:22:54.107278+0000","last_peered":"2024-05-09T02:22:54.107278+0000","last_clean":"2024-05-09T02:22:54.107278+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:22:54.107278+0000","last_undegraded":"2024-05-09T02:22:54.107278+0000","last_fullsized":"2024-05-09T02:22:54.107278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978232+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:22:53.978232+0000","last_peered":"2024-05-09T02:22:53.978232+0000","last_clean":"2024-05-09T02:22:53.978232+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:22:53.978232+0000","last_undegraded":"2024-05-09T02:22:53.978232+0000","last_fullsized":"2024-05-09T02:22:53.978232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980476+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:22:53.980476+0000","last_peered":"2024-05-09T02:22:53.980476+0000","last_clean":"2024-05-09T02:22:53.980476+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:22:53.980476+0000","last_undegraded":"2024-05-09T02:22:53.980476+0000","last_fullsized":"2024-05-09T02:22:53.980476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"32'135","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979276+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:22:53.979276+0000","last_peered":"2024-05-09T02:22:53.979276+0000","last_clean":"2024-05-09T02:22:53.979276+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:22:53.979276+0000","last_undegraded":"2024-05-09T02:22:53.979276+0000","last_fullsized":"2024-05-09T02:22:53.979276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.690441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978295+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:22:53.978295+0000","last_peered":"2024-05-09T02:22:53.978295+0000","last_clean":"2024-05-09T02:22:53.978295+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:22:53.978295+0000","last_undegraded":"2024-05-09T02:22:53.978295+0000","last_fullsized":"2024-05-09T02:22:53.978295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979181+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:22:53.979181+0000","last_peered":"2024-05-09T02:22:53.979181+0000","last_clean":"2024-05-09T02:22:53.979181+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:22:53.979181+0000","last_undegraded":"2024-05-09T02:22:53.979181+0000","last_fullsized":"2024-05-09T02:22:53.979181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980574+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:22:53.980574+0000","last_peered":"2024-05-09T02:22:53.980574+0000","last_clean":"2024-05-09T02:22:53.980574+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:22:53.980574+0000","last_undegraded":"2024-05-09T02:22:53.980574+0000","last_fullsized":"2024-05-09T02:22:53.980574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978092+0000","last_change":"2024-05-09T02:18:23.204925+0000","last_active":"2024-05-09T02:22:53.978092+0000","last_peered":"2024-05-09T02:22:53.978092+0000","last_clean":"2024-05-09T02:22:53.978092+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:22:53.978092+0000","last_undegraded":"2024-05-09T02:22:53.978092+0000","last_fullsized":"2024-05-09T02:22:53.978092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:26.946425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'138","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978097+0000","last_change":"2024-05-09T02:18:55.756927+0000","last_active":"2024-05-09T02:22:53.978097+0000","last_peered":"2024-05-09T02:22:53.978097+0000","last_clean":"2024-05-09T02:22:53.978097+0000","last_became_active":"2024-05-09T02:18:55.756398+0000","last_became_peered":"2024-05-09T02:18:55.756398+0000","last_unstale":"2024-05-09T02:22:53.978097+0000","last_undegraded":"2024-05-09T02:22:53.978097+0000","last_fullsized":"2024-05-09T02:22:53.978097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975232+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:22:53.975232+0000","last_peered":"2024-05-09T02:22:53.975232+0000","last_clean":"2024-05-09T02:22:53.975232+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:22:53.975232+0000","last_undegraded":"2024-05-09T02:22:53.975232+0000","last_fullsized":"2024-05-09T02:22:53.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'7","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970048+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:22:53.970048+0000","last_peered":"2024-05-09T02:22:53.970048+0000","last_clean":"2024-05-09T02:22:53.970048+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:22:53.970048+0000","last_undegraded":"2024-05-09T02:22:53.970048+0000","last_fullsized":"2024-05-09T02:22:53.970048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976514+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:22:53.976514+0000","last_peered":"2024-05-09T02:22:53.976514+0000","last_clean":"2024-05-09T02:22:53.976514+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:22:53.976514+0000","last_undegraded":"2024-05-09T02:22:53.976514+0000","last_fullsized":"2024-05-09T02:22:53.976514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978683+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:22:53.978683+0000","last_peered":"2024-05-09T02:22:53.978683+0000","last_clean":"2024-05-09T02:22:53.978683+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:22:53.978683+0000","last_undegraded":"2024-05-09T02:22:53.978683+0000","last_fullsized":"2024-05-09T02:22:53.978683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984458+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:22:56.984458+0000","last_peered":"2024-05-09T02:22:56.984458+0000","last_clean":"2024-05-09T02:22:56.984458+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:22:56.984458+0000","last_undegraded":"2024-05-09T02:22:56.984458+0000","last_fullsized":"2024-05-09T02:22:56.984458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106855+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:22:54.106855+0000","last_peered":"2024-05-09T02:22:54.106855+0000","last_clean":"2024-05-09T02:22:54.106855+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:22:54.106855+0000","last_undegraded":"2024-05-09T02:22:54.106855+0000","last_fullsized":"2024-05-09T02:22:54.106855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977966+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:22:53.977966+0000","last_peered":"2024-05-09T02:22:53.977966+0000","last_clean":"2024-05-09T02:22:53.977966+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:22:53.977966+0000","last_undegraded":"2024-05-09T02:22:53.977966+0000","last_fullsized":"2024-05-09T02:22:53.977966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:50.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978422+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:22:53.978422+0000","last_peered":"2024-05-09T02:22:53.978422+0000","last_clean":"2024-05-09T02:22:53.978422+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:22:53.978422+0000","last_undegraded":"2024-05-09T02:22:53.978422+0000","last_fullsized":"2024-05-09T02:22:53.978422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971819+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:22:53.971819+0000","last_peered":"2024-05-09T02:22:53.971819+0000","last_clean":"2024-05-09T02:22:53.971819+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:22:53.971819+0000","last_undegraded":"2024-05-09T02:22:53.971819+0000","last_fullsized":"2024-05-09T02:22:53.971819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969924+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:22:53.969924+0000","last_peered":"2024-05-09T02:22:53.969924+0000","last_clean":"2024-05-09T02:22:53.969924+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:22:53.969924+0000","last_undegraded":"2024-05-09T02:22:53.969924+0000","last_fullsized":"2024-05-09T02:22:53.969924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"32'132","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984777+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:22:53.984777+0000","last_peered":"2024-05-09T02:22:53.984777+0000","last_clean":"2024-05-09T02:22:53.984777+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:22:53.984777+0000","last_undegraded":"2024-05-09T02:22:53.984777+0000","last_fullsized":"2024-05-09T02:22:53.984777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:48.907509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978087+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:22:53.978087+0000","last_peered":"2024-05-09T02:22:53.978087+0000","last_clean":"2024-05-09T02:22:53.978087+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:22:53.978087+0000","last_undegraded":"2024-05-09T02:22:53.978087+0000","last_fullsized":"2024-05-09T02:22:53.978087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'9","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.987000+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:22:56.987000+0000","last_peered":"2024-05-09T02:22:56.987000+0000","last_clean":"2024-05-09T02:22:56.987000+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:22:56.987000+0000","last_undegraded":"2024-05-09T02:22:56.987000+0000","last_fullsized":"2024-05-09T02:22:56.987000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:30:33.368298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971101+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:22:53.971101+0000","last_peered":"2024-05-09T02:22:53.971101+0000","last_clean":"2024-05-09T02:22:53.971101+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:22:53.971101+0000","last_undegraded":"2024-05-09T02:22:53.971101+0000","last_fullsized":"2024-05-09T02:22:53.971101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:43.925097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"32'219","reported_seq":247,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107776+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:22:54.107776+0000","last_peered":"2024-05-09T02:22:54.107776+0000","last_clean":"2024-05-09T02:22:54.107776+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:22:54.107776+0000","last_undegraded":"2024-05-09T02:22:54.107776+0000","last_fullsized":"2024-05-09T02:22:54.107776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980895+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:22:53.980895+0000","last_peered":"2024-05-09T02:22:53.980895+0000","last_clean":"2024-05-09T02:22:53.980895+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:22:53.980895+0000","last_undegraded":"2024-05-09T02:22:53.980895+0000","last_fullsized":"2024-05-09T02:22:53.980895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985237+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:22:53.985237+0000","last_peered":"2024-05-09T02:22:53.985237+0000","last_clean":"2024-05-09T02:22:53.985237+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:22:53.985237+0000","last_undegraded":"2024-05-09T02:22:53.985237+0000","last_fullsized":"2024-05-09T02:22:53.985237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:09.715806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107190+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:22:54.107190+0000","last_peered":"2024-05-09T02:22:54.107190+0000","last_clean":"2024-05-09T02:22:54.107190+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:22:54.107190+0000","last_undegraded":"2024-05-09T02:22:54.107190+0000","last_fullsized":"2024-05-09T02:22:54.107190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977431+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:22:53.977431+0000","last_peered":"2024-05-09T02:22:53.977431+0000","last_clean":"2024-05-09T02:22:53.977431+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:22:53.977431+0000","last_undegraded":"2024-05-09T02:22:53.977431+0000","last_fullsized":"2024-05-09T02:22:53.977431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108124+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:22:54.108124+0000","last_peered":"2024-05-09T02:22:54.108124+0000","last_clean":"2024-05-09T02:22:54.108124+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:22:54.108124+0000","last_undegraded":"2024-05-09T02:22:54.108124+0000","last_fullsized":"2024-05-09T02:22:54.108124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'111","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576573+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:23:01.576573+0000","last_peered":"2024-05-09T02:23:01.576573+0000","last_clean":"2024-05-09T02:23:01.576573+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:23:01.576573+0000","last_undegraded":"2024-05-09T02:23:01.576573+0000","last_fullsized":"2024-05-09T02:23:01.576573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:54.899250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":214,"num_write":106,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985967+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:22:53.985967+0000","last_peered":"2024-05-09T02:22:53.985967+0000","last_clean":"2024-05-09T02:22:53.985967+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:22:53.985967+0000","last_undegraded":"2024-05-09T02:22:53.985967+0000","last_fullsized":"2024-05-09T02:22:53.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:15.783153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'148","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969742+0000","last_change":"2024-05-09T02:18:14.151524+0000","last_active":"2024-05-09T02:22:53.969742+0000","last_peered":"2024-05-09T02:22:53.969742+0000","last_clean":"2024-05-09T02:22:53.969742+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:22:53.969742+0000","last_undegraded":"2024-05-09T02:22:53.969742+0000","last_fullsized":"2024-05-09T02:22:53.969742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.577018+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:22:56.577018+0000","last_peered":"2024-05-09T02:22:56.577018+0000","last_clean":"2024-05-09T02:22:56.577018+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:22:56.577018+0000","last_undegraded":"2024-05-09T02:22:56.577018+0000","last_fullsized":"2024-05-09T02:22:56.577018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.939508+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:23:01.939508+0000","last_peered":"2024-05-09T02:23:01.939508+0000","last_clean":"2024-05-09T02:23:01.939508+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:23:01.939508+0000","last_undegraded":"2024-05-09T02:23:01.939508+0000","last_fullsized":"2024-05-09T02:23:01.939508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"32'156","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984948+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:22:53.984948+0000","last_peered":"2024-05-09T02:22:53.984948+0000","last_clean":"2024-05-09T02:22:53.984948+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:22:53.984948+0000","last_undegraded":"2024-05-09T02:22:53.984948+0000","last_fullsized":"2024-05-09T02:22:53.984948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977657+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:22:53.977657+0000","last_peered":"2024-05-09T02:22:53.977657+0000","last_clean":"2024-05-09T02:22:53.977657+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:22:53.977657+0000","last_undegraded":"2024-05-09T02:22:53.977657+0000","last_fullsized":"2024-05-09T02:22:53.977657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'111","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:03.257459+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:23:03.257459+0000","last_peered":"2024-05-09T02:23:03.257459+0000","last_clean":"2024-05-09T02:23:03.257459+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:23:03.257459+0000","last_undegraded":"2024-05-09T02:23:03.257459+0000","last_fullsized":"2024-05-09T02:23:03.257459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":234,"num_write":106,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971080+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:22:53.971080+0000","last_peered":"2024-05-09T02:22:53.971080+0000","last_clean":"2024-05-09T02:22:53.971080+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:22:53.971080+0000","last_undegraded":"2024-05-09T02:22:53.971080+0000","last_fullsized":"2024-05-09T02:22:53.971080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"32'148","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971367+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:22:53.971367+0000","last_peered":"2024-05-09T02:22:53.971367+0000","last_clean":"2024-05-09T02:22:53.971367+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:22:53.971367+0000","last_undegraded":"2024-05-09T02:22:53.971367+0000","last_fullsized":"2024-05-09T02:22:53.971367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971892+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:22:53.971892+0000","last_peered":"2024-05-09T02:22:53.971892+0000","last_clean":"2024-05-09T02:22:53.971892+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:22:53.971892+0000","last_undegraded":"2024-05-09T02:22:53.971892+0000","last_fullsized":"2024-05-09T02:22:53.971892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.982899+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:22:58.982899+0000","last_peered":"2024-05-09T02:22:58.982899+0000","last_clean":"2024-05-09T02:22:58.982899+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:22:58.982899+0000","last_undegraded":"2024-05-09T02:22:58.982899+0000","last_fullsized":"2024-05-09T02:22:58.982899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970598+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:22:53.970598+0000","last_peered":"2024-05-09T02:22:53.970598+0000","last_clean":"2024-05-09T02:22:53.970598+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:22:53.970598+0000","last_undegraded":"2024-05-09T02:22:53.970598+0000","last_fullsized":"2024-05-09T02:22:53.970598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980486+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:22:53.980486+0000","last_peered":"2024-05-09T02:22:53.980486+0000","last_clean":"2024-05-09T02:22:53.980486+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:22:53.980486+0000","last_undegraded":"2024-05-09T02:22:53.980486+0000","last_fullsized":"2024-05-09T02:22:53.980486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969761+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:22:53.969761+0000","last_peered":"2024-05-09T02:22:53.969761+0000","last_clean":"2024-05-09T02:22:53.969761+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:22:53.969761+0000","last_undegraded":"2024-05-09T02:22:53.969761+0000","last_fullsized":"2024-05-09T02:22:53.969761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108042+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:22:54.108042+0000","last_peered":"2024-05-09T02:22:54.108042+0000","last_clean":"2024-05-09T02:22:54.108042+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:22:54.108042+0000","last_undegraded":"2024-05-09T02:22:54.108042+0000","last_fullsized":"2024-05-09T02:22:54.108042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'9","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576515+0000","last_change":"2024-05-09T02:18:22.198675+0000","last_active":"2024-05-09T02:23:01.576515+0000","last_peered":"2024-05-09T02:23:01.576515+0000","last_clean":"2024-05-09T02:23:01.576515+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:23:01.576515+0000","last_undegraded":"2024-05-09T02:23:01.576515+0000","last_fullsized":"2024-05-09T02:23:01.576515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'159","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977100+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:22:53.977100+0000","last_peered":"2024-05-09T02:22:53.977100+0000","last_clean":"2024-05-09T02:22:53.977100+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:22:53.977100+0000","last_undegraded":"2024-05-09T02:22:53.977100+0000","last_fullsized":"2024-05-09T02:22:53.977100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'219","reported_seq":241,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978920+0000","last_change":"2024-05-09T02:18:55.680482+0000","last_active":"2024-05-09T02:22:53.978920+0000","last_peered":"2024-05-09T02:22:53.978920+0000","last_clean":"2024-05-09T02:22:53.978920+0000","last_became_active":"2024-05-09T02:18:55.680219+0000","last_became_peered":"2024-05-09T02:18:55.680219+0000","last_unstale":"2024-05-09T02:22:53.978920+0000","last_undegraded":"2024-05-09T02:22:53.978920+0000","last_fullsized":"2024-05-09T02:22:53.978920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:13.255019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.977541+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:22:58.977541+0000","last_peered":"2024-05-09T02:22:58.977541+0000","last_clean":"2024-05-09T02:22:58.977541+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:22:58.977541+0000","last_undegraded":"2024-05-09T02:22:58.977541+0000","last_fullsized":"2024-05-09T02:22:58.977541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984423+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:22:53.984423+0000","last_peered":"2024-05-09T02:22:53.984423+0000","last_clean":"2024-05-09T02:22:53.984423+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:22:53.984423+0000","last_undegraded":"2024-05-09T02:22:53.984423+0000","last_fullsized":"2024-05-09T02:22:53.984423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:39.930445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981396+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:22:53.981396+0000","last_peered":"2024-05-09T02:22:53.981396+0000","last_clean":"2024-05-09T02:22:53.981396+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:22:53.981396+0000","last_undegraded":"2024-05-09T02:22:53.981396+0000","last_fullsized":"2024-05-09T02:22:53.981396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970678+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:22:53.970678+0000","last_peered":"2024-05-09T02:22:53.970678+0000","last_clean":"2024-05-09T02:22:53.970678+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:22:53.970678+0000","last_undegraded":"2024-05-09T02:22:53.970678+0000","last_fullsized":"2024-05-09T02:22:53.970678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971820+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:22:53.971820+0000","last_peered":"2024-05-09T02:22:53.971820+0000","last_clean":"2024-05-09T02:22:53.971820+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:22:53.971820+0000","last_undegraded":"2024-05-09T02:22:53.971820+0000","last_fullsized":"2024-05-09T02:22:53.971820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107588+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:22:54.107588+0000","last_peered":"2024-05-09T02:22:54.107588+0000","last_clean":"2024-05-09T02:22:54.107588+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:22:54.107588+0000","last_undegraded":"2024-05-09T02:22:54.107588+0000","last_fullsized":"2024-05-09T02:22:54.107588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"32'147","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970333+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:22:53.970333+0000","last_peered":"2024-05-09T02:22:53.970333+0000","last_clean":"2024-05-09T02:22:53.970333+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:22:53.970333+0000","last_undegraded":"2024-05-09T02:22:53.970333+0000","last_fullsized":"2024-05-09T02:22:53.970333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981757+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:22:53.981757+0000","last_peered":"2024-05-09T02:22:53.981757+0000","last_clean":"2024-05-09T02:22:53.981757+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:22:53.981757+0000","last_undegraded":"2024-05-09T02:22:53.981757+0000","last_fullsized":"2024-05-09T02:22:53.981757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'162","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970351+0000","last_change":"2024-05-09T02:18:55.678178+0000","last_active":"2024-05-09T02:22:53.970351+0000","last_peered":"2024-05-09T02:22:53.970351+0000","last_clean":"2024-05-09T02:22:53.970351+0000","last_became_active":"2024-05-09T02:18:55.677782+0000","last_became_peered":"2024-05-09T02:18:55.677782+0000","last_unstale":"2024-05-09T02:22:53.970351+0000","last_undegraded":"2024-05-09T02:22:53.970351+0000","last_fullsized":"2024-05-09T02:22:53.970351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:03.517417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984692+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:22:53.984692+0000","last_peered":"2024-05-09T02:22:53.984692+0000","last_clean":"2024-05-09T02:22:53.984692+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:22:53.984692+0000","last_undegraded":"2024-05-09T02:22:53.984692+0000","last_fullsized":"2024-05-09T02:22:53.984692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'168","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974606+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:22:53.974606+0000","last_peered":"2024-05-09T02:22:53.974606+0000","last_clean":"2024-05-09T02:22:53.974606+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:22:53.974606+0000","last_undegraded":"2024-05-09T02:22:53.974606+0000","last_fullsized":"2024-05-09T02:22:53.974606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981322+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:22:53.981322+0000","last_peered":"2024-05-09T02:22:53.981322+0000","last_clean":"2024-05-09T02:22:53.981322+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:22:53.981322+0000","last_undegraded":"2024-05-09T02:22:53.981322+0000","last_fullsized":"2024-05-09T02:22:53.981322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'129","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971974+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:22:53.971974+0000","last_peered":"2024-05-09T02:22:53.971974+0000","last_clean":"2024-05-09T02:22:53.971974+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:22:53.971974+0000","last_undegraded":"2024-05-09T02:22:53.971974+0000","last_fullsized":"2024-05-09T02:22:53.971974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978910+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:22:53.978910+0000","last_peered":"2024-05-09T02:22:53.978910+0000","last_clean":"2024-05-09T02:22:53.978910+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:22:53.978910+0000","last_undegraded":"2024-05-09T02:22:53.978910+0000","last_fullsized":"2024-05-09T02:22:53.978910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:10.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970562+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:22:53.970562+0000","last_peered":"2024-05-09T02:22:53.970562+0000","last_clean":"2024-05-09T02:22:53.970562+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:22:53.970562+0000","last_undegraded":"2024-05-09T02:22:53.970562+0000","last_fullsized":"2024-05-09T02:22:53.970562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986431+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:22:53.986431+0000","last_peered":"2024-05-09T02:22:53.986431+0000","last_clean":"2024-05-09T02:22:53.986431+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:22:53.986431+0000","last_undegraded":"2024-05-09T02:22:53.986431+0000","last_fullsized":"2024-05-09T02:22:53.986431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:35.326804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971985+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:22:53.971985+0000","last_peered":"2024-05-09T02:22:53.971985+0000","last_clean":"2024-05-09T02:22:53.971985+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:22:53.971985+0000","last_undegraded":"2024-05-09T02:22:53.971985+0000","last_fullsized":"2024-05-09T02:22:53.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985776+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:22:53.985776+0000","last_peered":"2024-05-09T02:22:53.985776+0000","last_clean":"2024-05-09T02:22:53.985776+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:22:53.985776+0000","last_undegraded":"2024-05-09T02:22:53.985776+0000","last_fullsized":"2024-05-09T02:22:53.985776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:21.303513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985967+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:22:53.985967+0000","last_peered":"2024-05-09T02:22:53.985967+0000","last_clean":"2024-05-09T02:22:53.985967+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:22:53.985967+0000","last_undegraded":"2024-05-09T02:22:53.985967+0000","last_fullsized":"2024-05-09T02:22:53.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:58.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980177+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:22:53.980177+0000","last_peered":"2024-05-09T02:22:53.980177+0000","last_clean":"2024-05-09T02:22:53.980177+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:22:53.980177+0000","last_undegraded":"2024-05-09T02:22:53.980177+0000","last_fullsized":"2024-05-09T02:22:53.980177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974939+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:22:53.974939+0000","last_peered":"2024-05-09T02:22:53.974939+0000","last_clean":"2024-05-09T02:22:53.974939+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:22:53.974939+0000","last_undegraded":"2024-05-09T02:22:53.974939+0000","last_fullsized":"2024-05-09T02:22:53.974939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:17.335202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978061+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:22:53.978061+0000","last_peered":"2024-05-09T02:22:53.978061+0000","last_clean":"2024-05-09T02:22:53.978061+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:22:53.978061+0000","last_undegraded":"2024-05-09T02:22:53.978061+0000","last_fullsized":"2024-05-09T02:22:53.978061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107639+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:22:54.107639+0000","last_peered":"2024-05-09T02:22:54.107639+0000","last_clean":"2024-05-09T02:22:54.107639+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:22:54.107639+0000","last_undegraded":"2024-05-09T02:22:54.107639+0000","last_fullsized":"2024-05-09T02:22:54.107639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107926+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:22:54.107926+0000","last_peered":"2024-05-09T02:22:54.107926+0000","last_clean":"2024-05-09T02:22:54.107926+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:22:54.107926+0000","last_undegraded":"2024-05-09T02:22:54.107926+0000","last_fullsized":"2024-05-09T02:22:54.107926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974583+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:22:53.974583+0000","last_peered":"2024-05-09T02:22:53.974583+0000","last_clean":"2024-05-09T02:22:53.974583+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:22:53.974583+0000","last_undegraded":"2024-05-09T02:22:53.974583+0000","last_fullsized":"2024-05-09T02:22:53.974583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"31'111","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971307+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:22:53.971307+0000","last_peered":"2024-05-09T02:22:53.971307+0000","last_clean":"2024-05-09T02:22:53.971307+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:22:53.971307+0000","last_undegraded":"2024-05-09T02:22:53.971307+0000","last_fullsized":"2024-05-09T02:22:53.971307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"32'123","reported_seq":153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976759+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:22:53.976759+0000","last_peered":"2024-05-09T02:22:53.976759+0000","last_clean":"2024-05-09T02:22:53.976759+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:22:53.976759+0000","last_undegraded":"2024-05-09T02:22:53.976759+0000","last_fullsized":"2024-05-09T02:22:53.976759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"31'129","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986301+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:22:53.986301+0000","last_peered":"2024-05-09T02:22:53.986301+0000","last_clean":"2024-05-09T02:22:53.986301+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:22:53.986301+0000","last_undegraded":"2024-05-09T02:22:53.986301+0000","last_fullsized":"2024-05-09T02:22:53.986301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"32'111","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970144+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:22:53.970144+0000","last_peered":"2024-05-09T02:22:53.970144+0000","last_clean":"2024-05-09T02:22:53.970144+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:22:53.970144+0000","last_undegraded":"2024-05-09T02:22:53.970144+0000","last_fullsized":"2024-05-09T02:22:53.970144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975059+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:22:53.975059+0000","last_peered":"2024-05-09T02:22:53.975059+0000","last_clean":"2024-05-09T02:22:53.975059+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:22:53.975059+0000","last_undegraded":"2024-05-09T02:22:53.975059+0000","last_fullsized":"2024-05-09T02:22:53.975059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976427+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:22:53.976427+0000","last_peered":"2024-05-09T02:22:53.976427+0000","last_clean":"2024-05-09T02:22:53.976427+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:22:53.976427+0000","last_undegraded":"2024-05-09T02:22:53.976427+0000","last_fullsized":"2024-05-09T02:22:53.976427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981218+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:22:53.981218+0000","last_peered":"2024-05-09T02:22:53.981218+0000","last_clean":"2024-05-09T02:22:53.981218+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:22:53.981218+0000","last_undegraded":"2024-05-09T02:22:53.981218+0000","last_fullsized":"2024-05-09T02:22:53.981218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'132","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985334+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:22:53.985334+0000","last_peered":"2024-05-09T02:22:53.985334+0000","last_clean":"2024-05-09T02:22:53.985334+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:22:53.985334+0000","last_undegraded":"2024-05-09T02:22:53.985334+0000","last_fullsized":"2024-05-09T02:22:53.985334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"32'147","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985603+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:22:53.985603+0000","last_peered":"2024-05-09T02:22:53.985603+0000","last_clean":"2024-05-09T02:22:53.985603+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:22:53.985603+0000","last_undegraded":"2024-05-09T02:22:53.985603+0000","last_fullsized":"2024-05-09T02:22:53.985603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:55.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'174","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107316+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:22:54.107316+0000","last_peered":"2024-05-09T02:22:54.107316+0000","last_clean":"2024-05-09T02:22:54.107316+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:22:54.107316+0000","last_undegraded":"2024-05-09T02:22:54.107316+0000","last_fullsized":"2024-05-09T02:22:54.107316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978652+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:22:53.978652+0000","last_peered":"2024-05-09T02:22:53.978652+0000","last_clean":"2024-05-09T02:22:53.978652+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:22:53.978652+0000","last_undegraded":"2024-05-09T02:22:53.978652+0000","last_fullsized":"2024-05-09T02:22:53.978652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"31'126","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984607+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:22:53.984607+0000","last_peered":"2024-05-09T02:22:53.984607+0000","last_clean":"2024-05-09T02:22:53.984607+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:22:53.984607+0000","last_undegraded":"2024-05-09T02:22:53.984607+0000","last_fullsized":"2024-05-09T02:22:53.984607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"32'153","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978575+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:22:53.978575+0000","last_peered":"2024-05-09T02:22:53.978575+0000","last_clean":"2024-05-09T02:22:53.978575+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:22:53.978575+0000","last_undegraded":"2024-05-09T02:22:53.978575+0000","last_fullsized":"2024-05-09T02:22:53.978575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:32.696901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"31'156","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107220+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:22:54.107220+0000","last_peered":"2024-05-09T02:22:54.107220+0000","last_clean":"2024-05-09T02:22:54.107220+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:22:54.107220+0000","last_undegraded":"2024-05-09T02:22:54.107220+0000","last_fullsized":"2024-05-09T02:22:54.107220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"32'165","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984760+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:22:53.984760+0000","last_peered":"2024-05-09T02:22:53.984760+0000","last_clean":"2024-05-09T02:22:53.984760+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:22:53.984760+0000","last_undegraded":"2024-05-09T02:22:53.984760+0000","last_fullsized":"2024-05-09T02:22:53.984760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970590+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:22:53.970590+0000","last_peered":"2024-05-09T02:22:53.970590+0000","last_clean":"2024-05-09T02:22:53.970590+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:22:53.970590+0000","last_undegraded":"2024-05-09T02:22:53.970590+0000","last_fullsized":"2024-05-09T02:22:53.970590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:32.095309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"32'156","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971445+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:22:53.971445+0000","last_peered":"2024-05-09T02:22:53.971445+0000","last_clean":"2024-05-09T02:22:53.971445+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:22:53.971445+0000","last_undegraded":"2024-05-09T02:22:53.971445+0000","last_fullsized":"2024-05-09T02:22:53.971445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'153","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980789+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:22:53.980789+0000","last_peered":"2024-05-09T02:22:53.980789+0000","last_clean":"2024-05-09T02:22:53.980789+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:22:53.980789+0000","last_undegraded":"2024-05-09T02:22:53.980789+0000","last_fullsized":"2024-05-09T02:22:53.980789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970169+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:22:53.970169+0000","last_peered":"2024-05-09T02:22:53.970169+0000","last_clean":"2024-05-09T02:22:53.970169+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:22:53.970169+0000","last_undegraded":"2024-05-09T02:22:53.970169+0000","last_fullsized":"2024-05-09T02:22:53.970169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"31'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978983+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:22:53.978983+0000","last_peered":"2024-05-09T02:22:53.978983+0000","last_clean":"2024-05-09T02:22:53.978983+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:22:53.978983+0000","last_undegraded":"2024-05-09T02:22:53.978983+0000","last_fullsized":"2024-05-09T02:22:53.978983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"32'174","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106722+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:22:54.106722+0000","last_peered":"2024-05-09T02:22:54.106722+0000","last_clean":"2024-05-09T02:22:54.106722+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:22:54.106722+0000","last_undegraded":"2024-05-09T02:22:54.106722+0000","last_fullsized":"2024-05-09T02:22:54.106722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"31'147","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979771+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:22:53.979771+0000","last_peered":"2024-05-09T02:22:53.979771+0000","last_clean":"2024-05-09T02:22:53.979771+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:22:53.979771+0000","last_undegraded":"2024-05-09T02:22:53.979771+0000","last_fullsized":"2024-05-09T02:22:53.979771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.968919+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:22:53.968919+0000","last_peered":"2024-05-09T02:22:53.968919+0000","last_clean":"2024-05-09T02:22:53.968919+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:22:53.968919+0000","last_undegraded":"2024-05-09T02:22:53.968919+0000","last_fullsized":"2024-05-09T02:22:53.968919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"31'138","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979922+0000","last_change":"2024-05-09T02:18:55.680326+0000","last_active":"2024-05-09T02:22:53.979922+0000","last_peered":"2024-05-09T02:22:53.979922+0000","last_clean":"2024-05-09T02:22:53.979922+0000","last_became_active":"2024-05-09T02:18:55.680014+0000","last_became_peered":"2024-05-09T02:18:55.680014+0000","last_unstale":"2024-05-09T02:22:53.979922+0000","last_undegraded":"2024-05-09T02:22:53.979922+0000","last_fullsized":"2024-05-09T02:22:53.979922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:40.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"32'141","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974615+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:22:53.974615+0000","last_peered":"2024-05-09T02:22:53.974615+0000","last_clean":"2024-05-09T02:22:53.974615+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:22:53.974615+0000","last_undegraded":"2024-05-09T02:22:53.974615+0000","last_fullsized":"2024-05-09T02:22:53.974615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107142+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:22:54.107142+0000","last_peered":"2024-05-09T02:22:54.107142+0000","last_clean":"2024-05-09T02:22:54.107142+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:22:54.107142+0000","last_undegraded":"2024-05-09T02:22:54.107142+0000","last_fullsized":"2024-05-09T02:22:54.107142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971005+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:22:53.971005+0000","last_peered":"2024-05-09T02:22:53.971005+0000","last_clean":"2024-05-09T02:22:53.971005+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:22:53.971005+0000","last_undegraded":"2024-05-09T02:22:53.971005+0000","last_fullsized":"2024-05-09T02:22:53.971005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971840+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:22:53.971840+0000","last_peered":"2024-05-09T02:22:53.971840+0000","last_clean":"2024-05-09T02:22:53.971840+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:22:53.971840+0000","last_undegraded":"2024-05-09T02:22:53.971840+0000","last_fullsized":"2024-05-09T02:22:53.971840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"32'135","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107391+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:22:54.107391+0000","last_peered":"2024-05-09T02:22:54.107391+0000","last_clean":"2024-05-09T02:22:54.107391+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:22:54.107391+0000","last_undegraded":"2024-05-09T02:22:54.107391+0000","last_fullsized":"2024-05-09T02:22:54.107391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969430+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:22:53.969430+0000","last_peered":"2024-05-09T02:22:53.969430+0000","last_clean":"2024-05-09T02:22:53.969430+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:22:53.969430+0000","last_undegraded":"2024-05-09T02:22:53.969430+0000","last_fullsized":"2024-05-09T02:22:53.969430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:02.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977362+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:22:53.977362+0000","last_peered":"2024-05-09T02:22:53.977362+0000","last_clean":"2024-05-09T02:22:53.977362+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:22:53.977362+0000","last_undegraded":"2024-05-09T02:22:53.977362+0000","last_fullsized":"2024-05-09T02:22:53.977362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985367+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:22:53.985367+0000","last_peered":"2024-05-09T02:22:53.985367+0000","last_clean":"2024-05-09T02:22:53.985367+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:22:53.985367+0000","last_undegraded":"2024-05-09T02:22:53.985367+0000","last_fullsized":"2024-05-09T02:22:53.985367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985382+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:22:53.985382+0000","last_peered":"2024-05-09T02:22:53.985382+0000","last_clean":"2024-05-09T02:22:53.985382+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:22:53.985382+0000","last_undegraded":"2024-05-09T02:22:53.985382+0000","last_fullsized":"2024-05-09T02:22:53.985382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971405+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:22:53.971405+0000","last_peered":"2024-05-09T02:22:53.971405+0000","last_clean":"2024-05-09T02:22:53.971405+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:22:53.971405+0000","last_undegraded":"2024-05-09T02:22:53.971405+0000","last_fullsized":"2024-05-09T02:22:53.971405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"32'141","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978785+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:22:53.978785+0000","last_peered":"2024-05-09T02:22:53.978785+0000","last_clean":"2024-05-09T02:22:53.978785+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:22:53.978785+0000","last_undegraded":"2024-05-09T02:22:53.978785+0000","last_fullsized":"2024-05-09T02:22:53.978785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:51.524771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980636+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:22:53.980636+0000","last_peered":"2024-05-09T02:22:53.980636+0000","last_clean":"2024-05-09T02:22:53.980636+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:22:53.980636+0000","last_undegraded":"2024-05-09T02:22:53.980636+0000","last_fullsized":"2024-05-09T02:22:53.980636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981266+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:22:53.981266+0000","last_peered":"2024-05-09T02:22:53.981266+0000","last_clean":"2024-05-09T02:22:53.981266+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:22:53.981266+0000","last_undegraded":"2024-05-09T02:22:53.981266+0000","last_fullsized":"2024-05-09T02:22:53.981266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106954+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:22:54.106954+0000","last_peered":"2024-05-09T02:22:54.106954+0000","last_clean":"2024-05-09T02:22:54.106954+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:22:54.106954+0000","last_undegraded":"2024-05-09T02:22:54.106954+0000","last_fullsized":"2024-05-09T02:22:54.106954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"32'126","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985089+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:22:53.985089+0000","last_peered":"2024-05-09T02:22:53.985089+0000","last_clean":"2024-05-09T02:22:53.985089+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:22:53.985089+0000","last_undegraded":"2024-05-09T02:22:53.985089+0000","last_fullsized":"2024-05-09T02:22:53.985089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984760+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:22:53.984760+0000","last_peered":"2024-05-09T02:22:53.984760+0000","last_clean":"2024-05-09T02:22:53.984760+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:22:53.984760+0000","last_undegraded":"2024-05-09T02:22:53.984760+0000","last_fullsized":"2024-05-09T02:22:53.984760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:37:49.686505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981348+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:22:53.981348+0000","last_peered":"2024-05-09T02:22:53.981348+0000","last_clean":"2024-05-09T02:22:53.981348+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:22:53.981348+0000","last_undegraded":"2024-05-09T02:22:53.981348+0000","last_fullsized":"2024-05-09T02:22:53.981348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977532+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:22:53.977532+0000","last_peered":"2024-05-09T02:22:53.977532+0000","last_clean":"2024-05-09T02:22:53.977532+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:22:53.977532+0000","last_undegraded":"2024-05-09T02:22:53.977532+0000","last_fullsized":"2024-05-09T02:22:53.977532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"32'165","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970629+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:22:53.970629+0000","last_peered":"2024-05-09T02:22:53.970629+0000","last_clean":"2024-05-09T02:22:53.970629+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:22:53.970629+0000","last_undegraded":"2024-05-09T02:22:53.970629+0000","last_fullsized":"2024-05-09T02:22:53.970629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:49.813168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'129","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107103+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:22:54.107103+0000","last_peered":"2024-05-09T02:22:54.107103+0000","last_clean":"2024-05-09T02:22:54.107103+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:22:54.107103+0000","last_undegraded":"2024-05-09T02:22:54.107103+0000","last_fullsized":"2024-05-09T02:22:54.107103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107507+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:22:54.107507+0000","last_peered":"2024-05-09T02:22:54.107507+0000","last_clean":"2024-05-09T02:22:54.107507+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:22:54.107507+0000","last_undegraded":"2024-05-09T02:22:54.107507+0000","last_fullsized":"2024-05-09T02:22:54.107507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977075+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:22:53.977075+0000","last_peered":"2024-05-09T02:22:53.977075+0000","last_clean":"2024-05-09T02:22:53.977075+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:22:53.977075+0000","last_undegraded":"2024-05-09T02:22:53.977075+0000","last_fullsized":"2024-05-09T02:22:53.977075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984863+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:22:53.984863+0000","last_peered":"2024-05-09T02:22:53.984863+0000","last_clean":"2024-05-09T02:22:53.984863+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:22:53.984863+0000","last_undegraded":"2024-05-09T02:22:53.984863+0000","last_fullsized":"2024-05-09T02:22:53.984863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'165","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108415+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:22:54.108415+0000","last_peered":"2024-05-09T02:22:54.108415+0000","last_clean":"2024-05-09T02:22:54.108415+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:22:54.108415+0000","last_undegraded":"2024-05-09T02:22:54.108415+0000","last_fullsized":"2024-05-09T02:22:54.108415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978390+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:22:53.978390+0000","last_peered":"2024-05-09T02:22:53.978390+0000","last_clean":"2024-05-09T02:22:53.978390+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:22:53.978390+0000","last_undegraded":"2024-05-09T02:22:53.978390+0000","last_fullsized":"2024-05-09T02:22:53.978390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:08.775650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969841+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:22:53.969841+0000","last_peered":"2024-05-09T02:22:53.969841+0000","last_clean":"2024-05-09T02:22:53.969841+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:22:53.969841+0000","last_undegraded":"2024-05-09T02:22:53.969841+0000","last_fullsized":"2024-05-09T02:22:53.969841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"32'177","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976418+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:22:53.976418+0000","last_peered":"2024-05-09T02:22:53.976418+0000","last_clean":"2024-05-09T02:22:53.976418+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:22:53.976418+0000","last_undegraded":"2024-05-09T02:22:53.976418+0000","last_fullsized":"2024-05-09T02:22:53.976418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"31'126","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974807+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:22:53.974807+0000","last_peered":"2024-05-09T02:22:53.974807+0000","last_clean":"2024-05-09T02:22:53.974807+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:22:53.974807+0000","last_undegraded":"2024-05-09T02:22:53.974807+0000","last_fullsized":"2024-05-09T02:22:53.974807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"32'159","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976524+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:22:53.976524+0000","last_peered":"2024-05-09T02:22:53.976524+0000","last_clean":"2024-05-09T02:22:53.976524+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:22:53.976524+0000","last_undegraded":"2024-05-09T02:22:53.976524+0000","last_fullsized":"2024-05-09T02:22:53.976524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977969+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:22:53.977969+0000","last_peered":"2024-05-09T02:22:53.977969+0000","last_clean":"2024-05-09T02:22:53.977969+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:22:53.977969+0000","last_undegraded":"2024-05-09T02:22:53.977969+0000","last_fullsized":"2024-05-09T02:22:53.977969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":211620,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":435,"num_write":199,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":423240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216648,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":455,"num_write":196,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":433296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":966656,"data_stored":752122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58128,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313712,"statfs":{"total":96636764160,"available":96577241088,"internally_reserved":0,"allocated":598016,"data_stored":377043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":380928,"data_stored":162349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45444,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326396,"statfs":{"total":96636764160,"available":96590229504,"internally_reserved":0,"allocated":389120,"data_stored":161817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54184,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317656,"statfs":{"total":96636764160,"available":96581279744,"internally_reserved":0,"allocated":819200,"data_stored":587271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":372736,"data_stored":161657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49808,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":598016,"data_stored":371581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50172,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321668,"statfs":{"total":96636764160,"available":96585388032,"internally_reserved":0,"allocated":970752,"data_stored":752088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":215850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":215345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:23:12.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:23:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.786+0000 7f3873dbe640 1 Processor -- start 2024-05-09T02:23:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.786+0000 7f3873dbe640 1 -- start start 2024-05-09T02:23:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3873dbe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f386c071c10 0x7f386c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3873dbe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f386c0c57d0 0x7f386c153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3873dbe640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c155c90 con 0x7f386c0c7650 2024-05-09T02:23:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3873dbe640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f386c0caac0 con 0x7f386c0c57d0 2024-05-09T02:23:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3873dbe640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f386c0ca2b0 con 0x7f386c071c10 2024-05-09T02:23:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f386c0c57d0 0x7f386c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f386c0c57d0 0x7f386c153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59350/0 (socket says 172.21.15.46:59350) 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 -- 172.21.15.46:0/719639996 learned_addr learned my addr 172.21.15.46:0/719639996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871b5a640 1 --2- 172.21.15.46:0/719639996 >> v2:172.21.15.107:3300/0 conn(0x7f386c071c10 0x7f386c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 -- 172.21.15.46:0/719639996 >> v2:172.21.15.107:3300/0 conn(0x7f386c071c10 msgr2=0x7f386c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 --2- 172.21.15.46:0/719639996 >> v2:172.21.15.107:3300/0 conn(0x7f386c071c10 0x7f386c159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 -- 172.21.15.46:0/719639996 >> v1:172.21.15.107:6789/0 conn(0x7f386c0c7650 legacy=0x7f386c156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871359640 1 -- 172.21.15.46:0/719639996 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c0ca500 con 0x7f386c0c57d0 2024-05-09T02:23:12.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.788+0000 7f3871b5a640 1 --2- 172.21.15.46:0/719639996 >> v2:172.21.15.107:3300/0 conn(0x7f386c071c10 0x7f386c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:23:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.789+0000 7f3871359640 1 --2- 172.21.15.46:0/719639996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c153100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f386c073090 tx=0x7f385c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b840ef447d43086 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.789+0000 7f3870b58640 1 -- 172.21.15.46:0/719639996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c037070 con 0x7f386c0c57d0 2024-05-09T02:23:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.789+0000 7f3870b58640 1 -- 172.21.15.46:0/719639996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c032440 con 0x7f386c0c57d0 2024-05-09T02:23:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.789+0000 7f3870b58640 1 -- 172.21.15.46:0/719639996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c02ae60 con 0x7f386c0c57d0 2024-05-09T02:23:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 -- 172.21.15.46:0/719639996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 msgr2=0x7f386c153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 --2- 172.21.15.46:0/719639996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c153100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f386c073090 tx=0x7f385c02a110 comp rx=0 tx=0).stop 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 -- 172.21.15.46:0/719639996 shutdown_connections 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 --2- 172.21.15.46:0/719639996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c153100 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 --2- 172.21.15.46:0/719639996 >> v2:172.21.15.107:3300/0 conn(0x7f386c071c10 0x7f386c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 -- 172.21.15.46:0/719639996 >> 172.21.15.46:0/719639996 conn(0x7f386c0ac930 msgr2=0x7f386c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 -- 172.21.15.46:0/719639996 shutdown_connections 2024-05-09T02:23:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.790+0000 7f3873dbe640 1 -- 172.21.15.46:0/719639996 wait complete. 2024-05-09T02:23:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.791+0000 7f3873dbe640 1 Processor -- start 2024-05-09T02:23:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.792+0000 7f3873dbe640 1 -- start start 2024-05-09T02:23:12.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3873dbe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c071c10 0x7f386c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3873dbe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3873dbe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f386c0c7650 0x7f386c146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3873dbe640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0c6040 con 0x7f386c0c57d0 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3873dbe640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f386c153640 con 0x7f386c071c10 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3873dbe640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f386c156880 con 0x7f386c0c7650 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59354/0 (socket says 172.21.15.46:59354) 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 -- 172.21.15.46:0/1616572372 learned_addr learned my addr 172.21.15.46:0/1616572372 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871b5a640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c071c10 0x7f386c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f387235b640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f386c0c7650 0x7f386c146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 -- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f386c0c7650 msgr2=0x7f386c146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f386c0c7650 0x7f386c146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 -- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c071c10 msgr2=0x7f386c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c071c10 0x7f386c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 -- 172.21.15.46:0/1616572372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c146810 con 0x7f386c0c57d0 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.793+0000 7f3871359640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c145be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f385c000c00 tx=0x7f385c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.794+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c041020 con 0x7f386c0c57d0 2024-05-09T02:23:12.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.794+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c030970 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.794+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c146ad0 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.794+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c037040 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.794+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c153990 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.795+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c06a330 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.795+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f385c044020 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.796+0000 7f38627fc640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3850076300 0x7f3850078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.796+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f385c0b8560 con 0x7f386c0c57d0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.796+0000 7f3871b5a640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3850076300 0x7f3850078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:12.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.797+0000 7f3871b5a640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3850076300 0x7f3850078810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f386c0740c0 tx=0x7f3868008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:12.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.800+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f385c04b030 con 0x7f386c0c57d0 2024-05-09T02:23:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.993+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f386c159a00 con 0x7f386c0c57d0 2024-05-09T02:23:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.994+0000 7f38627fc640 1 -- 172.21.15.46:0/1616572372 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+21333 (secure 0 0 0) 0x7f385c0811b0 con 0x7f386c0c57d0 2024-05-09T02:23:12.997 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:12.998 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:22:53.964778+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6834/1968918469":"2024-05-10T02:22:53.964723+0000","172.21.15.46:6832/3794663718":"2024-05-10T02:22:39.920164+0000","172.21.15.46:6833/3794663718":"2024-05-10T02:22:39.920164+0000","172.21.15.46:6835/687229870":"2024-05-10T02:20:29.906793+0000","172.21.15.46:6834/687229870":"2024-05-10T02:20:29.906793+0000","172.21.15.107:6837/3709209674":"2024-05-10T02:20:29.900468+0000","172.21.15.46:6833/268323982":"2024-05-10T02:19:54.895024+0000","172.21.15.46:6832/268323982":"2024-05-10T02:19:54.895024+0000","172.21.15.107:6836/1968918469":"2024-05-10T02:22:53.964723+0000","172.21.15.107:6835/3709209674":"2024-05-10T02:20:29.900468+0000","172.21.15.107:6837/16654146":"2024-05-10T02:19:04.887047+0000","172.21.15.107:6835/16654146":"2024-05-10T02:19:04.887047+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:23:12.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.996+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3850076300 msgr2=0x7f3850078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.996+0000 7f3873dbe640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3850076300 0x7f3850078810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f386c0740c0 tx=0x7f3868008040 comp rx=0 tx=0).stop 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.996+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 msgr2=0x7f386c145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.996+0000 7f3873dbe640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c145be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f385c000c00 tx=0x7f385c0046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.996+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 shutdown_connections 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3850076300 0x7f3850078810 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f386c0c7650 0x7f386c146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f386c0c57d0 0x7f386c145be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 --2- 172.21.15.46:0/1616572372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c071c10 0x7f386c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 >> 172.21.15.46:0/1616572372 conn(0x7f386c0ac930 msgr2=0x7f386c156170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 shutdown_connections 2024-05-09T02:23:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:12.997+0000 7f3873dbe640 1 -- 172.21.15.46:0/1616572372 wait complete. 2024-05-09T02:23:14.012 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T02:23:14.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.144+0000 7fd1e5696640 1 Processor -- start 2024-05-09T02:23:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.144+0000 7fd1e5696640 1 -- start start 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.145+0000 7fd1e5696640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1e0158510 0x7fd1e01601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.145+0000 7fd1e5696640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e0158920 con 0x7fd1e00acd20 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.145+0000 7fd1e5696640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e0154a20 con 0x7fd1e014ec00 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.145+0000 7fd1e5696640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e01557e0 con 0x7fd1e0158510 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1de7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd1e00acd20 0x7fd1e0157e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45074/0 (socket says 172.21.15.46:45074) 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1de7fc640 1 -- 172.21.15.46:0/2703813836 learned_addr learned my addr 172.21.15.46:0/2703813836 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1df7fe640 1 --2- 172.21.15.46:0/2703813836 >> v2:172.21.15.107:3300/0 conn(0x7fd1e0158510 0x7fd1e01601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250093425 0 0) 0x7fd1e0158920 con 0x7fd1e00acd20 2024-05-09T02:23:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1c8003520 con 0x7fd1e00acd20 2024-05-09T02:23:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521982571 0 0) 0x7fd1e0154a20 con 0x7fd1e014ec00 2024-05-09T02:23:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e0158920 con 0x7fd1e014ec00 2024-05-09T02:23:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1df7fe640 1 -- 172.21.15.46:0/2703813836 >> v1:172.21.15.107:6789/0 conn(0x7fd1e014ec00 legacy=0x7fd1e0073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1df7fe640 1 -- 172.21.15.46:0/2703813836 >> v1:172.21.15.46:6789/0 conn(0x7fd1e00acd20 legacy=0x7fd1e0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.146+0000 7fd1df7fe640 1 -- 172.21.15.46:0/2703813836 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e0154d00 con 0x7fd1e0158510 2024-05-09T02:23:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.147+0000 7fd1df7fe640 1 --2- 172.21.15.46:0/2703813836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e0158510 0x7fd1e01601a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009d90 tx=0x7fd1d802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b55b4ed525be8fc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.147+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8031600 con 0x7fd1e0158510 2024-05-09T02:23:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.147+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d80317a0 con 0x7fd1e0158510 2024-05-09T02:23:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.147+0000 7fd1ddffb640 1 -- 172.21.15.46:0/2703813836 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8031b50 con 0x7fd1e0158510 2024-05-09T02:23:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 -- 172.21.15.46:0/2703813836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e0158510 msgr2=0x7fd1e01601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 --2- 172.21.15.46:0/2703813836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e0158510 0x7fd1e01601a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009d90 tx=0x7fd1d802a5d0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 -- 172.21.15.46:0/2703813836 shutdown_connections 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 --2- 172.21.15.46:0/2703813836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e0158510 0x7fd1e01601a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 -- 172.21.15.46:0/2703813836 >> 172.21.15.46:0/2703813836 conn(0x7fd1e00ca690 msgr2=0x7fd1e00c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 -- 172.21.15.46:0/2703813836 shutdown_connections 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.148+0000 7fd1e5696640 1 -- 172.21.15.46:0/2703813836 wait complete. 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.150+0000 7fd1e5696640 1 Processor -- start 2024-05-09T02:23:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.150+0000 7fd1e5696640 1 -- start start 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1e5696640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1e00acd20 0x7fd1e0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1e5696640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e014ec00 0x7fd1e0153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1e5696640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1e0158510 0x7fd1e0149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1e5696640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e0155350 con 0x7fd1e00acd20 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1e5696640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e00720b0 con 0x7fd1e014ec00 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1e5696640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e0072230 con 0x7fd1e0158510 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1deffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1e00acd20 0x7fd1e0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1deffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1e00acd20 0x7fd1e0150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59364/0 (socket says 172.21.15.46:59364) 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1deffd640 1 -- 172.21.15.46:0/370519952 learned_addr learned my addr 172.21.15.46:0/370519952 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1de7fc640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e014ec00 0x7fd1e0153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.151+0000 7fd1df7fe640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1e0158510 0x7fd1e0149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1deffd640 1 -- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1e0158510 msgr2=0x7fd1e0149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1deffd640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1e0158510 0x7fd1e0149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1deffd640 1 -- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e014ec00 msgr2=0x7fd1e0153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1deffd640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1e014ec00 0x7fd1e0153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1deffd640 1 -- 172.21.15.46:0/370519952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e00aa080 con 0x7fd1e00acd20 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1deffd640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1e00acd20 0x7fd1e0150a30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c430 tx=0x7fd1d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0017070 con 0x7fd1e00acd20 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d00052d0 con 0x7fd1e00acd20 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e01581e0 con 0x7fd1e00acd20 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0003830 con 0x7fd1e00acd20 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.152+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e014ffc0 con 0x7fd1e00acd20 2024-05-09T02:23:14.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.153+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1e01502a0 con 0x7fd1e00acd20 2024-05-09T02:23:14.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.154+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd1d001a070 con 0x7fd1e00acd20 2024-05-09T02:23:14.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.154+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1cc076300 0x7fd1cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fd1d00975a0 con 0x7fd1e00acd20 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1de7fc640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1cc076300 0x7fd1cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fd1cc081120 0x7fd1cc0835f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 --> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1cc083cc0 con 0x7fd1cc081120 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd1d0097950 con 0x7fd1e00acd20 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1df7fe640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fd1cc081120 0x7fd1cc0835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1de7fc640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1cc076300 0x7fd1cc078810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4007f50 tx=0x7fd1d4007ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.155+0000 7fd1df7fe640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fd1cc081120 0x7fd1cc0835f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.156+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== osd.0 v2:172.21.15.46:6800/738364260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1cc083cc0 con 0x7fd1cc081120 2024-05-09T02:23:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.169+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 --> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd1e006a3a0 con 0x7fd1cc081120 2024-05-09T02:23:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1c77fe640 1 -- 172.21.15.46:0/370519952 <== osd.0 v2:172.21.15.46:6800/738364260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd1e006a3a0 con 0x7fd1cc081120 2024-05-09T02:23:14.173 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:14.173 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:14.173 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fd1cc081120 msgr2=0x7fd1cc0835f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:6800/738364260,v1:172.21.15.46:6801/738364260] conn(0x7fd1cc081120 0x7fd1cc0835f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1cc076300 msgr2=0x7fd1cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1cc076300 0x7fd1cc078810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4007f50 tx=0x7fd1d4007ee0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1e00acd20 msgr2=0x7fd1e0150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 --2- 172.21.15.46:0/370519952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1e00acd20 0x7fd1e0150a30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c430 tx=0x7fd1d000c8f0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1df7fe640 1 -- 172.21.15.46:0/370519952 reap_dead start 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 shutdown_connections 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 >> 172.21.15.46:0/370519952 conn(0x7fd1e00ca690 msgr2=0x7fd1e014d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 shutdown_connections 2024-05-09T02:23:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.170+0000 7fd1e5696640 1 -- 172.21.15.46:0/370519952 wait complete. 2024-05-09T02:23:14.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T02:23:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.300+0000 7f1893f00640 1 Processor -- start 2024-05-09T02:23:14.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.300+0000 7f1893f00640 1 -- start start 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.301+0000 7f1893f00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f188c0c4df0 0x7f188c154df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.301+0000 7f1893f00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c0723b0 con 0x7f188c071fa0 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.301+0000 7f1893f00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c158500 con 0x7f188c071b90 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.301+0000 7f1893f00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f188c0c86b0 con 0x7f188c0c4df0 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.301+0000 7f189249d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f188c071fa0 0x7f188c0c96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45090/0 (socket says 172.21.15.46:45090) 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f189249d640 1 -- 172.21.15.46:0/1172696903 learned_addr learned my addr 172.21.15.46:0/1172696903 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f1891c9c640 1 --2- 172.21.15.46:0/1172696903 >> v2:172.21.15.107:3300/0 conn(0x7f188c0c4df0 0x7f188c154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f1890c9a640 1 -- 172.21.15.46:0/1172696903 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283543559 0 0) 0x7f188c0723b0 con 0x7f188c071fa0 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f1890c9a640 1 -- 172.21.15.46:0/1172696903 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1878003520 con 0x7f188c071fa0 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f1891c9c640 1 -- 172.21.15.46:0/1172696903 >> v1:172.21.15.107:6789/0 conn(0x7f188c071b90 legacy=0x7f188c0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f1891c9c640 1 -- 172.21.15.46:0/1172696903 >> v1:172.21.15.46:6789/0 conn(0x7f188c071fa0 legacy=0x7f188c0c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.302+0000 7f1891c9c640 1 -- 172.21.15.46:0/1172696903 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c072640 con 0x7f188c0c4df0 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.303+0000 7f1891c9c640 1 --2- 172.21.15.46:0/1172696903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c154df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f18880097a0 tx=0x7f188802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae51e47a4bddf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.303+0000 7f1890c9a640 1 -- 172.21.15.46:0/1172696903 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888037070 con 0x7f188c0c4df0 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.303+0000 7f1890c9a640 1 -- 172.21.15.46:0/1172696903 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888032440 con 0x7f188c0c4df0 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.303+0000 7f1890c9a640 1 -- 172.21.15.46:0/1172696903 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188802ae60 con 0x7f188c0c4df0 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 -- 172.21.15.46:0/1172696903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 msgr2=0x7f188c154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 --2- 172.21.15.46:0/1172696903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c154df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f18880097a0 tx=0x7f188802a110 comp rx=0 tx=0).stop 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 -- 172.21.15.46:0/1172696903 shutdown_connections 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 --2- 172.21.15.46:0/1172696903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c154df0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 -- 172.21.15.46:0/1172696903 >> 172.21.15.46:0/1172696903 conn(0x7f188c0ac9c0 msgr2=0x7f188c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 -- 172.21.15.46:0/1172696903 shutdown_connections 2024-05-09T02:23:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.304+0000 7f1893f00640 1 -- 172.21.15.46:0/1172696903 wait complete. 2024-05-09T02:23:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.305+0000 7f1893f00640 1 Processor -- start 2024-05-09T02:23:14.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.305+0000 7f1893f00640 1 -- start start 2024-05-09T02:23:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1893f00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f188c071b90 0x7f188c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1893f00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 0x7f188c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1893f00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1893f00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f188c155330 con 0x7f188c071fa0 2024-05-09T02:23:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1893f00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f188c072920 con 0x7f188c0c4df0 2024-05-09T02:23:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1893f00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f188c0ad4e0 con 0x7f188c071b90 2024-05-09T02:23:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 0x7f188c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 0x7f188c1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59380/0 (socket says 172.21.15.46:59380) 2024-05-09T02:23:14.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 -- 172.21.15.46:0/4116241015 learned_addr learned my addr 172.21.15.46:0/4116241015 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f1891c9c640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f188c071b90 0x7f188c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189249d640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 -- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f188c071b90 msgr2=0x7f188c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f188c071b90 0x7f188c14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 -- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 msgr2=0x7f188c151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 -- 172.21.15.46:0/4116241015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c14e220 con 0x7f188c071fa0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f189149b640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 0x7f188c1504a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f187c00c3c0 tx=0x7f187c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.307+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c017070 con 0x7f188c071fa0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.308+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c0052f0 con 0x7f188c071fa0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.308+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c1595e0 con 0x7f188c071fa0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.308+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c003830 con 0x7f188c071fa0 2024-05-09T02:23:14.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.308+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c14f400 con 0x7f188c071fa0 2024-05-09T02:23:14.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.308+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c050910 con 0x7f188c071fa0 2024-05-09T02:23:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.309+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f187c01a070 con 0x7f188c071fa0 2024-05-09T02:23:14.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.310+0000 7f18827fc640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f18700762d0 0x7f18700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.310+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f187c0972f0 con 0x7f188c071fa0 2024-05-09T02:23:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.310+0000 7f1891c9c640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f18700762d0 0x7f18700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.311+0000 7f1891c9c640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f18700762d0 0x7f18700787e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1888034000 tx=0x7f188802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.314+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f188c050910 con 0x7f188c071fa0 2024-05-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.503+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f188c14f190 con 0x7f18700762d0 2024-05-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.504+0000 7f18827fc640 1 -- 172.21.15.46:0/4116241015 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f188c14f190 con 0x7f18700762d0 2024-05-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f18700762d0 msgr2=0x7f18700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f18700762d0 0x7f18700787e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1888034000 tx=0x7f188802e000 comp rx=0 tx=0).stop 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 msgr2=0x7f188c1504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 0x7f188c1504a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f187c00c3c0 tx=0x7f187c00c880 comp rx=0 tx=0).stop 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 shutdown_connections 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f18700762d0 0x7f18700787e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f188c0c4df0 0x7f188c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f188c071fa0 0x7f188c1504a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 --2- 172.21.15.46:0/4116241015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f188c071b90 0x7f188c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 >> 172.21.15.46:0/4116241015 conn(0x7f188c0ac9c0 msgr2=0x7f188c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 shutdown_connections 2024-05-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.506+0000 7f1893f00640 1 -- 172.21.15.46:0/4116241015 wait complete. 2024-05-09T02:23:14.521 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T02:23:14.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.637+0000 7f31ca98d640 1 Processor -- start 2024-05-09T02:23:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.637+0000 7f31ca98d640 1 -- start start 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.638+0000 7f31ca98d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31c4151b10 0x7f31c40c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.638+0000 7f31ca98d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 0x7f31c415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.638+0000 7f31ca98d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c40c9590 con 0x7f31c40c90a0 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.638+0000 7f31ca98d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f31c4157be0 con 0x7f31c4151b10 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.638+0000 7f31ca98d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f31c4157ec0 con 0x7f31c415b0c0 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c8f2a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 0x7f31c415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31c4151b10 0x7f31c40c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c8f2a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 0x7f31c415b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:51720/0 (socket says 172.21.15.46:51720) 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c8f2a640 1 -- 172.21.15.46:0/3867361863 learned_addr learned my addr 172.21.15.46:0/3867361863 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:14.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31c4151b10 0x7f31c40c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.46:60254/0 (socket says 172.21.15.46:60254) 2024-05-09T02:23:14.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c37fe640 1 --1- 172.21.15.46:0/3867361863 >> v1:172.21.15.107:6789/0 conn(0x7f31c40c90a0 0x7f31c406e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:41178/0 (socket says 172.21.15.46:41178) 2024-05-09T02:23:14.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c3fff640 1 -- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 msgr2=0x7f31c415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:14.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c3fff640 1 --2- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 0x7f31c415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c3fff640 1 -- 172.21.15.46:0/3867361863 >> v1:172.21.15.107:6789/0 conn(0x7f31c40c90a0 legacy=0x7f31c406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c3fff640 1 -- 172.21.15.46:0/3867361863 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c41581a0 con 0x7f31c4151b10 2024-05-09T02:23:14.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.639+0000 7f31c8f2a640 1 --2- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 0x7f31c415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:14.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.640+0000 7f31c3fff640 1 --2- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c4151b10 0x7f31c40c8b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31b40097a0 tx=0x7f31b402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634f8f926b78e450 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.640+0000 7f31c2ffd640 1 -- 172.21.15.46:0/3867361863 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4037070 con 0x7f31c4151b10 2024-05-09T02:23:14.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.640+0000 7f31c2ffd640 1 -- 172.21.15.46:0/3867361863 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b402ae50 con 0x7f31c4151b10 2024-05-09T02:23:14.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.640+0000 7f31c2ffd640 1 -- 172.21.15.46:0/3867361863 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4032660 con 0x7f31c4151b10 2024-05-09T02:23:14.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 -- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c4151b10 msgr2=0x7f31c40c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 --2- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c4151b10 0x7f31c40c8b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31b40097a0 tx=0x7f31b402a100 comp rx=0 tx=0).stop 2024-05-09T02:23:14.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 -- 172.21.15.46:0/3867361863 shutdown_connections 2024-05-09T02:23:14.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 --2- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c415b0c0 0x7f31c415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 --2- 172.21.15.46:0/3867361863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c4151b10 0x7f31c40c8b60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 -- 172.21.15.46:0/3867361863 >> 172.21.15.46:0/3867361863 conn(0x7f31c4068c40 msgr2=0x7f31c40ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 -- 172.21.15.46:0/3867361863 shutdown_connections 2024-05-09T02:23:14.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.641+0000 7f31ca98d640 1 -- 172.21.15.46:0/3867361863 wait complete. 2024-05-09T02:23:14.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.642+0000 7f31ca98d640 1 Processor -- start 2024-05-09T02:23:14.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.643+0000 7f31ca98d640 1 -- start start 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31ca98d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c40c90a0 0x7f31c4156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31ca98d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c4151b10 0x7f31c40c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31ca98d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c415b0c0 0x7f31c40cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31ca98d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41589a0 con 0x7f31c40c90a0 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31ca98d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f31c4151f20 con 0x7f31c415b0c0 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31ca98d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f31c415ba10 con 0x7f31c4151b10 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c40c90a0 0x7f31c4156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c40c90a0 0x7f31c4156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59382/0 (socket says 172.21.15.46:59382) 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c3fff640 1 -- 172.21.15.46:0/531849446 learned_addr learned my addr 172.21.15.46:0/531849446 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c415b0c0 0x7f31c40cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c37fe640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c4151b10 0x7f31c40c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 -- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c4151b10 msgr2=0x7f31c40c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31c4151b10 0x7f31c40c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 -- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c40c90a0 msgr2=0x7f31c4156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31c40c90a0 0x7f31c4156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 -- 172.21.15.46:0/531849446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c41ee970 con 0x7f31c415b0c0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.644+0000 7f31c8f2a640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c415b0c0 0x7f31c40cbb70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009db0 tx=0x7f31bc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.645+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00cb20 con 0x7f31c415b0c0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.645+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc00cce0 con 0x7f31c415b0c0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.645+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c41eec10 con 0x7f31c415b0c0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.645+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc003bd0 con 0x7f31c415b0c0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.645+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c4155d50 con 0x7f31c415b0c0 2024-05-09T02:23:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.645+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31c406a3a0 con 0x7f31c415b0c0 2024-05-09T02:23:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.646+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f31bc01b030 con 0x7f31c415b0c0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c0ff9640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31b00762d0 0x7f31b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f31bc098ae0 con 0x7f31c415b0c0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c3fff640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31b00762d0 0x7f31b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c0ff9640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f31b00810f0 0x7f31b00835c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 --> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31bc00df90 con 0x7f31b00810f0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f31bc098e90 con 0x7f31c415b0c0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.647+0000 7f31c37fe640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f31b00810f0 0x7f31b00835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.648+0000 7f31c3fff640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31b00762d0 0x7f31b00787e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31b402a140 tx=0x7f31b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.648+0000 7f31c37fe640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f31b00810f0 0x7f31b00835c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.648+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== osd.1 v2:172.21.15.46:6809/960382158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31bc00df90 con 0x7f31b00810f0 2024-05-09T02:23:14.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 --> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f31c4157540 con 0x7f31b00810f0 2024-05-09T02:23:14.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31c0ff9640 1 -- 172.21.15.46:0/531849446 <== osd.1 v2:172.21.15.46:6809/960382158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f31c4157540 con 0x7f31b00810f0 2024-05-09T02:23:14.665 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:14.665 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:14.665 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f31b00810f0 msgr2=0x7f31b00835c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.46:6809/960382158,v1:172.21.15.46:6811/960382158] conn(0x7f31b00810f0 0x7f31b00835c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31b00762d0 msgr2=0x7f31b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f31b00762d0 0x7f31b00787e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31b402a140 tx=0x7f31b402e000 comp rx=0 tx=0).stop 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c415b0c0 msgr2=0x7f31c40cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 --2- 172.21.15.46:0/531849446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31c415b0c0 0x7f31c40cbb70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009db0 tx=0x7f31bc00c490 comp rx=0 tx=0).stop 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31c8f2a640 1 -- 172.21.15.46:0/531849446 reap_dead start 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 shutdown_connections 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 >> 172.21.15.46:0/531849446 conn(0x7f31c4068c40 msgr2=0x7f31c414fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 shutdown_connections 2024-05-09T02:23:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.662+0000 7f31ca98d640 1 -- 172.21.15.46:0/531849446 wait complete. 2024-05-09T02:23:14.676 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T02:23:14.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.789+0000 7f1eed419640 1 Processor -- start 2024-05-09T02:23:14.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.789+0000 7f1eed419640 1 -- start start 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1eed419640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 0x7f1ee80c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1eed419640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1ee81584f0 0x7f1ee806e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1eed419640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee806ed80 0x7f1ee80c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1eed419640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee815bd10 con 0x7f1ee80c9230 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1eed419640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee80c8e40 con 0x7f1ee81584f0 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1eed419640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee815b100 con 0x7f1ee806ed80 2024-05-09T02:23:14.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee6ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 0x7f1ee80c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee6ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 0x7f1ee80c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59386/0 (socket says 172.21.15.46:59386) 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee6ffd640 1 -- 172.21.15.46:0/2821100707 learned_addr learned my addr 172.21.15.46:0/2821100707 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee67fc640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.107:3300/0 conn(0x7f1ee81584f0 0x7f1ee806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee77fe640 1 --2- 172.21.15.46:0/2821100707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee806ed80 0x7f1ee80c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee77fe640 1 -- 172.21.15.46:0/2821100707 >> v2:172.21.15.107:3300/0 conn(0x7f1ee81584f0 msgr2=0x7f1ee806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee77fe640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.107:3300/0 conn(0x7f1ee81584f0 0x7f1ee806e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee77fe640 1 -- 172.21.15.46:0/2821100707 >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 msgr2=0x7f1ee80c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee77fe640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 0x7f1ee80c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee77fe640 1 -- 172.21.15.46:0/2821100707 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee815b3e0 con 0x7f1ee806ed80 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee67fc640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.107:3300/0 conn(0x7f1ee81584f0 0x7f1ee806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:14.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.791+0000 7f1ee6ffd640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 0x7f1ee80c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:14.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.792+0000 7f1ee77fe640 1 --2- 172.21.15.46:0/2821100707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee806ed80 0x7f1ee80c25a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ee808e930 tx=0x7f1ee002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d68072f5bc11ab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.792+0000 7f1ee5ffb640 1 -- 172.21.15.46:0/2821100707 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0037070 con 0x7f1ee806ed80 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.792+0000 7f1ee5ffb640 1 -- 172.21.15.46:0/2821100707 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee002add0 con 0x7f1ee806ed80 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.792+0000 7f1ee5ffb640 1 -- 172.21.15.46:0/2821100707 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0032660 con 0x7f1ee806ed80 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 -- 172.21.15.46:0/2821100707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee806ed80 msgr2=0x7f1ee80c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 --2- 172.21.15.46:0/2821100707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee806ed80 0x7f1ee80c25a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ee808e930 tx=0x7f1ee002a080 comp rx=0 tx=0).stop 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 -- 172.21.15.46:0/2821100707 shutdown_connections 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 --2- 172.21.15.46:0/2821100707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee806ed80 0x7f1ee80c25a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.107:3300/0 conn(0x7f1ee81584f0 0x7f1ee806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 --2- 172.21.15.46:0/2821100707 >> v2:172.21.15.46:3300/0 conn(0x7f1ee80c9230 0x7f1ee80c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 -- 172.21.15.46:0/2821100707 >> 172.21.15.46:0/2821100707 conn(0x7f1ee80ccec0 msgr2=0x7f1ee80cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 -- 172.21.15.46:0/2821100707 shutdown_connections 2024-05-09T02:23:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.793+0000 7f1eed419640 1 -- 172.21.15.46:0/2821100707 wait complete. 2024-05-09T02:23:14.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.795+0000 7f1eed419640 1 Processor -- start 2024-05-09T02:23:14.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.795+0000 7f1eed419640 1 -- start start 2024-05-09T02:23:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1eed419640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 0x7f1ee81e4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1eed419640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee80c9230 0x7f1ee81f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1eed419640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee81584f0 0x7f1ee814e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1eed419640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8158900 con 0x7f1ee806ed80 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1eed419640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee815b9a0 con 0x7f1ee81584f0 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1eed419640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee80c2ae0 con 0x7f1ee80c9230 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 0x7f1ee81e4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 0x7f1ee81e4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59398/0 (socket says 172.21.15.46:59398) 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 -- 172.21.15.46:0/790561268 learned_addr learned my addr 172.21.15.46:0/790561268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee67fc640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee80c9230 0x7f1ee81f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee77fe640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee81584f0 0x7f1ee814e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 -- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee80c9230 msgr2=0x7f1ee81f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee80c9230 0x7f1ee81f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 -- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee81584f0 msgr2=0x7f1ee814e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.796+0000 7f1ee6ffd640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee81584f0 0x7f1ee814e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1ee6ffd640 1 -- 172.21.15.46:0/790561268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee81521d0 con 0x7f1ee806ed80 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1ee6ffd640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 0x7f1ee81e4bc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800efc0 tx=0x7f1ed800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800ce60 con 0x7f1ee806ed80 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed8019070 con 0x7f1ee806ed80 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee81524b0 con 0x7f1ee806ed80 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8014680 con 0x7f1ee806ed80 2024-05-09T02:23:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.797+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee80cae80 con 0x7f1ee806ed80 2024-05-09T02:23:14.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.798+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee80c5150 con 0x7f1ee806ed80 2024-05-09T02:23:14.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.799+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ed8005d10 con 0x7f1ee806ed80 2024-05-09T02:23:14.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.799+0000 7f1edf7fe640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1ec80762d0 0x7f1ec80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:14.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.799+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f1ed8097ed0 con 0x7f1ee806ed80 2024-05-09T02:23:14.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.799+0000 7f1ee67fc640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1ec80762d0 0x7f1ec80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:14.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.800+0000 7f1ee67fc640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1ec80762d0 0x7f1ec80787e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009500 tx=0x7f1ed0009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:14.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.804+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ee80c5150 con 0x7f1ee806ed80 2024-05-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.996+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1ee80c4040 con 0x7f1ec80762d0 2024-05-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.996+0000 7f1edf7fe640 1 -- 172.21.15.46:0/790561268 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1ee80c4040 con 0x7f1ec80762d0 2024-05-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1ec80762d0 msgr2=0x7f1ec80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1ec80762d0 0x7f1ec80787e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009500 tx=0x7f1ed0009110 comp rx=0 tx=0).stop 2024-05-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 msgr2=0x7f1ee81e4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 0x7f1ee81e4bc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800efc0 tx=0x7f1ed800c490 comp rx=0 tx=0).stop 2024-05-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 shutdown_connections 2024-05-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1ec80762d0 0x7f1ec80787e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee81584f0 0x7f1ee814e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ee80c9230 0x7f1ee81f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 --2- 172.21.15.46:0/790561268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ee806ed80 0x7f1ee81e4bc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 >> 172.21.15.46:0/790561268 conn(0x7f1ee80ccec0 msgr2=0x7f1ee8075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 shutdown_connections 2024-05-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:14.999+0000 7f1eed419640 1 -- 172.21.15.46:0/790561268 wait complete. 2024-05-09T02:23:15.014 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T02:23:15.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.130+0000 7fca83a70640 1 Processor -- start 2024-05-09T02:23:15.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.131+0000 7fca83a70640 1 -- start start 2024-05-09T02:23:15.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca83a70640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca7c0c9290 0x7fca7c1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca83a70640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fca7c0c5b50 0x7fca7c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca83a70640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca7c157cc0 con 0x7fca7c0c9710 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca83a70640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fca7c15b1a0 con 0x7fca7c0c9290 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca83a70640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fca7c158310 con 0x7fca7c0c5b50 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca7c0c9290 0x7fca7c1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca7c0c9290 0x7fca7c1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59410/0 (socket says 172.21.15.46:59410) 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 -- 172.21.15.46:0/565578831 learned_addr learned my addr 172.21.15.46:0/565578831 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8200d640 1 --2- 172.21.15.46:0/565578831 >> v2:172.21.15.107:3300/0 conn(0x7fca7c0c5b50 0x7fca7c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 -- 172.21.15.46:0/565578831 >> v2:172.21.15.107:3300/0 conn(0x7fca7c0c5b50 msgr2=0x7fca7c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 --2- 172.21.15.46:0/565578831 >> v2:172.21.15.107:3300/0 conn(0x7fca7c0c5b50 0x7fca7c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 -- 172.21.15.46:0/565578831 >> v1:172.21.15.107:6789/0 conn(0x7fca7c0c9710 legacy=0x7fca7c155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.132+0000 7fca8180c640 1 -- 172.21.15.46:0/565578831 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c157fa0 con 0x7fca7c0c9290 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.133+0000 7fca8180c640 1 --2- 172.21.15.46:0/565578831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9290 0x7fca7c1587a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0cad50 tx=0x7fca6c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4bd1c2ce422e91 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.133+0000 7fca8080a640 1 -- 172.21.15.46:0/565578831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c036070 con 0x7fca7c0c9290 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.133+0000 7fca8080a640 1 -- 172.21.15.46:0/565578831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c031600 con 0x7fca7c0c9290 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.133+0000 7fca8080a640 1 -- 172.21.15.46:0/565578831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0319d0 con 0x7fca7c0c9290 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 -- 172.21.15.46:0/565578831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9290 msgr2=0x7fca7c1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 --2- 172.21.15.46:0/565578831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9290 0x7fca7c1587a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0cad50 tx=0x7fca6c02a6a0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 -- 172.21.15.46:0/565578831 shutdown_connections 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 --2- 172.21.15.46:0/565578831 >> v2:172.21.15.107:3300/0 conn(0x7fca7c0c5b50 0x7fca7c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 --2- 172.21.15.46:0/565578831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9290 0x7fca7c1587a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 -- 172.21.15.46:0/565578831 >> 172.21.15.46:0/565578831 conn(0x7fca7c06dad0 msgr2=0x7fca7c06dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 -- 172.21.15.46:0/565578831 shutdown_connections 2024-05-09T02:23:15.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.134+0000 7fca83a70640 1 -- 172.21.15.46:0/565578831 wait complete. 2024-05-09T02:23:15.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.136+0000 7fca83a70640 1 Processor -- start 2024-05-09T02:23:15.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.136+0000 7fca83a70640 1 -- start start 2024-05-09T02:23:15.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca83a70640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca7c0c5b50 0x7fca7c0c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca83a70640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca7c0c9290 0x7fca7c0cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca83a70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9710 0x7fca7c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca83a70640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c0c4440 con 0x7fca7c0c9710 2024-05-09T02:23:15.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca83a70640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c0c42c0 con 0x7fca7c0c5b50 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca83a70640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c0ca140 con 0x7fca7c0c9290 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca8200d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9710 0x7fca7c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca8200d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9710 0x7fca7c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59414/0 (socket says 172.21.15.46:59414) 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca8200d640 1 -- 172.21.15.46:0/2675701786 learned_addr learned my addr 172.21.15.46:0/2675701786 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca8180c640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca7c0c5b50 0x7fca7c0c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.137+0000 7fca8100b640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca7c0c9290 0x7fca7c0cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8200d640 1 -- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca7c0c9290 msgr2=0x7fca7c0cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8200d640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca7c0c9290 0x7fca7c0cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8200d640 1 -- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca7c0c5b50 msgr2=0x7fca7c0c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8200d640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca7c0c5b50 0x7fca7c0c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8200d640 1 -- 172.21.15.46:0/2675701786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c152530 con 0x7fca7c0c9710 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8180c640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca7c0c5b50 0x7fca7c0c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca8200d640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9710 0x7fca7c0cb300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e820 tx=0x7fca7400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74017070 con 0x7fca7c0c9710 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7400c730 con 0x7fca7c0c9710 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c156990 con 0x7fca7c0c9710 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7400cb00 con 0x7fca7c0c9710 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.138+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c156f50 con 0x7fca7c0c9710 2024-05-09T02:23:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.139+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca7c06a3a0 con 0x7fca7c0c9710 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.140+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca7401a070 con 0x7fca7c0c9710 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.140+0000 7fca7a7fc640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca68076300 0x7fca68078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.140+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fca74097db0 con 0x7fca7c0c9710 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.140+0000 7fca7a7fc640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7fca68081090 0x7fca68083560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.140+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 --> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca74016ec0 con 0x7fca68081090 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.141+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca74098240 con 0x7fca7c0c9710 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.141+0000 7fca8180c640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca68076300 0x7fca68078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.141+0000 7fca8100b640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7fca68081090 0x7fca68083560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.141+0000 7fca8100b640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7fca68081090 0x7fca68083560 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.141+0000 7fca8180c640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca68076300 0x7fca68078810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca6c033000 tx=0x7fca6c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.142+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== osd.2 v2:172.21.15.46:6818/2243748117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca74016ec0 con 0x7fca68081090 2024-05-09T02:23:15.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.155+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 --> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fca7c156740 con 0x7fca68081090 2024-05-09T02:23:15.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.155+0000 7fca7a7fc640 1 -- 172.21.15.46:0/2675701786 <== osd.2 v2:172.21.15.46:6818/2243748117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fca7c156740 con 0x7fca68081090 2024-05-09T02:23:15.159 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:15.159 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:15.159 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7fca68081090 msgr2=0x7fca68083560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:6818/2243748117,v1:172.21.15.46:6821/2243748117] conn(0x7fca68081090 0x7fca68083560 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca68076300 msgr2=0x7fca68078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca68076300 0x7fca68078810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca6c033000 tx=0x7fca6c009000 comp rx=0 tx=0).stop 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9710 msgr2=0x7fca7c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 --2- 172.21.15.46:0/2675701786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca7c0c9710 0x7fca7c0cb300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e820 tx=0x7fca7400ece0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca8200d640 1 -- 172.21.15.46:0/2675701786 reap_dead start 2024-05-09T02:23:15.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 shutdown_connections 2024-05-09T02:23:15.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 >> 172.21.15.46:0/2675701786 conn(0x7fca7c06dad0 msgr2=0x7fca7c15b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 shutdown_connections 2024-05-09T02:23:15.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.156+0000 7fca83a70640 1 -- 172.21.15.46:0/2675701786 wait complete. 2024-05-09T02:23:15.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T02:23:15.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.283+0000 7fd50dc49640 1 Processor -- start 2024-05-09T02:23:15.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.283+0000 7fd50dc49640 1 -- start start 2024-05-09T02:23:15.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd50dc49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5080c80f0 0x7fd50815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd50dc49640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd508157b10 con 0x7fd5080cd520 2024-05-09T02:23:15.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd50dc49640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50815b7c0 con 0x7fd508155060 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd50dc49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd508157e10 con 0x7fd5080c80f0 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd507fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd5080cd520 0x7fd5080cad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45096/0 (socket says 172.21.15.46:45096) 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd507fff640 1 -- 172.21.15.46:0/3819553650 learned_addr learned my addr 172.21.15.46:0/3819553650 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.284+0000 7fd5077fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5080c80f0 0x7fd50815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.285+0000 7fd5077fe640 1 -- 172.21.15.46:0/3819553650 >> v1:172.21.15.107:6789/0 conn(0x7fd508155060 legacy=0x7fd5081582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.285+0000 7fd5077fe640 1 -- 172.21.15.46:0/3819553650 >> v1:172.21.15.46:6789/0 conn(0x7fd5080cd520 legacy=0x7fd5080cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.285+0000 7fd5077fe640 1 -- 172.21.15.46:0/3819553650 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50815baa0 con 0x7fd5080c80f0 2024-05-09T02:23:15.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.285+0000 7fd5067fc640 1 -- 172.21.15.46:0/3819553650 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754146259 0 0) 0x7fd508157b10 con 0x7fd5080cd520 2024-05-09T02:23:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd5077fe640 1 --2- 172.21.15.46:0/3819553650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5080c80f0 0x7fd50815af70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009750 tx=0x7fd4f8029f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6041d9cb870bc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd5067fc640 1 -- 172.21.15.46:0/3819553650 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8037070 con 0x7fd5080c80f0 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd5067fc640 1 -- 172.21.15.46:0/3819553650 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f802ac90 con 0x7fd5080c80f0 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd5067fc640 1 -- 172.21.15.46:0/3819553650 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8032660 con 0x7fd5080c80f0 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd50dc49640 1 -- 172.21.15.46:0/3819553650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5080c80f0 msgr2=0x7fd50815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd50dc49640 1 --2- 172.21.15.46:0/3819553650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5080c80f0 0x7fd50815af70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009750 tx=0x7fd4f8029f80 comp rx=0 tx=0).stop 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd50dc49640 1 -- 172.21.15.46:0/3819553650 shutdown_connections 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd50dc49640 1 --2- 172.21.15.46:0/3819553650 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5080c80f0 0x7fd50815af70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd50dc49640 1 -- 172.21.15.46:0/3819553650 >> 172.21.15.46:0/3819553650 conn(0x7fd5080aefc0 msgr2=0x7fd5080cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.286+0000 7fd50dc49640 1 -- 172.21.15.46:0/3819553650 shutdown_connections 2024-05-09T02:23:15.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.287+0000 7fd50dc49640 1 -- 172.21.15.46:0/3819553650 wait complete. 2024-05-09T02:23:15.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.288+0000 7fd50dc49640 1 Processor -- start 2024-05-09T02:23:15.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.288+0000 7fd50dc49640 1 -- start start 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.289+0000 7fd50dc49640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5080c80f0 0x7fd5081f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.289+0000 7fd50dc49640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 0x7fd5080c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd50dc49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd508155060 0x7fd508153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd50dc49640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd50815bd80 con 0x7fd5080cd520 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd50dc49640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd5081589b0 con 0x7fd5080c80f0 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd50dc49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd508155470 con 0x7fd508155060 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 0x7fd5080c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 0x7fd5080c11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59428/0 (socket says 172.21.15.46:59428) 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 -- 172.21.15.46:0/2276822133 learned_addr learned my addr 172.21.15.46:0/2276822133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd5077fe640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5080c80f0 0x7fd5081f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd507fff640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd508155060 0x7fd508153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 -- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd508155060 msgr2=0x7fd508153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd508155060 0x7fd508153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 -- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5080c80f0 msgr2=0x7fd5081f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5080c80f0 0x7fd5081f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 -- 172.21.15.46:0/2276822133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5080c65d0 con 0x7fd5080cd520 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd506ffd640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 0x7fd5080c11b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c430 tx=0x7fd4fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.290+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc017070 con 0x7fd5080cd520 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.291+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc0035f0 con 0x7fd5080cd520 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.291+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5080c68b0 con 0x7fd5080cd520 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.291+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0039c0 con 0x7fd5080cd520 2024-05-09T02:23:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.291+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5080c1c10 con 0x7fd5080cd520 2024-05-09T02:23:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.292+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5081f1850 con 0x7fd5080cd520 2024-05-09T02:23:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.293+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd4fc01a070 con 0x7fd5080cd520 2024-05-09T02:23:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.293+0000 7fd4effff640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd4f40762d0 0x7fd4f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.293+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fd4fc096d10 con 0x7fd5080cd520 2024-05-09T02:23:15.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.293+0000 7fd5077fe640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd4f40762d0 0x7fd4f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.294+0000 7fd5077fe640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd4f40762d0 0x7fd4f40787e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8034000 tx=0x7fd4f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.298+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5081f1850 con 0x7fd5080cd520 2024-05-09T02:23:15.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.488+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd50806a330 con 0x7fd4f40762d0 2024-05-09T02:23:15.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.489+0000 7fd4effff640 1 -- 172.21.15.46:0/2276822133 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd50806a330 con 0x7fd4f40762d0 2024-05-09T02:23:15.491 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T02:23:15.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd4f40762d0 msgr2=0x7fd4f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd4f40762d0 0x7fd4f40787e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8034000 tx=0x7fd4f802e000 comp rx=0 tx=0).stop 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 msgr2=0x7fd5080c11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 0x7fd5080c11b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c430 tx=0x7fd4fc00c830 comp rx=0 tx=0).stop 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 shutdown_connections 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd4f40762d0 0x7fd4f40787e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd508155060 0x7fd508153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5080cd520 0x7fd5080c11b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 --2- 172.21.15.46:0/2276822133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5080c80f0 0x7fd5081f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 >> 172.21.15.46:0/2276822133 conn(0x7fd5080aefc0 msgr2=0x7fd508075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 shutdown_connections 2024-05-09T02:23:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.491+0000 7fd50dc49640 1 -- 172.21.15.46:0/2276822133 wait complete. 2024-05-09T02:23:15.506 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T02:23:15.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.622+0000 7ff9f7134640 1 Processor -- start 2024-05-09T02:23:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.622+0000 7ff9f7134640 1 -- start start 2024-05-09T02:23:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f7134640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 0x7ff9f015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f7134640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f0158570 con 0x7ff9f00c6e00 2024-05-09T02:23:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f7134640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f0158850 con 0x7ff9f00c9b00 2024-05-09T02:23:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f7134640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00c20f0 con 0x7ff9f015b6c0 2024-05-09T02:23:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f4ed0640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff9f00c6e00 0x7ff9f00c93f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45102/0 (socket says 172.21.15.46:45102) 2024-05-09T02:23:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f4ed0640 1 -- 172.21.15.46:0/2674900997 learned_addr learned my addr 172.21.15.46:0/2674900997 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f56d1640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 0x7ff9f015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158942341 0 0) 0x7ff9f0158570 con 0x7ff9f00c6e00 2024-05-09T02:23:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d8003520 con 0x7ff9f00c6e00 2024-05-09T02:23:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2478882404 0 0) 0x7ff9d8003520 con 0x7ff9f00c6e00 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 msgr2=0x7ff9f015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 0x7ff9f015bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 >> v1:172.21.15.107:6789/0 conn(0x7ff9f00c9b00 legacy=0x7ff9f015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00c23d0 con 0x7ff9f00c6e00 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7ff9e8001a70 con 0x7ff9f00c6e00 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 >> v1:172.21.15.46:6789/0 conn(0x7ff9f00c6e00 legacy=0x7ff9f00c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9d8003a30 0x7ff9d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 0x7ff9d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8004e60 0x7ff9d8005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00c20f0 con 0x7ff9d8003a30 2024-05-09T02:23:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d800bcc0 con 0x7ff9d8004e60 2024-05-09T02:23:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d800bec0 con 0x7ff9f015b6c0 2024-05-09T02:23:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.624+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9d8003a30 0x7ff9d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9f56d1640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8004e60 0x7ff9d8005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9effff640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 0x7ff9d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9f4ed0640 1 -- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 msgr2=0x7ff9d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f015b6c0 0x7ff9d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9f4ed0640 1 -- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8004e60 msgr2=0x7ff9d8005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8004e60 0x7ff9d8005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.625+0000 7ff9f4ed0640 1 -- 172.21.15.46:0/2674900997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d8003520 con 0x7ff9d8003a30 2024-05-09T02:23:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9d8003a30 0x7ff9d8003ea0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff9f006f810 tx=0x7ff9d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d79fd58f1ea33cd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800a450 con 0x7ff9d8003a30 2024-05-09T02:23:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e802f070 con 0x7ff9d8003a30 2024-05-09T02:23:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9ef7fe640 1 -- 172.21.15.46:0/2674900997 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e802bb80 con 0x7ff9d8003a30 2024-05-09T02:23:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f7134640 1 -- 172.21.15.46:0/2674900997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9d8003a30 msgr2=0x7ff9d8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f7134640 1 --2- 172.21.15.46:0/2674900997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9d8003a30 0x7ff9d8003ea0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff9f006f810 tx=0x7ff9d8005830 comp rx=0 tx=0).stop 2024-05-09T02:23:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f56d1640 1 -- 172.21.15.46:0/2674900997 reap_dead start 2024-05-09T02:23:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f7134640 1 -- 172.21.15.46:0/2674900997 shutdown_connections 2024-05-09T02:23:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f7134640 1 -- 172.21.15.46:0/2674900997 >> 172.21.15.46:0/2674900997 conn(0x7ff9f006e9b0 msgr2=0x7ff9f006edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f7134640 1 -- 172.21.15.46:0/2674900997 shutdown_connections 2024-05-09T02:23:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.626+0000 7ff9f7134640 1 -- 172.21.15.46:0/2674900997 wait complete. 2024-05-09T02:23:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.628+0000 7ff9f7134640 1 Processor -- start 2024-05-09T02:23:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.628+0000 7ff9f7134640 1 -- start start 2024-05-09T02:23:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.629+0000 7ff9f7134640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8003a30 0x7ff9f0153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.629+0000 7ff9f7134640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9f01f1760 0x7ff9f01ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f7134640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f014b7c0 0x7ff9f014bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f7134640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0155240 con 0x7ff9f01f1760 2024-05-09T02:23:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f7134640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00ca120 con 0x7ff9d8003a30 2024-05-09T02:23:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f7134640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f01553c0 con 0x7ff9f014b7c0 2024-05-09T02:23:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9f01f1760 0x7ff9f01ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9f01f1760 0x7ff9f01ed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59440/0 (socket says 172.21.15.46:59440) 2024-05-09T02:23:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 -- 172.21.15.46:0/786713598 learned_addr learned my addr 172.21.15.46:0/786713598 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8003a30 0x7ff9f0153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f56d1640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f014b7c0 0x7ff9f014bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 -- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f014b7c0 msgr2=0x7ff9f014bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9f014b7c0 0x7ff9f014bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 -- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8003a30 msgr2=0x7ff9f0153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8003a30 0x7ff9f0153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 -- 172.21.15.46:0/786713598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f01f0cc0 con 0x7ff9f01f1760 2024-05-09T02:23:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9effff640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9f01f1760 0x7ff9f01ed5b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400f820 tx=0x7ff9e400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40050d0 con 0x7ff9f01f1760 2024-05-09T02:23:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e4018070 con 0x7ff9f01f1760 2024-05-09T02:23:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f01506e0 con 0x7ff9f01f1760 2024-05-09T02:23:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400d730 con 0x7ff9f01f1760 2024-05-09T02:23:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.630+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f014c110 con 0x7ff9f01f1760 2024-05-09T02:23:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.631+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9f01f1340 con 0x7ff9f01f1760 2024-05-09T02:23:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.632+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9e400d8d0 con 0x7ff9f01f1760 2024-05-09T02:23:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9ed7fa640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff9dc0762d0 0x7ff9dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ff9e40983b0 con 0x7ff9f01f1760 2024-05-09T02:23:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9ed7fa640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7ff9dc0810f0 0x7ff9dc0835c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 --> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9e4004e50 con 0x7ff9dc0810f0 2024-05-09T02:23:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff9dc0762d0 0x7ff9dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff9e4098840 con 0x7ff9f01f1760 2024-05-09T02:23:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9f56d1640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7ff9dc0810f0 0x7ff9dc0835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9f56d1640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7ff9dc0810f0 0x7ff9dc0835c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.633+0000 7ff9f4ed0640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff9dc0762d0 0x7ff9dc0787e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8033000 tx=0x7ff9e802d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.634+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== osd.3 v2:172.21.15.46:6808/2010129310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9e4004e50 con 0x7ff9dc0810f0 2024-05-09T02:23:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.647+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 --> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9f006a3a0 con 0x7ff9dc0810f0 2024-05-09T02:23:15.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9ed7fa640 1 -- 172.21.15.46:0/786713598 <== osd.3 v2:172.21.15.46:6808/2010129310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9f006a3a0 con 0x7ff9dc0810f0 2024-05-09T02:23:15.653 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:15.653 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:15.653 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:15.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7ff9dc0810f0 msgr2=0x7ff9dc0835c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:6808/2010129310,v1:172.21.15.46:6810/2010129310] conn(0x7ff9dc0810f0 0x7ff9dc0835c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff9dc0762d0 msgr2=0x7ff9dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff9dc0762d0 0x7ff9dc0787e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8033000 tx=0x7ff9e802d000 comp rx=0 tx=0).stop 2024-05-09T02:23:15.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9f01f1760 msgr2=0x7ff9f01ed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 --2- 172.21.15.46:0/786713598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9f01f1760 0x7ff9f01ed5b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400f820 tx=0x7ff9e400fc20 comp rx=0 tx=0).stop 2024-05-09T02:23:15.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f56d1640 1 -- 172.21.15.46:0/786713598 reap_dead start 2024-05-09T02:23:15.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 shutdown_connections 2024-05-09T02:23:15.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 >> 172.21.15.46:0/786713598 conn(0x7ff9f006e9b0 msgr2=0x7ff9f00c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 shutdown_connections 2024-05-09T02:23:15.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.648+0000 7ff9f7134640 1 -- 172.21.15.46:0/786713598 wait complete. 2024-05-09T02:23:15.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T02:23:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.775+0000 7fab20c3b640 1 Processor -- start 2024-05-09T02:23:15.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.775+0000 7fab20c3b640 1 -- start start 2024-05-09T02:23:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab20c3b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c0b1890 0x7fab1c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab20c3b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fab1c06e8b0 0x7fab1c0c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab20c3b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab1c06ecc0 con 0x7fab1c06e4a0 2024-05-09T02:23:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab20c3b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fab1c0c1e30 con 0x7fab1c06e8b0 2024-05-09T02:23:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab20c3b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c158820 con 0x7fab1c0b1890 2024-05-09T02:23:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab19d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fab1c06e4a0 0x7fab1c0c2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45108/0 (socket says 172.21.15.46:45108) 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab19d9b640 1 -- 172.21.15.46:0/3782098966 learned_addr learned my addr 172.21.15.46:0/3782098966 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1ad9d640 1 --2- 172.21.15.46:0/3782098966 >> v2:172.21.15.107:3300/0 conn(0x7fab1c06e8b0 0x7fab1c0c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1a59c640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c0b1890 0x7fab1c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1959a640 1 -- 172.21.15.46:0/3782098966 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732344481 0 0) 0x7fab1c06ecc0 con 0x7fab1c06e4a0 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1959a640 1 -- 172.21.15.46:0/3782098966 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab08003520 con 0x7fab1c06e4a0 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c0b1890 msgr2=0x7fab1c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1ad9d640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c0b1890 0x7fab1c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3782098966 >> v1:172.21.15.46:6789/0 conn(0x7fab1c06e4a0 legacy=0x7fab1c0c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1959a640 1 -- 172.21.15.46:0/3782098966 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1677775715 0 0) 0x7fab08003520 con 0x7fab1c06e4a0 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3782098966 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c0c2080 con 0x7fab1c06e8b0 2024-05-09T02:23:15.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.777+0000 7fab1a59c640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c0b1890 0x7fab1c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:15.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.778+0000 7fab1ad9d640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e8b0 0x7fab1c0c3270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab140097a0 tx=0x7fab1402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc35fa6886d320b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.778+0000 7fab1959a640 1 -- 172.21.15.46:0/3782098966 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14037070 con 0x7fab1c06e8b0 2024-05-09T02:23:15.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.778+0000 7fab1959a640 1 -- 172.21.15.46:0/3782098966 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1402ab10 con 0x7fab1c06e8b0 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.778+0000 7fab1959a640 1 -- 172.21.15.46:0/3782098966 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040016f0 con 0x7fab1c06e8b0 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 -- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e8b0 msgr2=0x7fab1c0c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e8b0 0x7fab1c0c3270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab140097a0 tx=0x7fab1402a080 comp rx=0 tx=0).stop 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 -- 172.21.15.46:0/3782098966 shutdown_connections 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e8b0 0x7fab1c0c3270 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3782098966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c0b1890 0x7fab1c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 -- 172.21.15.46:0/3782098966 >> 172.21.15.46:0/3782098966 conn(0x7fab1c068e90 msgr2=0x7fab1c0cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 -- 172.21.15.46:0/3782098966 shutdown_connections 2024-05-09T02:23:15.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.779+0000 7fab20c3b640 1 -- 172.21.15.46:0/3782098966 wait complete. 2024-05-09T02:23:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.781+0000 7fab20c3b640 1 Processor -- start 2024-05-09T02:23:15.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.781+0000 7fab20c3b640 1 -- start start 2024-05-09T02:23:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab20c3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e4a0 0x7fab1c148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab20c3b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c06e8b0 0x7fab1c1f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab20c3b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 0x7fab1c0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab20c3b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c1555f0 con 0x7fab1c0b1890 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab20c3b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0c2640 con 0x7fab1c06e4a0 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab20c3b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c0c37b0 con 0x7fab1c06e8b0 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab1ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 0x7fab1c0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab1ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 0x7fab1c0c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59450/0 (socket says 172.21.15.46:59450) 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.782+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3625482536 learned_addr learned my addr 172.21.15.46:0/3625482536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab19d9b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c06e8b0 0x7fab1c1f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1a59c640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e4a0 0x7fab1c148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c06e8b0 msgr2=0x7fab1c1f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1ad9d640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c06e8b0 0x7fab1c1f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e4a0 msgr2=0x7fab1c148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1ad9d640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e4a0 0x7fab1c148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1ad9d640 1 -- 172.21.15.46:0/3625482536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c148f30 con 0x7fab1c0b1890 2024-05-09T02:23:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab1ad9d640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 0x7fab1c0c6900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fab14035040 tx=0x7fab140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14042020 con 0x7fab1c0b1890 2024-05-09T02:23:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab14003a40 con 0x7fab1c0b1890 2024-05-09T02:23:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1c158f00 con 0x7fab1c0b1890 2024-05-09T02:23:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14037040 con 0x7fab1c0b1890 2024-05-09T02:23:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.783+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1c15b1b0 con 0x7fab1c0b1890 2024-05-09T02:23:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.784+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1c0c35d0 con 0x7fab1c0b1890 2024-05-09T02:23:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.785+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab14045020 con 0x7fab1c0b1890 2024-05-09T02:23:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.785+0000 7fab12ffd640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faafc0762d0 0x7faafc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.785+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fab140b8220 con 0x7fab1c0b1890 2024-05-09T02:23:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.786+0000 7fab1a59c640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faafc0762d0 0x7faafc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.786+0000 7fab1a59c640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faafc0762d0 0x7faafc0787e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0c4c80 tx=0x7fab0c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.790+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fab1c0c35d0 con 0x7fab1c0b1890 2024-05-09T02:23:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.980+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fab1c15a310 con 0x7faafc0762d0 2024-05-09T02:23:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.981+0000 7fab12ffd640 1 -- 172.21.15.46:0/3625482536 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fab1c15a310 con 0x7faafc0762d0 2024-05-09T02:23:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T02:23:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faafc0762d0 msgr2=0x7faafc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faafc0762d0 0x7faafc0787e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0c4c80 tx=0x7fab0c00b040 comp rx=0 tx=0).stop 2024-05-09T02:23:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 msgr2=0x7fab1c0c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 0x7fab1c0c6900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fab14035040 tx=0x7fab140046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 shutdown_connections 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faafc0762d0 0x7faafc0787e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab1c0b1890 0x7fab1c0c6900 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fab1c06e8b0 0x7fab1c1f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 --2- 172.21.15.46:0/3625482536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab1c06e4a0 0x7fab1c148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 >> 172.21.15.46:0/3625482536 conn(0x7fab1c068e90 msgr2=0x7fab1c0c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 shutdown_connections 2024-05-09T02:23:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:15.983+0000 7fab20c3b640 1 -- 172.21.15.46:0/3625482536 wait complete. 2024-05-09T02:23:15.998 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T02:23:15.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:16.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.115+0000 7f29c00d1640 1 Processor -- start 2024-05-09T02:23:16.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.116+0000 7f29c00d1640 1 -- start start 2024-05-09T02:23:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29c00d1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f29b80c9290 0x7f29b81587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29c00d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29b80c9710 0x7f29b8155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29c00d1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b8157cc0 con 0x7f29b80c5b50 2024-05-09T02:23:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29c00d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f29b815b1a0 con 0x7f29b80c9710 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29c00d1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f29b8158310 con 0x7f29b80c9290 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29b80c9710 0x7f29b8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29b80c9710 0x7f29b8155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59454/0 (socket says 172.21.15.46:59454) 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 -- 172.21.15.46:0/2682838825 learned_addr learned my addr 172.21.15.46:0/2682838825 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bde6d640 1 --2- 172.21.15.46:0/2682838825 >> v2:172.21.15.107:3300/0 conn(0x7f29b80c9290 0x7f29b81587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 -- 172.21.15.46:0/2682838825 >> v2:172.21.15.107:3300/0 conn(0x7f29b80c9290 msgr2=0x7f29b81587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 --2- 172.21.15.46:0/2682838825 >> v2:172.21.15.107:3300/0 conn(0x7f29b80c9290 0x7f29b81587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 -- 172.21.15.46:0/2682838825 >> v1:172.21.15.107:6789/0 conn(0x7f29b80c5b50 legacy=0x7f29b80c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.117+0000 7f29bd66c640 1 -- 172.21.15.46:0/2682838825 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b8157fa0 con 0x7f29b80c9710 2024-05-09T02:23:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.118+0000 7f29bd66c640 1 --2- 172.21.15.46:0/2682838825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8155210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f29b806ea90 tx=0x7f29ac02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ad639d281a7812 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.118+0000 7f29bce6b640 1 -- 172.21.15.46:0/2682838825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac037070 con 0x7f29b80c9710 2024-05-09T02:23:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.118+0000 7f29bce6b640 1 -- 172.21.15.46:0/2682838825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac032440 con 0x7f29b80c9710 2024-05-09T02:23:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.118+0000 7f29bce6b640 1 -- 172.21.15.46:0/2682838825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac032810 con 0x7f29b80c9710 2024-05-09T02:23:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 -- 172.21.15.46:0/2682838825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 msgr2=0x7f29b8155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 --2- 172.21.15.46:0/2682838825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8155210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f29b806ea90 tx=0x7f29ac02a140 comp rx=0 tx=0).stop 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 -- 172.21.15.46:0/2682838825 shutdown_connections 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 --2- 172.21.15.46:0/2682838825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8155210 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 --2- 172.21.15.46:0/2682838825 >> v2:172.21.15.107:3300/0 conn(0x7f29b80c9290 0x7f29b81587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 -- 172.21.15.46:0/2682838825 >> 172.21.15.46:0/2682838825 conn(0x7f29b806dad0 msgr2=0x7f29b806dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 -- 172.21.15.46:0/2682838825 shutdown_connections 2024-05-09T02:23:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.119+0000 7f29c00d1640 1 -- 172.21.15.46:0/2682838825 wait complete. 2024-05-09T02:23:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.121+0000 7f29c00d1640 1 Processor -- start 2024-05-09T02:23:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.121+0000 7f29c00d1640 1 -- start start 2024-05-09T02:23:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29c00d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29b80c5b50 0x7f29b81465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29c00d1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29b80c9290 0x7f29b814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29c00d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29c00d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f29b80ca310 con 0x7f29b80c9710 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29c00d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8155750 con 0x7f29b80c5b50 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29c00d1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f29b80ca490 con 0x7f29b80c9290 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29be66e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29be66e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59458/0 (socket says 172.21.15.46:59458) 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29be66e640 1 -- 172.21.15.46:0/2684910171 learned_addr learned my addr 172.21.15.46:0/2684910171 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29bde6d640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29b80c5b50 0x7f29b81465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.122+0000 7f29bd66c640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29b80c9290 0x7f29b814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29be66e640 1 -- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29b80c9290 msgr2=0x7f29b814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29be66e640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f29b80c9290 0x7f29b814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29be66e640 1 -- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29b80c5b50 msgr2=0x7f29b81465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29be66e640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29b80c5b50 0x7f29b81465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29be66e640 1 -- 172.21.15.46:0/2684910171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b8076870 con 0x7f29b80c9710 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29be66e640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8156fd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29a800b440 tx=0x7f29a800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8011830 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8016070 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b814ce60 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8011c10 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.123+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81ee540 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.124+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29b806a3a0 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.125+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29a801b460 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.125+0000 7f29b67fc640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f29a40762d0 0x7f29a40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f29a80981c0 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29b67fc640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f29a40810e0 0x7f29a40835b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 --> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29a8016e50 con 0x7f29a40810e0 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f29a8098650 con 0x7f29b80c9710 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29bde6d640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f29a40762d0 0x7f29a40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29bd66c640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f29a40810e0 0x7f29a40835b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29bde6d640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f29a40762d0 0x7f29a40787e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29b000f360 tx=0x7f29b0007710 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.126+0000 7f29bd66c640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f29a40810e0 0x7f29a40835b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.127+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== osd.4 v2:172.21.15.107:6824/2823066883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29a8016e50 con 0x7f29a40810e0 2024-05-09T02:23:16.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 --> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29b8147290 con 0x7f29a40810e0 2024-05-09T02:23:16.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29b67fc640 1 -- 172.21.15.46:0/2684910171 <== osd.4 v2:172.21.15.107:6824/2823066883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29b8147290 con 0x7f29a40810e0 2024-05-09T02:23:16.144 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:16.144 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:16.144 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:16.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f29a40810e0 msgr2=0x7f29a40835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6824/2823066883,v1:172.21.15.107:6825/2823066883] conn(0x7f29a40810e0 0x7f29a40835b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f29a40762d0 msgr2=0x7f29a40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f29a40762d0 0x7f29a40787e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29b000f360 tx=0x7f29b0007710 comp rx=0 tx=0).stop 2024-05-09T02:23:16.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 msgr2=0x7f29b8156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.141+0000 7f29c00d1640 1 --2- 172.21.15.46:0/2684910171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80c9710 0x7f29b8156fd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29a800b440 tx=0x7f29a800b900 comp rx=0 tx=0).stop 2024-05-09T02:23:16.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.142+0000 7f29be66e640 1 -- 172.21.15.46:0/2684910171 reap_dead start 2024-05-09T02:23:16.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.142+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 shutdown_connections 2024-05-09T02:23:16.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.142+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 >> 172.21.15.46:0/2684910171 conn(0x7f29b806dad0 msgr2=0x7f29b806dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.142+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 shutdown_connections 2024-05-09T02:23:16.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.142+0000 7f29c00d1640 1 -- 172.21.15.46:0/2684910171 wait complete. 2024-05-09T02:23:16.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T02:23:16.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.267+0000 7f6ac6ad1640 1 Processor -- start 2024-05-09T02:23:16.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.267+0000 7f6ac6ad1640 1 -- start start 2024-05-09T02:23:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac6ad1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac00b1890 0x7f6ac01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac6ad1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ac006e8b0 0x7f6ac00c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac6ad1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac006ecc0 con 0x7f6ac006e4a0 2024-05-09T02:23:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac6ad1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac00c1e30 con 0x7f6ac006e8b0 2024-05-09T02:23:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac6ad1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac0158820 con 0x7f6ac00b1890 2024-05-09T02:23:16.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac506e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ac006e8b0 0x7f6ac00c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6abffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6ac006e4a0 0x7f6ac00c2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45124/0 (socket says 172.21.15.46:45124) 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac506e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ac006e8b0 0x7f6ac00c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59464/0 (socket says 172.21.15.46:59464) 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6abffff640 1 -- 172.21.15.46:0/2365752840 learned_addr learned my addr 172.21.15.46:0/2365752840 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac486d640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac00b1890 0x7f6ac01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac506e640 1 -- 172.21.15.46:0/2365752840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac00b1890 msgr2=0x7f6ac01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac506e640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac00b1890 0x7f6ac01550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac506e640 1 -- 172.21.15.46:0/2365752840 >> v1:172.21.15.46:6789/0 conn(0x7f6ac006e4a0 legacy=0x7f6ac00c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6abf7fe640 1 -- 172.21.15.46:0/2365752840 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390117210 0 0) 0x7f6ac006ecc0 con 0x7f6ac006e4a0 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac506e640 1 -- 172.21.15.46:0/2365752840 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac00c2080 con 0x7f6ac006e8b0 2024-05-09T02:23:16.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.269+0000 7f6ac486d640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac00b1890 0x7f6ac01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:16.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.270+0000 7f6ac506e640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e8b0 0x7f6ac00c3270 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097a0 tx=0x7f6aa802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfe67ba70a1ce2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.270+0000 7f6abf7fe640 1 -- 172.21.15.46:0/2365752840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8037070 con 0x7f6ac006e8b0 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.270+0000 7f6abf7fe640 1 -- 172.21.15.46:0/2365752840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa8032440 con 0x7f6ac006e8b0 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.270+0000 7f6abf7fe640 1 -- 172.21.15.46:0/2365752840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa802ae60 con 0x7f6ac006e8b0 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/2365752840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e8b0 msgr2=0x7f6ac00c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e8b0 0x7f6ac00c3270 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097a0 tx=0x7f6aa802a110 comp rx=0 tx=0).stop 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/2365752840 shutdown_connections 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e8b0 0x7f6ac00c3270 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/2365752840 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac00b1890 0x7f6ac01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/2365752840 >> 172.21.15.46:0/2365752840 conn(0x7f6ac0068e90 msgr2=0x7f6ac00cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/2365752840 shutdown_connections 2024-05-09T02:23:16.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.271+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/2365752840 wait complete. 2024-05-09T02:23:16.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.273+0000 7f6ac6ad1640 1 Processor -- start 2024-05-09T02:23:16.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.273+0000 7f6ac6ad1640 1 -- start start 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac6ad1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 0x7f6ac00cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac6ad1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac006e8b0 0x7f6ac01f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac6ad1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ac00b1890 0x7f6ac01f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac6ad1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01555f0 con 0x7f6ac006e4a0 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac6ad1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00c2640 con 0x7f6ac00b1890 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac6ad1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac00c37b0 con 0x7f6ac006e8b0 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 0x7f6ac00cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 0x7f6ac00cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59478/0 (socket says 172.21.15.46:59478) 2024-05-09T02:23:16.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 -- 172.21.15.46:0/1364079305 learned_addr learned my addr 172.21.15.46:0/1364079305 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac506e640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ac00b1890 0x7f6ac01f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6abffff640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac006e8b0 0x7f6ac01f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 -- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac006e8b0 msgr2=0x7f6ac01f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac006e8b0 0x7f6ac01f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 -- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ac00b1890 msgr2=0x7f6ac01f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ac00b1890 0x7f6ac01f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac486d640 1 -- 172.21.15.46:0/1364079305 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac0159060 con 0x7f6ac006e4a0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.274+0000 7f6ac506e640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ac00b1890 0x7f6ac01f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.275+0000 7f6ac486d640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 0x7f6ac00cb180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800d830 tx=0x7f6ab800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.275+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80096a0 con 0x7f6ac006e4a0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.275+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab8019070 con 0x7f6ac006e4a0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.275+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8009a80 con 0x7f6ac006e4a0 2024-05-09T02:23:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.275+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac0159340 con 0x7f6ac006e4a0 2024-05-09T02:23:16.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.275+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac00cbbe0 con 0x7f6ac006e4a0 2024-05-09T02:23:16.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.276+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac006a330 con 0x7f6ac006e4a0 2024-05-09T02:23:16.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.277+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ab801e460 con 0x7f6ac006e4a0 2024-05-09T02:23:16.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.277+0000 7f6abd7fa640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6aa0076300 0x7f6aa0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.277+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f6ab80981f0 con 0x7f6ac006e4a0 2024-05-09T02:23:16.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.278+0000 7f6abffff640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6aa0076300 0x7f6aa0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.278+0000 7f6abffff640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6aa0076300 0x7f6aa0078810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0157960 tx=0x7f6ab0005eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.282+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ab8061590 con 0x7f6ac006e4a0 2024-05-09T02:23:16.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.475+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f6ac00ccf20 con 0x7f6aa0076300 2024-05-09T02:23:16.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.476+0000 7f6abd7fa640 1 -- 172.21.15.46:0/1364079305 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6ac00ccf20 con 0x7f6aa0076300 2024-05-09T02:23:16.478 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T02:23:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6aa0076300 msgr2=0x7f6aa0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6aa0076300 0x7f6aa0078810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0157960 tx=0x7f6ab0005eb0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 msgr2=0x7f6ac00cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 0x7f6ac00cb180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800d830 tx=0x7f6ab800dcf0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 shutdown_connections 2024-05-09T02:23:16.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f6aa0076300 0x7f6aa0078810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ac00b1890 0x7f6ac01f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ac006e8b0 0x7f6ac01f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 --2- 172.21.15.46:0/1364079305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ac006e4a0 0x7f6ac00cb180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 >> 172.21.15.46:0/1364079305 conn(0x7f6ac0068e90 msgr2=0x7f6ac0157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 shutdown_connections 2024-05-09T02:23:16.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.478+0000 7f6ac6ad1640 1 -- 172.21.15.46:0/1364079305 wait complete. 2024-05-09T02:23:16.493 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T02:23:16.493 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.610+0000 7f163d372640 1 Processor -- start 2024-05-09T02:23:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.610+0000 7f163d372640 1 -- start start 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.611+0000 7f163d372640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c3e60 0x7f163806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.611+0000 7f163d372640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16380c5ba0 0x7f1638155480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.611+0000 7f163d372640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f163815bf80 con 0x7f1638155070 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.611+0000 7f163d372640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f1638157f50 con 0x7f16380c5ba0 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.611+0000 7f163d372640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1638158230 con 0x7f16380c3e60 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16377fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16380c5ba0 0x7f1638155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16367fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1638155070 0x7f16380c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50144/0 (socket says 172.21.15.46:50144) 2024-05-09T02:23:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16367fc640 1 -- 172.21.15.46:0/561402505 learned_addr learned my addr 172.21.15.46:0/561402505 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f1636ffd640 1 --2- 172.21.15.46:0/561402505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c3e60 0x7f163806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16377fe640 1 -- 172.21.15.46:0/561402505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c3e60 msgr2=0x7f163806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16377fe640 1 --2- 172.21.15.46:0/561402505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c3e60 0x7f163806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16377fe640 1 -- 172.21.15.46:0/561402505 >> v1:172.21.15.46:6789/0 conn(0x7f1638155070 legacy=0x7f16380c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f1635ffb640 1 -- 172.21.15.46:0/561402505 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176687939 0 0) 0x7f163815bf80 con 0x7f1638155070 2024-05-09T02:23:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.612+0000 7f16377fe640 1 -- 172.21.15.46:0/561402505 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1638158510 con 0x7f16380c5ba0 2024-05-09T02:23:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.613+0000 7f16377fe640 1 --2- 172.21.15.46:0/561402505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c5ba0 0x7f1638155480 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1628009d90 tx=0x7f162802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e127d7de7cdcd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.613+0000 7f1635ffb640 1 -- 172.21.15.46:0/561402505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628031600 con 0x7f16380c5ba0 2024-05-09T02:23:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.613+0000 7f1635ffb640 1 -- 172.21.15.46:0/561402505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16280317a0 con 0x7f16380c5ba0 2024-05-09T02:23:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.613+0000 7f1635ffb640 1 -- 172.21.15.46:0/561402505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628031b70 con 0x7f16380c5ba0 2024-05-09T02:23:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 -- 172.21.15.46:0/561402505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c5ba0 msgr2=0x7f1638155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 --2- 172.21.15.46:0/561402505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c5ba0 0x7f1638155480 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1628009d90 tx=0x7f162802a5d0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 -- 172.21.15.46:0/561402505 shutdown_connections 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 --2- 172.21.15.46:0/561402505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c5ba0 0x7f1638155480 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 --2- 172.21.15.46:0/561402505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c3e60 0x7f163806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 -- 172.21.15.46:0/561402505 >> 172.21.15.46:0/561402505 conn(0x7f16380ca690 msgr2=0x7f16380c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 -- 172.21.15.46:0/561402505 shutdown_connections 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.614+0000 7f163d372640 1 -- 172.21.15.46:0/561402505 wait complete. 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.615+0000 7f163d372640 1 Processor -- start 2024-05-09T02:23:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.616+0000 7f163d372640 1 -- start start 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c3e60 0x7f16381f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c5ba0 0x7f16381599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1638155070 0x7f1638147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f16380c32c0 con 0x7f16380c3e60 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1638157c20 con 0x7f1638155070 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f163806cde0 con 0x7f16380c5ba0 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c3e60 0x7f16381f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c3e60 0x7f16381f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40708/0 (socket says 172.21.15.46:40708) 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 -- 172.21.15.46:0/773019400 learned_addr learned my addr 172.21.15.46:0/773019400 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f16367fc640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c5ba0 0x7f16381599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f16377fe640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1638155070 0x7f1638147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 -- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c5ba0 msgr2=0x7f16381599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16380c5ba0 0x7f16381599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 -- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1638155070 msgr2=0x7f1638147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1638155070 0x7f1638147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 -- 172.21.15.46:0/773019400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163815b010 con 0x7f16380c3e60 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f1636ffd640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c3e60 0x7f16381f0da0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f163000e870 tx=0x7f163000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630017070 con 0x7f16380c3e60 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163000c940 con 0x7f16380c3e60 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.617+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16381f1770 con 0x7f16380c3e60 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.618+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163000cd30 con 0x7f16380c3e60 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.618+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1638152600 con 0x7f16380c3e60 2024-05-09T02:23:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.618+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1638159570 con 0x7f16380c3e60 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.619+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f163001a070 con 0x7f16380c3e60 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f162f7fe640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1618076300 0x7f1618078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f1630097de0 con 0x7f16380c3e60 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f16367fc640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1618076300 0x7f1618078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f162f7fe640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f1618081110 0x7f16180835e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 --> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1630016ec0 con 0x7f1618081110 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1630098270 con 0x7f16380c3e60 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.620+0000 7f16377fe640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f1618081110 0x7f16180835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.621+0000 7f16367fc640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1618076300 0x7f1618078810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f163809c690 tx=0x7f1620007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.621+0000 7f16377fe640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f1618081110 0x7f16180835e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.621+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== osd.5 v2:172.21.15.107:6816/278179118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1630016ec0 con 0x7f1618081110 2024-05-09T02:23:16.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.635+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 --> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f163809f720 con 0x7f1618081110 2024-05-09T02:23:16.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.635+0000 7f162f7fe640 1 -- 172.21.15.46:0/773019400 <== osd.5 v2:172.21.15.107:6816/278179118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f163809f720 con 0x7f1618081110 2024-05-09T02:23:16.639 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:16.639 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:16.639 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f1618081110 msgr2=0x7f16180835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6816/278179118,v1:172.21.15.107:6817/278179118] conn(0x7f1618081110 0x7f16180835e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1618076300 msgr2=0x7f1618078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f1618076300 0x7f1618078810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f163809c690 tx=0x7f1620007c00 comp rx=0 tx=0).stop 2024-05-09T02:23:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c3e60 msgr2=0x7f16381f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 --2- 172.21.15.46:0/773019400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16380c3e60 0x7f16381f0da0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f163000e870 tx=0x7f163000ed30 comp rx=0 tx=0).stop 2024-05-09T02:23:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f16377fe640 1 -- 172.21.15.46:0/773019400 reap_dead start 2024-05-09T02:23:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 shutdown_connections 2024-05-09T02:23:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 >> 172.21.15.46:0/773019400 conn(0x7f16380ca690 msgr2=0x7f16380ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 shutdown_connections 2024-05-09T02:23:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.636+0000 7f163d372640 1 -- 172.21.15.46:0/773019400 wait complete. 2024-05-09T02:23:16.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T02:23:16.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.763+0000 7f74db461640 1 Processor -- start 2024-05-09T02:23:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.763+0000 7f74db461640 1 -- start start 2024-05-09T02:23:16.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74db461640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74d40c5f90 0x7f74d40c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74db461640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74d4070e80 0x7f74d415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74db461640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d4071290 con 0x7f74d4070a70 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74db461640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f74d4157b40 con 0x7f74d40c5f90 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74db461640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f74d4157e20 con 0x7f74d4070e80 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74d91fd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74d40c5f90 0x7f74d40c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74d89fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74d4070a70 0x7f74d415b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50156/0 (socket says 172.21.15.46:50156) 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.764+0000 7f74d89fc640 1 -- 172.21.15.46:0/2156062897 learned_addr learned my addr 172.21.15.46:0/2156062897 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74d99fe640 1 --2- 172.21.15.46:0/2156062897 >> v2:172.21.15.107:3300/0 conn(0x7f74d4070e80 0x7f74d415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74d91fd640 1 -- 172.21.15.46:0/2156062897 >> v2:172.21.15.107:3300/0 conn(0x7f74d4070e80 msgr2=0x7f74d415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74d91fd640 1 --2- 172.21.15.46:0/2156062897 >> v2:172.21.15.107:3300/0 conn(0x7f74d4070e80 0x7f74d415b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74d91fd640 1 -- 172.21.15.46:0/2156062897 >> v1:172.21.15.46:6789/0 conn(0x7f74d4070a70 legacy=0x7f74d415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74cbfff640 1 -- 172.21.15.46:0/2156062897 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538089129 0 0) 0x7f74d4071290 con 0x7f74d4070a70 2024-05-09T02:23:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74d91fd640 1 -- 172.21.15.46:0/2156062897 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d4158100 con 0x7f74d40c5f90 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.765+0000 7f74d91fd640 1 --2- 172.21.15.46:0/2156062897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d40c5f90 0x7f74d40c3a80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f74d4158aa0 tx=0x7f74d002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c36df47fc202a78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74cbfff640 1 -- 172.21.15.46:0/2156062897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0037070 con 0x7f74d40c5f90 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74cbfff640 1 -- 172.21.15.46:0/2156062897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d002add0 con 0x7f74d40c5f90 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74cbfff640 1 -- 172.21.15.46:0/2156062897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0032660 con 0x7f74d40c5f90 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 -- 172.21.15.46:0/2156062897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d40c5f90 msgr2=0x7f74d40c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 --2- 172.21.15.46:0/2156062897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d40c5f90 0x7f74d40c3a80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f74d4158aa0 tx=0x7f74d002a080 comp rx=0 tx=0).stop 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 -- 172.21.15.46:0/2156062897 shutdown_connections 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 --2- 172.21.15.46:0/2156062897 >> v2:172.21.15.107:3300/0 conn(0x7f74d4070e80 0x7f74d415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 --2- 172.21.15.46:0/2156062897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d40c5f90 0x7f74d40c3a80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 -- 172.21.15.46:0/2156062897 >> 172.21.15.46:0/2156062897 conn(0x7f74d40c9e50 msgr2=0x7f74d40ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 -- 172.21.15.46:0/2156062897 shutdown_connections 2024-05-09T02:23:16.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.766+0000 7f74db461640 1 -- 172.21.15.46:0/2156062897 wait complete. 2024-05-09T02:23:16.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.768+0000 7f74db461640 1 Processor -- start 2024-05-09T02:23:16.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.768+0000 7f74db461640 1 -- start start 2024-05-09T02:23:16.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.769+0000 7f74db461640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4070a70 0x7f74d4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.769+0000 7f74db461640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 0x7f74d41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.769+0000 7f74db461640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74d40c5f90 0x7f74d41e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.769+0000 7f74db461640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74d40c63a0 con 0x7f74d4070e80 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.769+0000 7f74db461640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74d415bd00 con 0x7f74d4070a70 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.769+0000 7f74db461640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74d40c6520 con 0x7f74d40c5f90 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 0x7f74d41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 0x7f74d41530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40740/0 (socket says 172.21.15.46:40740) 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 -- 172.21.15.46:0/1345101952 learned_addr learned my addr 172.21.15.46:0/1345101952 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d91fd640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4070a70 0x7f74d4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d99fe640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74d40c5f90 0x7f74d41e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 -- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74d40c5f90 msgr2=0x7f74d41e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74d40c5f90 0x7f74d41e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 -- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4070a70 msgr2=0x7f74d4154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4070a70 0x7f74d4154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 -- 172.21.15.46:0/1345101952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d40af170 con 0x7f74d4070e80 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74d89fc640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 0x7f74d41530c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c3c0 tx=0x7f74c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c40074e0 con 0x7f74d4070e80 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c40047e0 con 0x7f74d4070e80 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d4152020 con 0x7f74d4070e80 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.770+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4004c10 con 0x7f74d4070e80 2024-05-09T02:23:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.771+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d41525e0 con 0x7f74d4070e80 2024-05-09T02:23:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.771+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d406e8b0 con 0x7f74d4070e80 2024-05-09T02:23:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.772+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74c4011070 con 0x7f74d4070e80 2024-05-09T02:23:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.773+0000 7f74c9ffb640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74b8076300 0x7f74b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.773+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f74c40975a0 con 0x7f74d4070e80 2024-05-09T02:23:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.773+0000 7f74d91fd640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74b8076300 0x7f74b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:16.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.773+0000 7f74d91fd640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74b8076300 0x7f74b8078810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f74d0034000 tx=0x7f74d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:16.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.777+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f74c4060300 con 0x7f74d4070e80 2024-05-09T02:23:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.969+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f74d406a330 con 0x7f74b8076300 2024-05-09T02:23:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.969+0000 7f74c9ffb640 1 -- 172.21.15.46:0/1345101952 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f74d406a330 con 0x7f74b8076300 2024-05-09T02:23:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74b8076300 msgr2=0x7f74b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74b8076300 0x7f74b8078810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f74d0034000 tx=0x7f74d002e000 comp rx=0 tx=0).stop 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 msgr2=0x7f74d41530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 0x7f74d41530c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c3c0 tx=0x7f74c400c880 comp rx=0 tx=0).stop 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 shutdown_connections 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f74b8076300 0x7f74b8078810 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74d40c5f90 0x7f74d41e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d4070e80 0x7f74d41530c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 --2- 172.21.15.46:0/1345101952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4070a70 0x7f74d4154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 >> 172.21.15.46:0/1345101952 conn(0x7f74d40c9e50 msgr2=0x7f74d4159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 shutdown_connections 2024-05-09T02:23:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:16.972+0000 7f74db461640 1 -- 172.21.15.46:0/1345101952 wait complete. 2024-05-09T02:23:16.986 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T02:23:16.987 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:17.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.103+0000 7f5090a30640 1 Processor -- start 2024-05-09T02:23:17.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.104+0000 7f5090a30640 1 -- start start 2024-05-09T02:23:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f5090a30640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f508c0c94c0 0x7f508c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f5090a30640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f508c0cd350 0x7f508c0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f5090a30640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508c0c53e0 con 0x7f508c15af50 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f5090a30640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f508c1585e0 con 0x7f508c0cd350 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f5090a30640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f508c0c5650 con 0x7f508c0c94c0 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f508c0cd350 0x7f508c0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f508c0cd350 0x7f508c0c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40754/0 (socket says 172.21.15.46:40754) 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508ad9d640 1 -- 172.21.15.46:0/726623974 learned_addr learned my addr 172.21.15.46:0/726623974 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508a59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f508c15af50 0x7f508c154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50158/0 (socket says 172.21.15.46:50158) 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f5089d9b640 1 --2- 172.21.15.46:0/726623974 >> v2:172.21.15.107:3300/0 conn(0x7f508c0c94c0 0x7f508c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508ad9d640 1 -- 172.21.15.46:0/726623974 >> v2:172.21.15.107:3300/0 conn(0x7f508c0c94c0 msgr2=0x7f508c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508ad9d640 1 --2- 172.21.15.46:0/726623974 >> v2:172.21.15.107:3300/0 conn(0x7f508c0c94c0 0x7f508c0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.105+0000 7f508ad9d640 1 -- 172.21.15.46:0/726623974 >> v1:172.21.15.46:6789/0 conn(0x7f508c15af50 legacy=0x7f508c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.106+0000 7f508ad9d640 1 -- 172.21.15.46:0/726623974 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c157cb0 con 0x7f508c0cd350 2024-05-09T02:23:17.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.106+0000 7f5089d9b640 1 --2- 172.21.15.46:0/726623974 >> v2:172.21.15.107:3300/0 conn(0x7f508c0c94c0 0x7f508c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.106+0000 7f508ad9d640 1 --2- 172.21.15.46:0/726623974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c0cd350 0x7f508c0c5ae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f508c0cd930 tx=0x7f508402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2952cec8d1c10d24 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.106+0000 7f508959a640 1 -- 172.21.15.46:0/726623974 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084037070 con 0x7f508c0cd350 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.106+0000 7f508959a640 1 -- 172.21.15.46:0/726623974 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084032440 con 0x7f508c0cd350 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.106+0000 7f508959a640 1 -- 172.21.15.46:0/726623974 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084032810 con 0x7f508c0cd350 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 -- 172.21.15.46:0/726623974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c0cd350 msgr2=0x7f508c0c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 --2- 172.21.15.46:0/726623974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c0cd350 0x7f508c0c5ae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f508c0cd930 tx=0x7f508402a270 comp rx=0 tx=0).stop 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 -- 172.21.15.46:0/726623974 shutdown_connections 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 --2- 172.21.15.46:0/726623974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c0cd350 0x7f508c0c5ae0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 --2- 172.21.15.46:0/726623974 >> v2:172.21.15.107:3300/0 conn(0x7f508c0c94c0 0x7f508c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 -- 172.21.15.46:0/726623974 >> 172.21.15.46:0/726623974 conn(0x7f508c06e960 msgr2=0x7f508c06ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 -- 172.21.15.46:0/726623974 shutdown_connections 2024-05-09T02:23:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.107+0000 7f5090a30640 1 -- 172.21.15.46:0/726623974 wait complete. 2024-05-09T02:23:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.109+0000 7f5090a30640 1 Processor -- start 2024-05-09T02:23:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.109+0000 7f5090a30640 1 -- start start 2024-05-09T02:23:17.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f5090a30640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f508c0c94c0 0x7f508c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f5090a30640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c0cd350 0x7f508c1f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f5090a30640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c15af50 0x7f508c150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f5090a30640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f508c157960 con 0x7f508c15af50 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f5090a30640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f508c158270 con 0x7f508c0cd350 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f5090a30640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f508c0c6020 con 0x7f508c0c94c0 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f508ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c15af50 0x7f508c150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f508ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c15af50 0x7f508c150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40768/0 (socket says 172.21.15.46:40768) 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.110+0000 7f508ad9d640 1 -- 172.21.15.46:0/452858866 learned_addr learned my addr 172.21.15.46:0/452858866 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f5089d9b640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c0cd350 0x7f508c1f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508a59c640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f508c0c94c0 0x7f508c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508ad9d640 1 -- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f508c0c94c0 msgr2=0x7f508c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508ad9d640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f508c0c94c0 0x7f508c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508ad9d640 1 -- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c0cd350 msgr2=0x7f508c1f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508ad9d640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c0cd350 0x7f508c1f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508ad9d640 1 -- 172.21.15.46:0/452858866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c153b50 con 0x7f508c15af50 2024-05-09T02:23:17.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f508ad9d640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c15af50 0x7f508c150340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f508402a2b0 tx=0x7f50840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084037040 con 0x7f508c15af50 2024-05-09T02:23:17.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084042070 con 0x7f508c15af50 2024-05-09T02:23:17.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c1510a0 con 0x7f508c15af50 2024-05-09T02:23:17.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084030920 con 0x7f508c15af50 2024-05-09T02:23:17.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.111+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c0c3600 con 0x7f508c15af50 2024-05-09T02:23:17.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.112+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f508c0c3110 con 0x7f508c15af50 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.113+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5084030ac0 con 0x7f508c15af50 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f5082ffd640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f506c0762d0 0x7f506c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f50840b8d70 con 0x7f508c15af50 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f5082ffd640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7f506c0810f0 0x7f506c0835c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 --> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5084008f00 con 0x7f506c0810f0 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f50840b9200 con 0x7f508c15af50 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f508a59c640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f506c0762d0 0x7f506c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.114+0000 7f5089d9b640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7f506c0810f0 0x7f506c0835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.115+0000 7f5089d9b640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7f506c0810f0 0x7f506c0835c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.115+0000 7f508a59c640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f506c0762d0 0x7f506c0787e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f507c0012e0 tx=0x7f507c001640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.115+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== osd.6 v2:172.21.15.107:6808/425658714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5084008f00 con 0x7f506c0810f0 2024-05-09T02:23:17.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.129+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 --> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f508c06a3a0 con 0x7f506c0810f0 2024-05-09T02:23:17.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.129+0000 7f5082ffd640 1 -- 172.21.15.46:0/452858866 <== osd.6 v2:172.21.15.107:6808/425658714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f508c06a3a0 con 0x7f506c0810f0 2024-05-09T02:23:17.132 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:17.132 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:17.132 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.129+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7f506c0810f0 msgr2=0x7f506c0835c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.129+0000 7f5090a30640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6808/425658714,v1:172.21.15.107:6809/425658714] conn(0x7f506c0810f0 0x7f506c0835c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f506c0762d0 msgr2=0x7f506c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f506c0762d0 0x7f506c0787e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f507c0012e0 tx=0x7f507c001640 comp rx=0 tx=0).stop 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c15af50 msgr2=0x7f508c150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 --2- 172.21.15.46:0/452858866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f508c15af50 0x7f508c150340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f508402a2b0 tx=0x7f50840046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f508ad9d640 1 -- 172.21.15.46:0/452858866 reap_dead start 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 shutdown_connections 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 >> 172.21.15.46:0/452858866 conn(0x7f508c06e960 msgr2=0x7f508c06ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 shutdown_connections 2024-05-09T02:23:17.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.130+0000 7f5090a30640 1 -- 172.21.15.46:0/452858866 wait complete. 2024-05-09T02:23:17.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T02:23:17.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.257+0000 7fb3625dd640 1 Processor -- start 2024-05-09T02:23:17.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.257+0000 7fb3625dd640 1 -- start start 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb3625dd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb3625dd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb35c06e8b0 0x7fb35c0c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb3625dd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c06ecc0 con 0x7fb35c06e4a0 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb3625dd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb35c0c1e30 con 0x7fb35c06e8b0 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb3625dd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb35c158820 con 0x7fb35c0b1890 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb360b7a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb35c06e8b0 0x7fb35c0c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb35b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb35c06e4a0 0x7fb35c0c2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50164/0 (socket says 172.21.15.46:50164) 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb35b7fe640 1 -- 172.21.15.46:0/3305266783 learned_addr learned my addr 172.21.15.46:0/3305266783 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb35bfff640 1 --2- 172.21.15.46:0/3305266783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb360b7a640 1 -- 172.21.15.46:0/3305266783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 msgr2=0x7fb35c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb360b7a640 1 --2- 172.21.15.46:0/3305266783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb360b7a640 1 -- 172.21.15.46:0/3305266783 >> v1:172.21.15.46:6789/0 conn(0x7fb35c06e4a0 legacy=0x7fb35c0c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb35affd640 1 -- 172.21.15.46:0/3305266783 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309704118 0 0) 0x7fb35c06ecc0 con 0x7fb35c06e4a0 2024-05-09T02:23:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.259+0000 7fb360b7a640 1 -- 172.21.15.46:0/3305266783 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c0c2080 con 0x7fb35c06e8b0 2024-05-09T02:23:17.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.260+0000 7fb360b7a640 1 --2- 172.21.15.46:0/3305266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c0c3270 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb35402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8820fc813ac15777 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.260+0000 7fb35affd640 1 -- 172.21.15.46:0/3305266783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354007740 con 0x7fb35c06e8b0 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.260+0000 7fb35affd640 1 -- 172.21.15.46:0/3305266783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3540078e0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.260+0000 7fb35affd640 1 -- 172.21.15.46:0/3305266783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354007cb0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 -- 172.21.15.46:0/3305266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 msgr2=0x7fb35c0c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 --2- 172.21.15.46:0/3305266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c0c3270 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb35402a5f0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 -- 172.21.15.46:0/3305266783 shutdown_connections 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 --2- 172.21.15.46:0/3305266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c0c3270 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 --2- 172.21.15.46:0/3305266783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 -- 172.21.15.46:0/3305266783 >> 172.21.15.46:0/3305266783 conn(0x7fb35c068e90 msgr2=0x7fb35c0cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 -- 172.21.15.46:0/3305266783 shutdown_connections 2024-05-09T02:23:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.261+0000 7fb3625dd640 1 -- 172.21.15.46:0/3305266783 wait complete. 2024-05-09T02:23:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.262+0000 7fb3625dd640 1 Processor -- start 2024-05-09T02:23:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.263+0000 7fb3625dd640 1 -- start start 2024-05-09T02:23:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb3625dd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb35c06e4a0 0x7fb35c14f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb3625dd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c1ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb3625dd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb3625dd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c1555f0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb3625dd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c0c2640 con 0x7fb35c06e4a0 2024-05-09T02:23:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb3625dd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb35c0c37b0 con 0x7fb35c0b1890 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c1ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c1ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40780/0 (socket says 172.21.15.46:40780) 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 -- 172.21.15.46:0/376187906 learned_addr learned my addr 172.21.15.46:0/376187906 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb360b7a640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35bfff640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb35c06e4a0 0x7fb35c14f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 -- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 msgr2=0x7fb35c14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 -- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb35c06e4a0 msgr2=0x7fb35c14f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb35c06e4a0 0x7fb35c14f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 -- 172.21.15.46:0/376187906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c154a10 con 0x7fb35c06e8b0 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb360b7a640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35bfff640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb35c06e4a0 0x7fb35c14f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:23:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.264+0000 7fb35b7fe640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c1ed8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb35000c3c0 tx=0x7fb350001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.265+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500074e0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.265+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3500047e0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.265+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350004bd0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.265+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c0cc290 con 0x7fb35c06e8b0 2024-05-09T02:23:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.265+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35c0cb3d0 con 0x7fb35c06e8b0 2024-05-09T02:23:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.266+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35c0c2b60 con 0x7fb35c06e8b0 2024-05-09T02:23:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.267+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb350011070 con 0x7fb35c06e8b0 2024-05-09T02:23:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.267+0000 7fb358ff9640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3480762d0 0x7fb3480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.267+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fb350097780 con 0x7fb35c06e8b0 2024-05-09T02:23:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.267+0000 7fb35bfff640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3480762d0 0x7fb3480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.268+0000 7fb35bfff640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3480762d0 0x7fb3480787e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0c4c80 tx=0x7fb34c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.272+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb35c0c2b60 con 0x7fb35c06e8b0 2024-05-09T02:23:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.466+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb35c06a330 con 0x7fb3480762d0 2024-05-09T02:23:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.466+0000 7fb358ff9640 1 -- 172.21.15.46:0/376187906 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb35c06a330 con 0x7fb3480762d0 2024-05-09T02:23:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3480762d0 msgr2=0x7fb3480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3480762d0 0x7fb3480787e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0c4c80 tx=0x7fb34c008040 comp rx=0 tx=0).stop 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 msgr2=0x7fb35c1ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c1ed8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb35000c3c0 tx=0x7fb350001e70 comp rx=0 tx=0).stop 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 shutdown_connections 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb3480762d0 0x7fb3480787e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb35c0b1890 0x7fb35c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb35c06e8b0 0x7fb35c1ed8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 --2- 172.21.15.46:0/376187906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb35c06e4a0 0x7fb35c14f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.468+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 >> 172.21.15.46:0/376187906 conn(0x7fb35c068e90 msgr2=0x7fb35c0c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.469+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 shutdown_connections 2024-05-09T02:23:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.469+0000 7fb3625dd640 1 -- 172.21.15.46:0/376187906 wait complete. 2024-05-09T02:23:17.483 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T02:23:17.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T02:23:17.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.599+0000 7fdc04308640 1 Processor -- start 2024-05-09T02:23:17.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.599+0000 7fdc04308640 1 -- start start 2024-05-09T02:23:17.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc04308640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdbfc0c6e00 0x7fdbfc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc04308640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdbfc0c9d40 0x7fdbfc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc04308640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbfc158570 con 0x7fdbfc0c9930 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc04308640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fdbfc158850 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc04308640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdbfc0c20f0 con 0x7fdbfc0c9d40 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc020a4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdbfc0c6e00 0x7fdbfc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc018a3640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdbfc0c9930 0x7fdbfc0c78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50174/0 (socket says 172.21.15.46:50174) 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc020a4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdbfc0c6e00 0x7fdbfc0c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40790/0 (socket says 172.21.15.46:40790) 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc018a3640 1 -- 172.21.15.46:0/3842475228 learned_addr learned my addr 172.21.15.46:0/3842475228 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc028a5640 1 --2- 172.21.15.46:0/3842475228 >> v2:172.21.15.107:3300/0 conn(0x7fdbfc0c9d40 0x7fdbfc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc020a4640 1 -- 172.21.15.46:0/3842475228 >> v2:172.21.15.107:3300/0 conn(0x7fdbfc0c9d40 msgr2=0x7fdbfc0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc020a4640 1 --2- 172.21.15.46:0/3842475228 >> v2:172.21.15.107:3300/0 conn(0x7fdbfc0c9d40 0x7fdbfc0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc020a4640 1 -- 172.21.15.46:0/3842475228 >> v1:172.21.15.46:6789/0 conn(0x7fdbfc0c9930 legacy=0x7fdbfc0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc010a2640 1 -- 172.21.15.46:0/3842475228 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502637501 0 0) 0x7fdbfc158570 con 0x7fdbfc0c9930 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc020a4640 1 -- 172.21.15.46:0/3842475228 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbfc0c23d0 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.601+0000 7fdc028a5640 1 --2- 172.21.15.46:0/3842475228 >> v2:172.21.15.107:3300/0 conn(0x7fdbfc0c9d40 0x7fdbfc0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.602+0000 7fdc020a4640 1 --2- 172.21.15.46:0/3842475228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc0c93f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc06d5d0 tx=0x7fdbf802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cbd5c2a94fab32 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.602+0000 7fdc010a2640 1 -- 172.21.15.46:0/3842475228 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8037070 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.602+0000 7fdc010a2640 1 -- 172.21.15.46:0/3842475228 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf802add0 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.602+0000 7fdc010a2640 1 -- 172.21.15.46:0/3842475228 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8032660 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 -- 172.21.15.46:0/3842475228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 msgr2=0x7fdbfc0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 --2- 172.21.15.46:0/3842475228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc0c93f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc06d5d0 tx=0x7fdbf802a080 comp rx=0 tx=0).stop 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 -- 172.21.15.46:0/3842475228 shutdown_connections 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 --2- 172.21.15.46:0/3842475228 >> v2:172.21.15.107:3300/0 conn(0x7fdbfc0c9d40 0x7fdbfc0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 --2- 172.21.15.46:0/3842475228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc0c93f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 -- 172.21.15.46:0/3842475228 >> 172.21.15.46:0/3842475228 conn(0x7fdbfc06e9b0 msgr2=0x7fdbfc06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 -- 172.21.15.46:0/3842475228 shutdown_connections 2024-05-09T02:23:17.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.603+0000 7fdc04308640 1 -- 172.21.15.46:0/3842475228 wait complete. 2024-05-09T02:23:17.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.605+0000 7fdc04308640 1 Processor -- start 2024-05-09T02:23:17.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.605+0000 7fdc04308640 1 -- start start 2024-05-09T02:23:17.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc04308640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc04308640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdbfc0c9930 0x7fdbfc1f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc04308640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbfc0c9d40 0x7fdbfc1ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc04308640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc0c8510 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc04308640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc155450 con 0x7fdbfc0c9d40 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc04308640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdbfc0c8690 con 0x7fdbfc0c9930 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc020a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc020a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc14c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40792/0 (socket says 172.21.15.46:40792) 2024-05-09T02:23:17.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc020a4640 1 -- 172.21.15.46:0/885961122 learned_addr learned my addr 172.21.15.46:0/885961122 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc018a3640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdbfc0c9930 0x7fdbfc1f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.606+0000 7fdc028a5640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbfc0c9d40 0x7fdbfc1ecb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc020a4640 1 -- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdbfc0c9930 msgr2=0x7fdbfc1f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc020a4640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdbfc0c9930 0x7fdbfc1f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc020a4640 1 -- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbfc0c9d40 msgr2=0x7fdbfc1ecb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc020a4640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbfc0c9d40 0x7fdbfc1ecb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc020a4640 1 -- 172.21.15.46:0/885961122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbfc143b00 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc020a4640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc14c980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8035040 tx=0x7fdbf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8037050 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf8038040 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbfc0cbe20 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8004270 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.607+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbfc1ee260 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.608+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbfc1ee080 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.609+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdbf8003610 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.609+0000 7fdbf2ffd640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdbe00762d0 0x7fdbe00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.609+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fdbf80b7fa0 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdc018a3640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdbe00762d0 0x7fdbe00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdbf2ffd640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fdbe00810e0 0x7fdbe00835b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 --> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbf802add0 con 0x7fdbe00810e0 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdbf80bf050 con 0x7fdbfc0c6e00 2024-05-09T02:23:17.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdc028a5640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fdbe00810e0 0x7fdbe00835b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdc018a3640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdbe00762d0 0x7fdbe00787e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0cc920 tx=0x7fdbec007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.610+0000 7fdc028a5640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fdbe00810e0 0x7fdbe00835b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.611+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== osd.7 v2:172.21.15.107:6800/3874977895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbf802add0 con 0x7fdbe00810e0 2024-05-09T02:23:17.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.625+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 --> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdbfc06a3a0 con 0x7fdbe00810e0 2024-05-09T02:23:17.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.625+0000 7fdbf2ffd640 1 -- 172.21.15.46:0/885961122 <== osd.7 v2:172.21.15.107:6800/3874977895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdbfc06a3a0 con 0x7fdbe00810e0 2024-05-09T02:23:17.628 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T02:23:17.628 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T02:23:17.628 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T02:23:17.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fdbe00810e0 msgr2=0x7fdbe00835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6800/3874977895,v1:172.21.15.107:6801/3874977895] conn(0x7fdbe00810e0 0x7fdbe00835b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdbe00762d0 msgr2=0x7fdbe00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fdbe00762d0 0x7fdbe00787e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0cc920 tx=0x7fdbec007de0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 msgr2=0x7fdbfc14c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 --2- 172.21.15.46:0/885961122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbfc0c6e00 0x7fdbfc14c980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8035040 tx=0x7fdbf80046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc028a5640 1 -- 172.21.15.46:0/885961122 reap_dead start 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 shutdown_connections 2024-05-09T02:23:17.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 >> 172.21.15.46:0/885961122 conn(0x7fdbfc06e9b0 msgr2=0x7fdbfc152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 shutdown_connections 2024-05-09T02:23:17.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.626+0000 7fdc04308640 1 -- 172.21.15.46:0/885961122 wait complete. 2024-05-09T02:23:17.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T02:23:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.754+0000 7faeca584640 1 Processor -- start 2024-05-09T02:23:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.754+0000 7faeca584640 1 -- start start 2024-05-09T02:23:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faeca584640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faec40c3ef0 0x7faec40aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faeca584640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faec4158190 0x7faec41585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faeca584640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec4074a60 con 0x7faec4151e60 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faeca584640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7faec40c4810 con 0x7faec40c3ef0 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faeca584640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faec40c4af0 con 0x7faec4158190 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faec3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faec4151e60 0x7faec406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50176/0 (socket says 172.21.15.46:50176) 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faec3fff640 1 -- 172.21.15.46:0/1049713131 learned_addr learned my addr 172.21.15.46:0/1049713131 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faec37fe640 1 --2- 172.21.15.46:0/1049713131 >> v2:172.21.15.46:3300/0 conn(0x7faec40c3ef0 0x7faec40aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faec8b21640 1 --2- 172.21.15.46:0/1049713131 >> v2:172.21.15.107:3300/0 conn(0x7faec4158190 0x7faec41585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faec37fe640 1 -- 172.21.15.46:0/1049713131 >> v2:172.21.15.107:3300/0 conn(0x7faec4158190 msgr2=0x7faec41585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.755+0000 7faec37fe640 1 --2- 172.21.15.46:0/1049713131 >> v2:172.21.15.107:3300/0 conn(0x7faec4158190 0x7faec41585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.756+0000 7faec37fe640 1 -- 172.21.15.46:0/1049713131 >> v1:172.21.15.46:6789/0 conn(0x7faec4151e60 legacy=0x7faec406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.756+0000 7faec37fe640 1 -- 172.21.15.46:0/1049713131 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec4158ae0 con 0x7faec40c3ef0 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.756+0000 7faec37fe640 1 --2- 172.21.15.46:0/1049713131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec40c3ef0 0x7faec40aeee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faec40c6630 tx=0x7faeb802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3425180a0fba39 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.756+0000 7faec2ffd640 1 -- 172.21.15.46:0/1049713131 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8037070 con 0x7faec40c3ef0 2024-05-09T02:23:17.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.756+0000 7faec2ffd640 1 -- 172.21.15.46:0/1049713131 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb802add0 con 0x7faec40c3ef0 2024-05-09T02:23:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faec2ffd640 1 -- 172.21.15.46:0/1049713131 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8032660 con 0x7faec40c3ef0 2024-05-09T02:23:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 -- 172.21.15.46:0/1049713131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec40c3ef0 msgr2=0x7faec40aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 --2- 172.21.15.46:0/1049713131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec40c3ef0 0x7faec40aeee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faec40c6630 tx=0x7faeb802a080 comp rx=0 tx=0).stop 2024-05-09T02:23:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 -- 172.21.15.46:0/1049713131 shutdown_connections 2024-05-09T02:23:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 --2- 172.21.15.46:0/1049713131 >> v2:172.21.15.107:3300/0 conn(0x7faec4158190 0x7faec41585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 --2- 172.21.15.46:0/1049713131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec40c3ef0 0x7faec40aeee0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 -- 172.21.15.46:0/1049713131 >> 172.21.15.46:0/1049713131 conn(0x7faec40c9e50 msgr2=0x7faec40ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 -- 172.21.15.46:0/1049713131 shutdown_connections 2024-05-09T02:23:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.757+0000 7faeca584640 1 -- 172.21.15.46:0/1049713131 wait complete. 2024-05-09T02:23:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.759+0000 7faeca584640 1 Processor -- start 2024-05-09T02:23:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.759+0000 7faeca584640 1 -- start start 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faeca584640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faec40c3ef0 0x7faec41ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faeca584640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 0x7faec40c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faeca584640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faec4158190 0x7faec40c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faeca584640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faec406e060 con 0x7faec4151e60 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faeca584640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faec406dee0 con 0x7faec4158190 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faeca584640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faec41546c0 con 0x7faec40c3ef0 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.760+0000 7faec37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 0x7faec40c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 0x7faec40c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40808/0 (socket says 172.21.15.46:40808) 2024-05-09T02:23:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 -- 172.21.15.46:0/108236354 learned_addr learned my addr 172.21.15.46:0/108236354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec3fff640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faec40c3ef0 0x7faec41ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec8b21640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faec4158190 0x7faec40c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 -- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faec40c3ef0 msgr2=0x7faec41ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faec40c3ef0 0x7faec41ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 -- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faec4158190 msgr2=0x7faec40c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faec4158190 0x7faec40c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 -- 172.21.15.46:0/108236354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec41eff70 con 0x7faec4151e60 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec37fe640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 0x7faec40c85c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8037040 con 0x7faec4151e60 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb8042070 con 0x7faec4151e60 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb803b650 con 0x7faec4151e60 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.761+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec41efc90 con 0x7faec4151e60 2024-05-09T02:23:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.762+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec4153970 con 0x7faec4151e60 2024-05-09T02:23:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.762+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec40ca260 con 0x7faec4151e60 2024-05-09T02:23:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.763+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faeb803b7f0 con 0x7faec4151e60 2024-05-09T02:23:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.764+0000 7faec0ff9640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faeb0076300 0x7faeb0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.764+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7faeb80b8e60 con 0x7faec4151e60 2024-05-09T02:23:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.764+0000 7faec3fff640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faeb0076300 0x7faeb0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.765+0000 7faec3fff640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faeb0076300 0x7faeb0078810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faeb4000f60 tx=0x7faeb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:17.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.768+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faec40ca260 con 0x7faec4151e60 2024-05-09T02:23:17.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.959+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7faec406a330 con 0x7faeb0076300 2024-05-09T02:23:17.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.960+0000 7faec0ff9640 1 -- 172.21.15.46:0/108236354 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faec406a330 con 0x7faeb0076300 2024-05-09T02:23:17.963 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faeb0076300 msgr2=0x7faeb0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faeb0076300 0x7faeb0078810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faeb4000f60 tx=0x7faeb4009040 comp rx=0 tx=0).stop 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 msgr2=0x7faec40c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 0x7faec40c85c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb80046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 shutdown_connections 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7faeb0076300 0x7faeb0078810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faec4158190 0x7faec40c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faec4151e60 0x7faec40c85c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 --2- 172.21.15.46:0/108236354 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faec40c3ef0 0x7faec41ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 >> 172.21.15.46:0/108236354 conn(0x7faec40c9e50 msgr2=0x7faec414d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 shutdown_connections 2024-05-09T02:23:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:17.962+0000 7faeca584640 1 -- 172.21.15.46:0/108236354 wait complete. 2024-05-09T02:23:17.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:23:18.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.090+0000 7f3b11849640 1 Processor -- start 2024-05-09T02:23:18.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.090+0000 7f3b11849640 1 -- start start 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b11849640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3b0c0ca560 0x7f3b0c153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b11849640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0c155fe0 con 0x7f3b0c0c8ba0 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b11849640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0c1562c0 con 0x7f3b0c155890 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b11849640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c159070 con 0x7f3b0c0ca560 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b0affd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3b0c0c8ba0 0x7f3b0c0c7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:50192/0 (socket says 172.21.15.46:50192) 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b0affd640 1 -- 172.21.15.46:0/242413133 learned_addr learned my addr 172.21.15.46:0/242413133 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.091+0000 7f3b03fff640 1 --2- 172.21.15.46:0/242413133 >> v2:172.21.15.107:3300/0 conn(0x7f3b0c0ca560 0x7f3b0c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.092+0000 7f3b0a7fc640 1 -- 172.21.15.46:0/242413133 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077624851 0 0) 0x7f3b0c155fe0 con 0x7f3b0c0c8ba0 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.092+0000 7f3b0a7fc640 1 -- 172.21.15.46:0/242413133 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3af8003520 con 0x7f3b0c0c8ba0 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.092+0000 7f3b0a7fc640 1 -- 172.21.15.46:0/242413133 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2494607243 0 0) 0x7f3af8003520 con 0x7f3b0c0c8ba0 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.092+0000 7f3b03fff640 1 -- 172.21.15.46:0/242413133 >> v1:172.21.15.107:6789/0 conn(0x7f3b0c155890 legacy=0x7f3b0c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.092+0000 7f3b03fff640 1 -- 172.21.15.46:0/242413133 >> v1:172.21.15.46:6789/0 conn(0x7f3b0c0c8ba0 legacy=0x7f3b0c0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.092+0000 7f3b03fff640 1 -- 172.21.15.46:0/242413133 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c1565a0 con 0x7f3b0c0ca560 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.093+0000 7f3b03fff640 1 --2- 172.21.15.46:0/242413133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0ca560 0x7f3b0c153080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3af40097a0 tx=0x7f3af402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8270263197f8b026 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.093+0000 7f3b0a7fc640 1 -- 172.21.15.46:0/242413133 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4037070 con 0x7f3b0c0ca560 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.093+0000 7f3b0a7fc640 1 -- 172.21.15.46:0/242413133 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af402abc0 con 0x7f3b0c0ca560 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.093+0000 7f3b0a7fc640 1 -- 172.21.15.46:0/242413133 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0016f0 con 0x7f3b0c0ca560 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 -- 172.21.15.46:0/242413133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0ca560 msgr2=0x7f3b0c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 --2- 172.21.15.46:0/242413133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0ca560 0x7f3b0c153080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3af40097a0 tx=0x7f3af402a130 comp rx=0 tx=0).stop 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 -- 172.21.15.46:0/242413133 shutdown_connections 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 --2- 172.21.15.46:0/242413133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0ca560 0x7f3b0c153080 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 -- 172.21.15.46:0/242413133 >> 172.21.15.46:0/242413133 conn(0x7f3b0c0ac930 msgr2=0x7f3b0c0acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 -- 172.21.15.46:0/242413133 shutdown_connections 2024-05-09T02:23:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.094+0000 7f3b11849640 1 -- 172.21.15.46:0/242413133 wait complete. 2024-05-09T02:23:18.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.095+0000 7f3b11849640 1 Processor -- start 2024-05-09T02:23:18.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.095+0000 7f3b11849640 1 -- start start 2024-05-09T02:23:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0c8ba0 0x7f3b0c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b0c0ca560 0x7f3b0c1ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 0x7f3b0c0ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0c7d60 con 0x7f3b0c155890 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c155ca0 con 0x7f3b0c0c8ba0 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c0c7ee0 con 0x7f3b0c0ca560 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 0x7f3b0c0ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 0x7f3b0c0ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40810/0 (socket says 172.21.15.46:40810) 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 -- 172.21.15.46:0/3979644497 learned_addr learned my addr 172.21.15.46:0/3979644497 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0affd640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0c8ba0 0x7f3b0c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b03fff640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b0c0ca560 0x7f3b0c1ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 -- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b0c0ca560 msgr2=0x7f3b0c1ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b0c0ca560 0x7f3b0c1ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 -- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0c8ba0 msgr2=0x7f3b0c0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0c8ba0 0x7f3b0c0af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 -- 172.21.15.46:0/3979644497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c0af910 con 0x7f3b0c155890 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0affd640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0c8ba0 0x7f3b0c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b0b7fe640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 0x7f3b0c0ae1b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c700 tx=0x7f3b0400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04003b70 con 0x7f3b0c155890 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c1e0690 con 0x7f3b0c155890 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b04003d10 con 0x7f3b0c155890 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.097+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400aa70 con 0x7f3b0c155890 2024-05-09T02:23:18.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.098+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c1e0c50 con 0x7f3b0c155890 2024-05-09T02:23:18.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.099+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c06a330 con 0x7f3b0c155890 2024-05-09T02:23:18.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.099+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3b0400ac10 con 0x7f3b0c155890 2024-05-09T02:23:18.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.100+0000 7f3b08ff9640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aec076300 0x7f3aec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:18.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.100+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f3b04097a30 con 0x7f3b0c155890 2024-05-09T02:23:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.100+0000 7f3b0affd640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aec076300 0x7f3aec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.101+0000 7f3b0affd640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aec076300 0x7f3aec078810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0013c0 tx=0x7f3afc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:18.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.105+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3b04060df0 con 0x7f3b0c155890 2024-05-09T02:23:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.300+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b0c0ace70 con 0x7f3aec076300 2024-05-09T02:23:18.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.312+0000 7f3b08ff9640 1 -- 172.21.15.46:0/3979644497 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+489127 (secure 0 0 0) 0x7f3b0c0ace70 con 0x7f3aec076300 2024-05-09T02:23:18.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:18.324 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:23:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aec076300 msgr2=0x7f3aec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aec076300 0x7f3aec078810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0013c0 tx=0x7f3afc009040 comp rx=0 tx=0).stop 2024-05-09T02:23:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 msgr2=0x7f3b0c0ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 0x7f3b0c0ae1b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c700 tx=0x7f3b0400cbc0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 shutdown_connections 2024-05-09T02:23:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f3aec076300 0x7f3aec078810 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b0c155890 0x7f3b0c0ae1b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b0c0ca560 0x7f3b0c1ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 --2- 172.21.15.46:0/3979644497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b0c0c8ba0 0x7f3b0c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 >> 172.21.15.46:0/3979644497 conn(0x7f3b0c0ac930 msgr2=0x7f3b0c0ab220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 shutdown_connections 2024-05-09T02:23:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:18.316+0000 7f3b11849640 1 -- 172.21.15.46:0/3979644497 wait complete. 2024-05-09T02:23:18.331 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-05-09T02:23:16.590233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018636,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":546,"num_read_kb":945,"num_write":18928,"num_write_kb":50333845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18914,"ondisk_log_size":18914,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415408,"kb_used_data":4976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754559312,"statfs":{"total":773094113280,"available":772668735488,"internally_reserved":0,"allocated":5095424,"data_stored":3325928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":420204083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4525,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003956"},"pg_stats":[{"pgid":"5.18","version":"32'162","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969855+0000","last_change":"2024-05-09T02:18:23.203004+0000","last_active":"2024-05-09T02:22:53.969855+0000","last_peered":"2024-05-09T02:22:53.969855+0000","last_clean":"2024-05-09T02:22:53.969855+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:22:53.969855+0000","last_undegraded":"2024-05-09T02:22:53.969855+0000","last_fullsized":"2024-05-09T02:22:53.969855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"33'7","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.980057+0000","last_change":"2024-05-09T02:18:13.135050+0000","last_active":"2024-05-09T02:22:56.980057+0000","last_peered":"2024-05-09T02:22:56.980057+0000","last_clean":"2024-05-09T02:22:56.980057+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:22:56.980057+0000","last_undegraded":"2024-05-09T02:22:56.980057+0000","last_fullsized":"2024-05-09T02:22:56.980057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'147","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986281+0000","last_change":"2024-05-09T02:18:14.156118+0000","last_active":"2024-05-09T02:22:53.986281+0000","last_peered":"2024-05-09T02:22:53.986281+0000","last_clean":"2024-05-09T02:22:53.986281+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:22:53.986281+0000","last_undegraded":"2024-05-09T02:22:53.986281+0000","last_fullsized":"2024-05-09T02:22:53.986281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:11.577766+0000","last_change":"2024-05-09T02:18:22.196134+0000","last_active":"2024-05-09T02:23:11.577766+0000","last_peered":"2024-05-09T02:23:11.577766+0000","last_clean":"2024-05-09T02:23:11.577766+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:23:11.577766+0000","last_undegraded":"2024-05-09T02:23:11.577766+0000","last_fullsized":"2024-05-09T02:23:11.577766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"32'147","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.998682+0000","last_change":"2024-05-09T02:18:23.204526+0000","last_active":"2024-05-09T02:23:14.998682+0000","last_peered":"2024-05-09T02:23:14.998682+0000","last_clean":"2024-05-09T02:23:14.998682+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:23:14.998682+0000","last_undegraded":"2024-05-09T02:23:14.998682+0000","last_fullsized":"2024-05-09T02:23:14.998682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996219+0000","last_change":"2024-05-09T02:18:13.152859+0000","last_active":"2024-05-09T02:22:53.996219+0000","last_peered":"2024-05-09T02:22:53.996219+0000","last_clean":"2024-05-09T02:22:53.996219+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:22:53.996219+0000","last_undegraded":"2024-05-09T02:22:53.996219+0000","last_fullsized":"2024-05-09T02:22:53.996219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.706501+0000","last_change":"2024-05-09T02:23:14.706526+0000","last_active":"2024-05-09T02:23:14.706501+0000","last_peered":"2024-05-09T02:23:14.706501+0000","last_clean":"2024-05-09T02:23:14.706501+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:23:14.706501+0000","last_undegraded":"2024-05-09T02:23:14.706501+0000","last_fullsized":"2024-05-09T02:23:14.706501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:14.706404+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:14.706404+0000","last_clean_scrub_stamp":"2024-05-09T02:23:14.706404+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:15.880208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969945+0000","last_change":"2024-05-09T02:18:22.201783+0000","last_active":"2024-05-09T02:22:53.969945+0000","last_peered":"2024-05-09T02:22:53.969945+0000","last_clean":"2024-05-09T02:22:53.969945+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:22:53.969945+0000","last_undegraded":"2024-05-09T02:22:53.969945+0000","last_fullsized":"2024-05-09T02:22:53.969945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:21.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976679+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:22:53.976679+0000","last_peered":"2024-05-09T02:22:53.976679+0000","last_clean":"2024-05-09T02:22:53.976679+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:22:53.976679+0000","last_undegraded":"2024-05-09T02:22:53.976679+0000","last_fullsized":"2024-05-09T02:22:53.976679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.988297+0000","last_change":"2024-05-09T02:18:13.143089+0000","last_active":"2024-05-09T02:22:56.988297+0000","last_peered":"2024-05-09T02:22:56.988297+0000","last_clean":"2024-05-09T02:22:56.988297+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:22:56.988297+0000","last_undegraded":"2024-05-09T02:22:56.988297+0000","last_fullsized":"2024-05-09T02:22:56.988297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:27.939197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'132","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108425+0000","last_change":"2024-05-09T02:18:14.148717+0000","last_active":"2024-05-09T02:22:54.108425+0000","last_peered":"2024-05-09T02:22:54.108425+0000","last_clean":"2024-05-09T02:22:54.108425+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:22:54.108425+0000","last_undegraded":"2024-05-09T02:22:54.108425+0000","last_fullsized":"2024-05-09T02:22:54.108425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970514+0000","last_change":"2024-05-09T02:18:22.195109+0000","last_active":"2024-05-09T02:22:53.970514+0000","last_peered":"2024-05-09T02:22:53.970514+0000","last_clean":"2024-05-09T02:22:53.970514+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:22:53.970514+0000","last_undegraded":"2024-05-09T02:22:53.970514+0000","last_fullsized":"2024-05-09T02:22:53.970514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:50.518749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"32'129","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107050+0000","last_change":"2024-05-09T02:18:23.210201+0000","last_active":"2024-05-09T02:22:54.107050+0000","last_peered":"2024-05-09T02:22:54.107050+0000","last_clean":"2024-05-09T02:22:54.107050+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:22:54.107050+0000","last_undegraded":"2024-05-09T02:22:54.107050+0000","last_fullsized":"2024-05-09T02:22:54.107050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.984071+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:22:56.984071+0000","last_peered":"2024-05-09T02:22:56.984071+0000","last_clean":"2024-05-09T02:22:56.984071+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:22:56.984071+0000","last_undegraded":"2024-05-09T02:22:56.984071+0000","last_fullsized":"2024-05-09T02:22:56.984071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'168","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108041+0000","last_change":"2024-05-09T02:18:14.147424+0000","last_active":"2024-05-09T02:22:54.108041+0000","last_peered":"2024-05-09T02:22:54.108041+0000","last_clean":"2024-05-09T02:22:54.108041+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:22:54.108041+0000","last_undegraded":"2024-05-09T02:22:54.108041+0000","last_fullsized":"2024-05-09T02:22:54.108041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971555+0000","last_change":"2024-05-09T02:18:22.196954+0000","last_active":"2024-05-09T02:22:53.971555+0000","last_peered":"2024-05-09T02:22:53.971555+0000","last_clean":"2024-05-09T02:22:53.971555+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:22:53.971555+0000","last_undegraded":"2024-05-09T02:22:53.971555+0000","last_fullsized":"2024-05-09T02:22:53.971555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:49.153503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.571627+0000","last_change":"2024-05-09T02:18:23.215205+0000","last_active":"2024-05-09T02:22:56.571627+0000","last_peered":"2024-05-09T02:22:56.571627+0000","last_clean":"2024-05-09T02:22:56.571627+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:22:56.571627+0000","last_undegraded":"2024-05-09T02:22:56.571627+0000","last_fullsized":"2024-05-09T02:22:56.571627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981206+0000","last_change":"2024-05-09T02:18:14.157021+0000","last_active":"2024-05-09T02:22:53.981206+0000","last_peered":"2024-05-09T02:22:53.981206+0000","last_clean":"2024-05-09T02:22:53.981206+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:22:53.981206+0000","last_undegraded":"2024-05-09T02:22:53.981206+0000","last_fullsized":"2024-05-09T02:22:53.981206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:35.466282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'7","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996527+0000","last_change":"2024-05-09T02:18:13.139878+0000","last_active":"2024-05-09T02:22:53.996527+0000","last_peered":"2024-05-09T02:22:53.996527+0000","last_clean":"2024-05-09T02:22:53.996527+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:22:53.996527+0000","last_undegraded":"2024-05-09T02:22:53.996527+0000","last_fullsized":"2024-05-09T02:22:53.996527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:30.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970513+0000","last_change":"2024-05-09T02:18:22.192225+0000","last_active":"2024-05-09T02:22:53.970513+0000","last_peered":"2024-05-09T02:22:53.970513+0000","last_clean":"2024-05-09T02:22:53.970513+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:22:53.970513+0000","last_undegraded":"2024-05-09T02:22:53.970513+0000","last_fullsized":"2024-05-09T02:22:53.970513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:32.684419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'144","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.563560+0000","last_change":"2024-05-09T02:18:23.210854+0000","last_active":"2024-05-09T02:22:56.563560+0000","last_peered":"2024-05-09T02:22:56.563560+0000","last_clean":"2024-05-09T02:22:56.563560+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:22:56.563560+0000","last_undegraded":"2024-05-09T02:22:56.563560+0000","last_fullsized":"2024-05-09T02:22:56.563560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985947+0000","last_change":"2024-05-09T02:18:14.144871+0000","last_active":"2024-05-09T02:22:53.985947+0000","last_peered":"2024-05-09T02:22:53.985947+0000","last_clean":"2024-05-09T02:22:53.985947+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:22:53.985947+0000","last_undegraded":"2024-05-09T02:22:53.985947+0000","last_fullsized":"2024-05-09T02:22:53.985947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.973857+0000","last_change":"2024-05-09T02:18:13.151116+0000","last_active":"2024-05-09T02:22:53.973857+0000","last_peered":"2024-05-09T02:22:53.973857+0000","last_clean":"2024-05-09T02:22:53.973857+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:22:53.973857+0000","last_undegraded":"2024-05-09T02:22:53.973857+0000","last_fullsized":"2024-05-09T02:22:53.973857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971018+0000","last_change":"2024-05-09T02:18:22.198781+0000","last_active":"2024-05-09T02:22:53.971018+0000","last_peered":"2024-05-09T02:22:53.971018+0000","last_clean":"2024-05-09T02:22:53.971018+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:22:53.971018+0000","last_undegraded":"2024-05-09T02:22:53.971018+0000","last_fullsized":"2024-05-09T02:22:53.971018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.690880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970419+0000","last_change":"2024-05-09T02:18:23.205088+0000","last_active":"2024-05-09T02:22:53.970419+0000","last_peered":"2024-05-09T02:22:53.970419+0000","last_clean":"2024-05-09T02:22:53.970419+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:22:53.970419+0000","last_undegraded":"2024-05-09T02:22:53.970419+0000","last_fullsized":"2024-05-09T02:22:53.970419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:45.279387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985423+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:22:53.985423+0000","last_peered":"2024-05-09T02:22:53.985423+0000","last_clean":"2024-05-09T02:22:53.985423+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:22:53.985423+0000","last_undegraded":"2024-05-09T02:22:53.985423+0000","last_fullsized":"2024-05-09T02:22:53.985423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972240+0000","last_change":"2024-05-09T02:18:13.147091+0000","last_active":"2024-05-09T02:22:53.972240+0000","last_peered":"2024-05-09T02:22:53.972240+0000","last_clean":"2024-05-09T02:22:53.972240+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:22:53.972240+0000","last_undegraded":"2024-05-09T02:22:53.972240+0000","last_fullsized":"2024-05-09T02:22:53.972240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975212+0000","last_change":"2024-05-09T02:18:22.199931+0000","last_active":"2024-05-09T02:22:53.975212+0000","last_peered":"2024-05-09T02:22:53.975212+0000","last_clean":"2024-05-09T02:22:53.975212+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:22:53.975212+0000","last_undegraded":"2024-05-09T02:22:53.975212+0000","last_fullsized":"2024-05-09T02:22:53.975212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108475+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:22:54.108475+0000","last_peered":"2024-05-09T02:22:54.108475+0000","last_clean":"2024-05-09T02:22:54.108475+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:22:54.108475+0000","last_undegraded":"2024-05-09T02:22:54.108475+0000","last_fullsized":"2024-05-09T02:22:54.108475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971430+0000","last_change":"2024-05-09T02:18:14.154473+0000","last_active":"2024-05-09T02:22:53.971430+0000","last_peered":"2024-05-09T02:22:53.971430+0000","last_clean":"2024-05-09T02:22:53.971430+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:22:53.971430+0000","last_undegraded":"2024-05-09T02:22:53.971430+0000","last_fullsized":"2024-05-09T02:22:53.971430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:36.458839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977614+0000","last_change":"2024-05-09T02:18:13.133323+0000","last_active":"2024-05-09T02:22:53.977614+0000","last_peered":"2024-05-09T02:22:53.977614+0000","last_clean":"2024-05-09T02:22:53.977614+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:22:53.977614+0000","last_undegraded":"2024-05-09T02:22:53.977614+0000","last_fullsized":"2024-05-09T02:22:53.977614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:35.453466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970761+0000","last_change":"2024-05-09T02:18:22.200344+0000","last_active":"2024-05-09T02:22:53.970761+0000","last_peered":"2024-05-09T02:22:53.970761+0000","last_clean":"2024-05-09T02:22:53.970761+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:22:53.970761+0000","last_undegraded":"2024-05-09T02:22:53.970761+0000","last_fullsized":"2024-05-09T02:22:53.970761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"32'123","reported_seq":153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984247+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:22:53.984247+0000","last_peered":"2024-05-09T02:22:53.984247+0000","last_clean":"2024-05-09T02:22:53.984247+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:22:53.984247+0000","last_undegraded":"2024-05-09T02:22:53.984247+0000","last_fullsized":"2024-05-09T02:22:53.984247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'156","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971220+0000","last_change":"2024-05-09T02:18:14.147354+0000","last_active":"2024-05-09T02:22:53.971220+0000","last_peered":"2024-05-09T02:22:53.971220+0000","last_clean":"2024-05-09T02:22:53.971220+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:22:53.971220+0000","last_undegraded":"2024-05-09T02:22:53.971220+0000","last_fullsized":"2024-05-09T02:22:53.971220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.985077+0000","last_change":"2024-05-09T02:18:13.146947+0000","last_active":"2024-05-09T02:22:56.985077+0000","last_peered":"2024-05-09T02:22:56.985077+0000","last_clean":"2024-05-09T02:22:56.985077+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:22:56.985077+0000","last_undegraded":"2024-05-09T02:22:56.985077+0000","last_fullsized":"2024-05-09T02:22:56.985077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.936277+0000","last_change":"2024-05-09T02:18:22.191576+0000","last_active":"2024-05-09T02:23:01.936277+0000","last_peered":"2024-05-09T02:23:01.936277+0000","last_clean":"2024-05-09T02:23:01.936277+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:23:01.936277+0000","last_undegraded":"2024-05-09T02:23:01.936277+0000","last_fullsized":"2024-05-09T02:23:01.936277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:07.769628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969835+0000","last_change":"2024-05-09T02:18:23.219384+0000","last_active":"2024-05-09T02:22:53.969835+0000","last_peered":"2024-05-09T02:22:53.969835+0000","last_clean":"2024-05-09T02:22:53.969835+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:22:53.969835+0000","last_undegraded":"2024-05-09T02:22:53.969835+0000","last_fullsized":"2024-05-09T02:22:53.969835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985468+0000","last_change":"2024-05-09T02:18:14.151607+0000","last_active":"2024-05-09T02:22:53.985468+0000","last_peered":"2024-05-09T02:22:53.985468+0000","last_clean":"2024-05-09T02:22:53.985468+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:22:53.985468+0000","last_undegraded":"2024-05-09T02:22:53.985468+0000","last_fullsized":"2024-05-09T02:22:53.985468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'21","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.976879+0000","last_change":"2024-05-09T02:18:13.144661+0000","last_active":"2024-05-09T02:22:58.976879+0000","last_peered":"2024-05-09T02:22:58.976879+0000","last_clean":"2024-05-09T02:22:58.976879+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:22:58.976879+0000","last_undegraded":"2024-05-09T02:22:58.976879+0000","last_fullsized":"2024-05-09T02:22:58.976879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984278+0000","last_change":"2024-05-09T02:18:22.201158+0000","last_active":"2024-05-09T02:22:53.984278+0000","last_peered":"2024-05-09T02:22:53.984278+0000","last_clean":"2024-05-09T02:22:53.984278+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:22:53.984278+0000","last_undegraded":"2024-05-09T02:22:53.984278+0000","last_fullsized":"2024-05-09T02:22:53.984278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'150","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980650+0000","last_change":"2024-05-09T02:18:23.202609+0000","last_active":"2024-05-09T02:22:53.980650+0000","last_peered":"2024-05-09T02:22:53.980650+0000","last_clean":"2024-05-09T02:22:53.980650+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:22:53.980650+0000","last_undegraded":"2024-05-09T02:22:53.980650+0000","last_fullsized":"2024-05-09T02:22:53.980650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:50.020283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"31'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971700+0000","last_change":"2024-05-09T02:18:14.150386+0000","last_active":"2024-05-09T02:22:53.971700+0000","last_peered":"2024-05-09T02:22:53.971700+0000","last_clean":"2024-05-09T02:22:53.971700+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:22:53.971700+0000","last_undegraded":"2024-05-09T02:22:53.971700+0000","last_fullsized":"2024-05-09T02:22:53.971700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979037+0000","last_change":"2024-05-09T02:18:13.136119+0000","last_active":"2024-05-09T02:22:53.979037+0000","last_peered":"2024-05-09T02:22:53.979037+0000","last_clean":"2024-05-09T02:22:53.979037+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:22:53.979037+0000","last_undegraded":"2024-05-09T02:22:53.979037+0000","last_fullsized":"2024-05-09T02:22:53.979037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:01.488281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970307+0000","last_change":"2024-05-09T02:18:22.189952+0000","last_active":"2024-05-09T02:22:53.970307+0000","last_peered":"2024-05-09T02:22:53.970307+0000","last_clean":"2024-05-09T02:22:53.970307+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:22:53.970307+0000","last_undegraded":"2024-05-09T02:22:53.970307+0000","last_fullsized":"2024-05-09T02:22:53.970307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'138","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970991+0000","last_change":"2024-05-09T02:18:23.198855+0000","last_active":"2024-05-09T02:22:53.970991+0000","last_peered":"2024-05-09T02:22:53.970991+0000","last_clean":"2024-05-09T02:22:53.970991+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:22:53.970991+0000","last_undegraded":"2024-05-09T02:22:53.970991+0000","last_fullsized":"2024-05-09T02:22:53.970991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108245+0000","last_change":"2024-05-09T02:18:14.161345+0000","last_active":"2024-05-09T02:22:54.108245+0000","last_peered":"2024-05-09T02:22:54.108245+0000","last_clean":"2024-05-09T02:22:54.108245+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:22:54.108245+0000","last_undegraded":"2024-05-09T02:22:54.108245+0000","last_fullsized":"2024-05-09T02:22:54.108245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.973773+0000","last_change":"2024-05-09T02:18:13.147196+0000","last_active":"2024-05-09T02:22:53.973773+0000","last_peered":"2024-05-09T02:22:53.973773+0000","last_clean":"2024-05-09T02:22:53.973773+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:22:53.973773+0000","last_undegraded":"2024-05-09T02:22:53.973773+0000","last_fullsized":"2024-05-09T02:22:53.973773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971176+0000","last_change":"2024-05-09T02:18:22.197479+0000","last_active":"2024-05-09T02:22:53.971176+0000","last_peered":"2024-05-09T02:22:53.971176+0000","last_clean":"2024-05-09T02:22:53.971176+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:22:53.971176+0000","last_undegraded":"2024-05-09T02:22:53.971176+0000","last_fullsized":"2024-05-09T02:22:53.971176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'138","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969512+0000","last_change":"2024-05-09T02:18:23.224309+0000","last_active":"2024-05-09T02:22:53.969512+0000","last_peered":"2024-05-09T02:22:53.969512+0000","last_clean":"2024-05-09T02:22:53.969512+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:22:53.969512+0000","last_undegraded":"2024-05-09T02:22:53.969512+0000","last_fullsized":"2024-05-09T02:22:53.969512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970783+0000","last_change":"2024-05-09T02:18:14.136310+0000","last_active":"2024-05-09T02:22:53.970783+0000","last_peered":"2024-05-09T02:22:53.970783+0000","last_clean":"2024-05-09T02:22:53.970783+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:22:53.970783+0000","last_undegraded":"2024-05-09T02:22:53.970783+0000","last_fullsized":"2024-05-09T02:22:53.970783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:15.570908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108236+0000","last_change":"2024-05-09T02:18:13.148086+0000","last_active":"2024-05-09T02:22:54.108236+0000","last_peered":"2024-05-09T02:22:54.108236+0000","last_clean":"2024-05-09T02:22:54.108236+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:22:54.108236+0000","last_undegraded":"2024-05-09T02:22:54.108236+0000","last_fullsized":"2024-05-09T02:22:54.108236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.568267+0000","last_change":"2024-05-09T02:23:16.568296+0000","last_active":"2024-05-09T02:23:16.568267+0000","last_peered":"2024-05-09T02:23:16.568267+0000","last_clean":"2024-05-09T02:23:16.568267+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:23:16.568267+0000","last_undegraded":"2024-05-09T02:23:16.568267+0000","last_fullsized":"2024-05-09T02:23:16.568267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:16.568139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:16.568139+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.568139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:43.627206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"32'156","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979449+0000","last_change":"2024-05-09T02:18:23.206308+0000","last_active":"2024-05-09T02:22:53.979449+0000","last_peered":"2024-05-09T02:22:53.979449+0000","last_clean":"2024-05-09T02:22:53.979449+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:22:53.979449+0000","last_undegraded":"2024-05-09T02:22:53.979449+0000","last_fullsized":"2024-05-09T02:22:53.979449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.972628+0000","last_change":"2024-05-09T02:18:14.150858+0000","last_active":"2024-05-09T02:22:53.972628+0000","last_peered":"2024-05-09T02:22:53.972628+0000","last_clean":"2024-05-09T02:22:53.972628+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:22:53.972628+0000","last_undegraded":"2024-05-09T02:22:53.972628+0000","last_fullsized":"2024-05-09T02:22:53.972628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'7","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.979713+0000","last_change":"2024-05-09T02:18:13.149928+0000","last_active":"2024-05-09T02:22:58.979713+0000","last_peered":"2024-05-09T02:22:58.979713+0000","last_clean":"2024-05-09T02:22:58.979713+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:22:58.979713+0000","last_undegraded":"2024-05-09T02:22:58.979713+0000","last_fullsized":"2024-05-09T02:22:58.979713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.575848+0000","last_change":"2024-05-09T02:23:15.575875+0000","last_active":"2024-05-09T02:23:15.575848+0000","last_peered":"2024-05-09T02:23:15.575848+0000","last_clean":"2024-05-09T02:23:15.575848+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:23:15.575848+0000","last_undegraded":"2024-05-09T02:23:15.575848+0000","last_fullsized":"2024-05-09T02:23:15.575848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:15.575763+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:15.575763+0000","last_clean_scrub_stamp":"2024-05-09T02:23:15.575763+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:36.158577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108653+0000","last_change":"2024-05-09T02:18:23.205256+0000","last_active":"2024-05-09T02:22:54.108653+0000","last_peered":"2024-05-09T02:22:54.108653+0000","last_clean":"2024-05-09T02:22:54.108653+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:22:54.108653+0000","last_undegraded":"2024-05-09T02:22:54.108653+0000","last_fullsized":"2024-05-09T02:22:54.108653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"31'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969120+0000","last_change":"2024-05-09T02:18:14.136949+0000","last_active":"2024-05-09T02:22:53.969120+0000","last_peered":"2024-05-09T02:22:53.969120+0000","last_clean":"2024-05-09T02:22:53.969120+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:22:53.969120+0000","last_undegraded":"2024-05-09T02:22:53.969120+0000","last_fullsized":"2024-05-09T02:22:53.969120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977964+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:22:53.977964+0000","last_peered":"2024-05-09T02:22:53.977964+0000","last_clean":"2024-05-09T02:22:53.977964+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:22:53.977964+0000","last_undegraded":"2024-05-09T02:22:53.977964+0000","last_fullsized":"2024-05-09T02:22:53.977964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:17.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'22","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.928562+0000","last_change":"2024-05-09T02:18:22.196343+0000","last_active":"2024-05-09T02:23:01.928562+0000","last_peered":"2024-05-09T02:23:01.928562+0000","last_clean":"2024-05-09T02:23:01.928562+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:23:01.928562+0000","last_undegraded":"2024-05-09T02:23:01.928562+0000","last_fullsized":"2024-05-09T02:23:01.928562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'135","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977106+0000","last_change":"2024-05-09T02:18:23.221514+0000","last_active":"2024-05-09T02:22:53.977106+0000","last_peered":"2024-05-09T02:22:53.977106+0000","last_clean":"2024-05-09T02:22:53.977106+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:22:53.977106+0000","last_undegraded":"2024-05-09T02:22:53.977106+0000","last_fullsized":"2024-05-09T02:22:53.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'150","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985884+0000","last_change":"2024-05-09T02:18:14.158966+0000","last_active":"2024-05-09T02:22:53.985884+0000","last_peered":"2024-05-09T02:22:53.985884+0000","last_clean":"2024-05-09T02:22:53.985884+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:22:53.985884+0000","last_undegraded":"2024-05-09T02:22:53.985884+0000","last_fullsized":"2024-05-09T02:22:53.985884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107278+0000","last_change":"2024-05-09T02:18:13.141855+0000","last_active":"2024-05-09T02:22:54.107278+0000","last_peered":"2024-05-09T02:22:54.107278+0000","last_clean":"2024-05-09T02:22:54.107278+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:22:54.107278+0000","last_undegraded":"2024-05-09T02:22:54.107278+0000","last_fullsized":"2024-05-09T02:22:54.107278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978232+0000","last_change":"2024-05-09T02:18:04.032074+0000","last_active":"2024-05-09T02:22:53.978232+0000","last_peered":"2024-05-09T02:22:53.978232+0000","last_clean":"2024-05-09T02:22:53.978232+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:22:53.978232+0000","last_undegraded":"2024-05-09T02:22:53.978232+0000","last_fullsized":"2024-05-09T02:22:53.978232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:03.018072+0000","last_clean_scrub_stamp":"2024-05-09T02:18:03.018072+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:50.177974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980476+0000","last_change":"2024-05-09T02:18:22.198215+0000","last_active":"2024-05-09T02:22:53.980476+0000","last_peered":"2024-05-09T02:22:53.980476+0000","last_clean":"2024-05-09T02:22:53.980476+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:22:53.980476+0000","last_undegraded":"2024-05-09T02:22:53.980476+0000","last_fullsized":"2024-05-09T02:22:53.980476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:37.678672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"32'135","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.563528+0000","last_change":"2024-05-09T02:18:23.202230+0000","last_active":"2024-05-09T02:22:56.563528+0000","last_peered":"2024-05-09T02:22:56.563528+0000","last_clean":"2024-05-09T02:22:56.563528+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:22:56.563528+0000","last_undegraded":"2024-05-09T02:22:56.563528+0000","last_fullsized":"2024-05-09T02:22:56.563528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978295+0000","last_change":"2024-05-09T02:18:14.155226+0000","last_active":"2024-05-09T02:22:53.978295+0000","last_peered":"2024-05-09T02:22:53.978295+0000","last_clean":"2024-05-09T02:22:53.978295+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:22:53.978295+0000","last_undegraded":"2024-05-09T02:22:53.978295+0000","last_fullsized":"2024-05-09T02:22:53.978295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979233+0000","last_change":"2024-05-09T02:18:13.144565+0000","last_active":"2024-05-09T02:22:53.979233+0000","last_peered":"2024-05-09T02:22:53.979233+0000","last_clean":"2024-05-09T02:22:53.979233+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:22:53.979233+0000","last_undegraded":"2024-05-09T02:22:53.979233+0000","last_fullsized":"2024-05-09T02:22:53.979233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980574+0000","last_change":"2024-05-09T02:18:22.201980+0000","last_active":"2024-05-09T02:22:53.980574+0000","last_peered":"2024-05-09T02:22:53.980574+0000","last_clean":"2024-05-09T02:22:53.980574+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:22:53.980574+0000","last_undegraded":"2024-05-09T02:22:53.980574+0000","last_fullsized":"2024-05-09T02:22:53.980574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:07.250145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"32'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.224847+0000","last_change":"2024-05-09T02:23:16.224895+0000","last_active":"2024-05-09T02:23:16.224847+0000","last_peered":"2024-05-09T02:23:16.224847+0000","last_clean":"2024-05-09T02:23:16.224847+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:23:16.224847+0000","last_undegraded":"2024-05-09T02:23:16.224847+0000","last_fullsized":"2024-05-09T02:23:16.224847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:16.224705+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:16.224705+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.224705+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:35.610074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'138","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978158+0000","last_change":"2024-05-09T02:18:55.756927+0000","last_active":"2024-05-09T02:22:53.978158+0000","last_peered":"2024-05-09T02:22:53.978158+0000","last_clean":"2024-05-09T02:22:53.978158+0000","last_became_active":"2024-05-09T02:18:55.756398+0000","last_became_peered":"2024-05-09T02:18:55.756398+0000","last_unstale":"2024-05-09T02:22:53.978158+0000","last_undegraded":"2024-05-09T02:22:53.978158+0000","last_fullsized":"2024-05-09T02:22:53.978158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975561+0000","last_change":"2024-05-09T02:18:13.150006+0000","last_active":"2024-05-09T02:22:53.975561+0000","last_peered":"2024-05-09T02:22:53.975561+0000","last_clean":"2024-05-09T02:22:53.975561+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:22:53.975561+0000","last_undegraded":"2024-05-09T02:22:53.975561+0000","last_fullsized":"2024-05-09T02:22:53.975561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'7","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970103+0000","last_change":"2024-05-09T02:18:22.195500+0000","last_active":"2024-05-09T02:22:53.970103+0000","last_peered":"2024-05-09T02:22:53.970103+0000","last_clean":"2024-05-09T02:22:53.970103+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:22:53.970103+0000","last_undegraded":"2024-05-09T02:22:53.970103+0000","last_fullsized":"2024-05-09T02:22:53.970103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976514+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:22:53.976514+0000","last_peered":"2024-05-09T02:22:53.976514+0000","last_clean":"2024-05-09T02:22:53.976514+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:22:53.976514+0000","last_undegraded":"2024-05-09T02:22:53.976514+0000","last_fullsized":"2024-05-09T02:22:53.976514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978683+0000","last_change":"2024-05-09T02:18:14.157683+0000","last_active":"2024-05-09T02:22:53.978683+0000","last_peered":"2024-05-09T02:22:53.978683+0000","last_clean":"2024-05-09T02:22:53.978683+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:22:53.978683+0000","last_undegraded":"2024-05-09T02:22:53.978683+0000","last_fullsized":"2024-05-09T02:22:53.978683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:11.791931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.990221+0000","last_change":"2024-05-09T02:18:13.150835+0000","last_active":"2024-05-09T02:22:56.990221+0000","last_peered":"2024-05-09T02:22:56.990221+0000","last_clean":"2024-05-09T02:22:56.990221+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:22:56.990221+0000","last_undegraded":"2024-05-09T02:22:56.990221+0000","last_fullsized":"2024-05-09T02:22:56.990221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106855+0000","last_change":"2024-05-09T02:18:22.199919+0000","last_active":"2024-05-09T02:22:54.106855+0000","last_peered":"2024-05-09T02:22:54.106855+0000","last_clean":"2024-05-09T02:22:54.106855+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:22:54.106855+0000","last_undegraded":"2024-05-09T02:22:54.106855+0000","last_fullsized":"2024-05-09T02:22:54.106855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:46.376466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"32'144","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978029+0000","last_change":"2024-05-09T02:18:23.204541+0000","last_active":"2024-05-09T02:22:53.978029+0000","last_peered":"2024-05-09T02:22:53.978029+0000","last_clean":"2024-05-09T02:22:53.978029+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:22:53.978029+0000","last_undegraded":"2024-05-09T02:22:53.978029+0000","last_fullsized":"2024-05-09T02:22:53.978029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978422+0000","last_change":"2024-05-09T02:18:14.154445+0000","last_active":"2024-05-09T02:22:53.978422+0000","last_peered":"2024-05-09T02:22:53.978422+0000","last_clean":"2024-05-09T02:22:53.978422+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:22:53.978422+0000","last_undegraded":"2024-05-09T02:22:53.978422+0000","last_fullsized":"2024-05-09T02:22:53.978422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:52.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971819+0000","last_change":"2024-05-09T02:18:13.146034+0000","last_active":"2024-05-09T02:22:53.971819+0000","last_peered":"2024-05-09T02:22:53.971819+0000","last_clean":"2024-05-09T02:22:53.971819+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:22:53.971819+0000","last_undegraded":"2024-05-09T02:22:53.971819+0000","last_fullsized":"2024-05-09T02:22:53.971819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:52.259372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969924+0000","last_change":"2024-05-09T02:18:22.200238+0000","last_active":"2024-05-09T02:22:53.969924+0000","last_peered":"2024-05-09T02:22:53.969924+0000","last_clean":"2024-05-09T02:22:53.969924+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:22:53.969924+0000","last_undegraded":"2024-05-09T02:22:53.969924+0000","last_fullsized":"2024-05-09T02:22:53.969924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:25.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.982951+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:23:15.982951+0000","last_peered":"2024-05-09T02:23:15.982951+0000","last_clean":"2024-05-09T02:23:15.982951+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:23:15.982951+0000","last_undegraded":"2024-05-09T02:23:15.982951+0000","last_fullsized":"2024-05-09T02:23:15.982951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978087+0000","last_change":"2024-05-09T02:18:14.153532+0000","last_active":"2024-05-09T02:22:53.978087+0000","last_peered":"2024-05-09T02:22:53.978087+0000","last_clean":"2024-05-09T02:22:53.978087+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:22:53.978087+0000","last_undegraded":"2024-05-09T02:22:53.978087+0000","last_fullsized":"2024-05-09T02:22:53.978087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:24.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'9","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.981287+0000","last_change":"2024-05-09T02:18:13.148436+0000","last_active":"2024-05-09T02:22:58.981287+0000","last_peered":"2024-05-09T02:22:58.981287+0000","last_clean":"2024-05-09T02:22:58.981287+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:22:58.981287+0000","last_undegraded":"2024-05-09T02:22:58.981287+0000","last_fullsized":"2024-05-09T02:22:58.981287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:11.578469+0000","last_change":"2024-05-09T02:18:22.194296+0000","last_active":"2024-05-09T02:23:11.578469+0000","last_peered":"2024-05-09T02:23:11.578469+0000","last_clean":"2024-05-09T02:23:11.578469+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:23:11.578469+0000","last_undegraded":"2024-05-09T02:23:11.578469+0000","last_fullsized":"2024-05-09T02:23:11.578469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"32'219","reported_seq":247,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107776+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:22:54.107776+0000","last_peered":"2024-05-09T02:22:54.107776+0000","last_clean":"2024-05-09T02:22:54.107776+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:22:54.107776+0000","last_undegraded":"2024-05-09T02:22:54.107776+0000","last_fullsized":"2024-05-09T02:22:54.107776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:14.154101+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:03.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980895+0000","last_change":"2024-05-09T02:18:13.144410+0000","last_active":"2024-05-09T02:22:53.980895+0000","last_peered":"2024-05-09T02:22:53.980895+0000","last_clean":"2024-05-09T02:22:53.980895+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:22:53.980895+0000","last_undegraded":"2024-05-09T02:22:53.980895+0000","last_fullsized":"2024-05-09T02:22:53.980895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:41.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:11.577826+0000","last_change":"2024-05-09T02:18:22.200930+0000","last_active":"2024-05-09T02:23:11.577826+0000","last_peered":"2024-05-09T02:23:11.577826+0000","last_clean":"2024-05-09T02:23:11.577826+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:23:11.577826+0000","last_undegraded":"2024-05-09T02:23:11.577826+0000","last_fullsized":"2024-05-09T02:23:11.577826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"32'144","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107190+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:22:54.107190+0000","last_peered":"2024-05-09T02:22:54.107190+0000","last_clean":"2024-05-09T02:22:54.107190+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:22:54.107190+0000","last_undegraded":"2024-05-09T02:22:54.107190+0000","last_fullsized":"2024-05-09T02:22:54.107190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:26.655436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977431+0000","last_change":"2024-05-09T02:18:14.157719+0000","last_active":"2024-05-09T02:22:53.977431+0000","last_peered":"2024-05-09T02:22:53.977431+0000","last_clean":"2024-05-09T02:22:53.977431+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:22:53.977431+0000","last_undegraded":"2024-05-09T02:22:53.977431+0000","last_fullsized":"2024-05-09T02:22:53.977431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:14.318169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108124+0000","last_change":"2024-05-09T02:18:13.150303+0000","last_active":"2024-05-09T02:22:54.108124+0000","last_peered":"2024-05-09T02:22:54.108124+0000","last_clean":"2024-05-09T02:22:54.108124+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:22:54.108124+0000","last_undegraded":"2024-05-09T02:22:54.108124+0000","last_fullsized":"2024-05-09T02:22:54.108124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:14.565535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'111","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:04.992536+0000","last_change":"2024-05-09T02:18:22.198833+0000","last_active":"2024-05-09T02:23:04.992536+0000","last_peered":"2024-05-09T02:23:04.992536+0000","last_clean":"2024-05-09T02:23:04.992536+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:23:04.992536+0000","last_undegraded":"2024-05-09T02:23:04.992536+0000","last_fullsized":"2024-05-09T02:23:04.992536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":214,"num_write":106,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577290+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:23:06.577290+0000","last_peered":"2024-05-09T02:23:06.577290+0000","last_clean":"2024-05-09T02:23:06.577290+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:23:06.577290+0000","last_undegraded":"2024-05-09T02:23:06.577290+0000","last_fullsized":"2024-05-09T02:23:06.577290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'148","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.748772+0000","last_change":"2024-05-09T02:23:15.748796+0000","last_active":"2024-05-09T02:23:15.748772+0000","last_peered":"2024-05-09T02:23:15.748772+0000","last_clean":"2024-05-09T02:23:15.748772+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:23:15.748772+0000","last_undegraded":"2024-05-09T02:23:15.748772+0000","last_fullsized":"2024-05-09T02:23:15.748772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2024-05-09T02:23:15.748682+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2024-05-09T02:23:15.748682+0000","last_clean_scrub_stamp":"2024-05-09T02:23:15.748682+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:05.028873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.979317+0000","last_change":"2024-05-09T02:18:13.141661+0000","last_active":"2024-05-09T02:22:56.979317+0000","last_peered":"2024-05-09T02:22:56.979317+0000","last_clean":"2024-05-09T02:22:56.979317+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:22:56.979317+0000","last_undegraded":"2024-05-09T02:22:56.979317+0000","last_fullsized":"2024-05-09T02:22:56.979317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.939508+0000","last_change":"2024-05-09T02:18:22.200236+0000","last_active":"2024-05-09T02:23:01.939508+0000","last_peered":"2024-05-09T02:23:01.939508+0000","last_clean":"2024-05-09T02:23:01.939508+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:23:01.939508+0000","last_undegraded":"2024-05-09T02:23:01.939508+0000","last_fullsized":"2024-05-09T02:23:01.939508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:49.014261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"32'156","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577262+0000","last_change":"2024-05-09T02:18:23.213445+0000","last_active":"2024-05-09T02:23:06.577262+0000","last_peered":"2024-05-09T02:23:06.577262+0000","last_clean":"2024-05-09T02:23:06.577262+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:23:06.577262+0000","last_undegraded":"2024-05-09T02:23:06.577262+0000","last_fullsized":"2024-05-09T02:23:06.577262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977657+0000","last_change":"2024-05-09T02:18:14.155490+0000","last_active":"2024-05-09T02:22:53.977657+0000","last_peered":"2024-05-09T02:22:53.977657+0000","last_clean":"2024-05-09T02:22:53.977657+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:22:53.977657+0000","last_undegraded":"2024-05-09T02:22:53.977657+0000","last_fullsized":"2024-05-09T02:22:53.977657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:23.642386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'111","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:03.257459+0000","last_change":"2024-05-09T02:18:13.149734+0000","last_active":"2024-05-09T02:23:03.257459+0000","last_peered":"2024-05-09T02:23:03.257459+0000","last_clean":"2024-05-09T02:23:03.257459+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:23:03.257459+0000","last_undegraded":"2024-05-09T02:23:03.257459+0000","last_fullsized":"2024-05-09T02:23:03.257459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:43.447324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":234,"num_write":106,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.572212+0000","last_change":"2024-05-09T02:18:22.200324+0000","last_active":"2024-05-09T02:23:01.572212+0000","last_peered":"2024-05-09T02:23:01.572212+0000","last_clean":"2024-05-09T02:23:01.572212+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:23:01.572212+0000","last_undegraded":"2024-05-09T02:23:01.572212+0000","last_fullsized":"2024-05-09T02:23:01.572212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"32'148","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.572828+0000","last_change":"2024-05-09T02:18:23.214363+0000","last_active":"2024-05-09T02:23:06.572828+0000","last_peered":"2024-05-09T02:23:06.572828+0000","last_clean":"2024-05-09T02:23:06.572828+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:23:06.572828+0000","last_undegraded":"2024-05-09T02:23:06.572828+0000","last_fullsized":"2024-05-09T02:23:06.572828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971892+0000","last_change":"2024-05-09T02:18:14.152712+0000","last_active":"2024-05-09T02:22:53.971892+0000","last_peered":"2024-05-09T02:22:53.971892+0000","last_clean":"2024-05-09T02:22:53.971892+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:22:53.971892+0000","last_undegraded":"2024-05-09T02:22:53.971892+0000","last_fullsized":"2024-05-09T02:22:53.971892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:44.452698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.572859+0000","last_change":"2024-05-09T02:18:13.144831+0000","last_active":"2024-05-09T02:23:06.572859+0000","last_peered":"2024-05-09T02:23:06.572859+0000","last_clean":"2024-05-09T02:23:06.572859+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:23:06.572859+0000","last_undegraded":"2024-05-09T02:23:06.572859+0000","last_fullsized":"2024-05-09T02:23:06.572859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970598+0000","last_change":"2024-05-09T02:18:22.197712+0000","last_active":"2024-05-09T02:22:53.970598+0000","last_peered":"2024-05-09T02:22:53.970598+0000","last_clean":"2024-05-09T02:22:53.970598+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:22:53.970598+0000","last_undegraded":"2024-05-09T02:22:53.970598+0000","last_fullsized":"2024-05-09T02:22:53.970598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:42.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980486+0000","last_change":"2024-05-09T02:18:23.203235+0000","last_active":"2024-05-09T02:22:53.980486+0000","last_peered":"2024-05-09T02:22:53.980486+0000","last_clean":"2024-05-09T02:22:53.980486+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:22:53.980486+0000","last_undegraded":"2024-05-09T02:22:53.980486+0000","last_fullsized":"2024-05-09T02:22:53.980486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'132","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577993+0000","last_change":"2024-05-09T02:18:14.150298+0000","last_active":"2024-05-09T02:23:06.577993+0000","last_peered":"2024-05-09T02:23:06.577993+0000","last_clean":"2024-05-09T02:23:06.577993+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:23:06.577993+0000","last_undegraded":"2024-05-09T02:23:06.577993+0000","last_fullsized":"2024-05-09T02:23:06.577993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108042+0000","last_change":"2024-05-09T02:18:13.143791+0000","last_active":"2024-05-09T02:22:54.108042+0000","last_peered":"2024-05-09T02:22:54.108042+0000","last_clean":"2024-05-09T02:22:54.108042+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:22:54.108042+0000","last_undegraded":"2024-05-09T02:22:54.108042+0000","last_fullsized":"2024-05-09T02:22:54.108042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:48.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'13","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.328837+0000","last_change":"2024-05-09T02:23:16.328894+0000","last_active":"2024-05-09T02:23:16.328837+0000","last_peered":"2024-05-09T02:23:16.328837+0000","last_clean":"2024-05-09T02:23:16.328837+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:23:16.328837+0000","last_undegraded":"2024-05-09T02:23:16.328837+0000","last_fullsized":"2024-05-09T02:23:16.328837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-09T02:23:16.328709+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-09T02:23:16.328709+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.328709+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:00.935663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'159","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977100+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:22:53.977100+0000","last_peered":"2024-05-09T02:22:53.977100+0000","last_clean":"2024-05-09T02:22:53.977100+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:22:53.977100+0000","last_undegraded":"2024-05-09T02:22:53.977100+0000","last_fullsized":"2024-05-09T02:22:53.977100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'219","reported_seq":242,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978976+0000","last_change":"2024-05-09T02:18:55.680482+0000","last_active":"2024-05-09T02:22:53.978976+0000","last_peered":"2024-05-09T02:22:53.978976+0000","last_clean":"2024-05-09T02:22:53.978976+0000","last_became_active":"2024-05-09T02:18:55.680219+0000","last_became_peered":"2024-05-09T02:18:55.680219+0000","last_unstale":"2024-05-09T02:22:53.978976+0000","last_undegraded":"2024-05-09T02:22:53.978976+0000","last_fullsized":"2024-05-09T02:22:53.978976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:58.977541+0000","last_change":"2024-05-09T02:18:13.144933+0000","last_active":"2024-05-09T02:22:58.977541+0000","last_peered":"2024-05-09T02:22:58.977541+0000","last_clean":"2024-05-09T02:22:58.977541+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:22:58.977541+0000","last_undegraded":"2024-05-09T02:22:58.977541+0000","last_fullsized":"2024-05-09T02:22:58.977541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:01.576541+0000","last_change":"2024-05-09T02:18:22.194929+0000","last_active":"2024-05-09T02:23:01.576541+0000","last_peered":"2024-05-09T02:23:01.576541+0000","last_clean":"2024-05-09T02:23:01.576541+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:23:01.576541+0000","last_undegraded":"2024-05-09T02:23:01.576541+0000","last_fullsized":"2024-05-09T02:23:01.576541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981396+0000","last_change":"2024-05-09T02:18:23.207518+0000","last_active":"2024-05-09T02:22:53.981396+0000","last_peered":"2024-05-09T02:22:53.981396+0000","last_clean":"2024-05-09T02:22:53.981396+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:22:53.981396+0000","last_undegraded":"2024-05-09T02:22:53.981396+0000","last_fullsized":"2024-05-09T02:22:53.981396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970728+0000","last_change":"2024-05-09T02:18:22.192711+0000","last_active":"2024-05-09T02:22:53.970728+0000","last_peered":"2024-05-09T02:22:53.970728+0000","last_clean":"2024-05-09T02:22:53.970728+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:22:53.970728+0000","last_undegraded":"2024-05-09T02:22:53.970728+0000","last_fullsized":"2024-05-09T02:22:53.970728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'147","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.572793+0000","last_change":"2024-05-09T02:18:14.145029+0000","last_active":"2024-05-09T02:23:06.572793+0000","last_peered":"2024-05-09T02:23:06.572793+0000","last_clean":"2024-05-09T02:23:06.572793+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:23:06.572793+0000","last_undegraded":"2024-05-09T02:23:06.572793+0000","last_fullsized":"2024-05-09T02:23:06.572793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107588+0000","last_change":"2024-05-09T02:18:13.142031+0000","last_active":"2024-05-09T02:22:54.107588+0000","last_peered":"2024-05-09T02:22:54.107588+0000","last_clean":"2024-05-09T02:22:54.107588+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:22:54.107588+0000","last_undegraded":"2024-05-09T02:22:54.107588+0000","last_fullsized":"2024-05-09T02:22:54.107588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:31.063260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"32'147","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970381+0000","last_change":"2024-05-09T02:18:23.212427+0000","last_active":"2024-05-09T02:22:53.970381+0000","last_peered":"2024-05-09T02:22:53.970381+0000","last_clean":"2024-05-09T02:22:53.970381+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:22:53.970381+0000","last_undegraded":"2024-05-09T02:22:53.970381+0000","last_fullsized":"2024-05-09T02:22:53.970381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981757+0000","last_change":"2024-05-09T02:18:22.203514+0000","last_active":"2024-05-09T02:22:53.981757+0000","last_peered":"2024-05-09T02:22:53.981757+0000","last_clean":"2024-05-09T02:22:53.981757+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:22:53.981757+0000","last_undegraded":"2024-05-09T02:22:53.981757+0000","last_fullsized":"2024-05-09T02:22:53.981757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:22.366662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'162","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970420+0000","last_change":"2024-05-09T02:18:55.678178+0000","last_active":"2024-05-09T02:22:53.970420+0000","last_peered":"2024-05-09T02:22:53.970420+0000","last_clean":"2024-05-09T02:22:53.970420+0000","last_became_active":"2024-05-09T02:18:55.677782+0000","last_became_peered":"2024-05-09T02:18:55.677782+0000","last_unstale":"2024-05-09T02:22:53.970420+0000","last_undegraded":"2024-05-09T02:22:53.970420+0000","last_fullsized":"2024-05-09T02:22:53.970420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577217+0000","last_change":"2024-05-09T02:18:13.147717+0000","last_active":"2024-05-09T02:23:06.577217+0000","last_peered":"2024-05-09T02:23:06.577217+0000","last_clean":"2024-05-09T02:23:06.577217+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:23:06.577217+0000","last_undegraded":"2024-05-09T02:23:06.577217+0000","last_fullsized":"2024-05-09T02:23:06.577217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'168","reported_seq":197,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974664+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:22:53.974664+0000","last_peered":"2024-05-09T02:22:53.974664+0000","last_clean":"2024-05-09T02:22:53.974664+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:22:53.974664+0000","last_undegraded":"2024-05-09T02:22:53.974664+0000","last_fullsized":"2024-05-09T02:22:53.974664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.996247+0000","last_change":"2024-05-09T02:18:13.143390+0000","last_active":"2024-05-09T02:22:53.996247+0000","last_peered":"2024-05-09T02:22:53.996247+0000","last_clean":"2024-05-09T02:22:53.996247+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:22:53.996247+0000","last_undegraded":"2024-05-09T02:22:53.996247+0000","last_fullsized":"2024-05-09T02:22:53.996247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:18.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'129","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.505713+0000","last_change":"2024-05-09T02:18:14.139418+0000","last_active":"2024-05-09T02:23:14.505713+0000","last_peered":"2024-05-09T02:23:14.505713+0000","last_clean":"2024-05-09T02:23:14.505713+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:23:14.505713+0000","last_undegraded":"2024-05-09T02:23:14.505713+0000","last_fullsized":"2024-05-09T02:23:14.505713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978962+0000","last_change":"2024-05-09T02:18:22.200350+0000","last_active":"2024-05-09T02:22:53.978962+0000","last_peered":"2024-05-09T02:22:53.978962+0000","last_clean":"2024-05-09T02:22:53.978962+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:22:53.978962+0000","last_undegraded":"2024-05-09T02:22:53.978962+0000","last_fullsized":"2024-05-09T02:22:53.978962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"32'132","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970562+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:22:53.970562+0000","last_peered":"2024-05-09T02:22:53.970562+0000","last_clean":"2024-05-09T02:22:53.970562+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:22:53.970562+0000","last_undegraded":"2024-05-09T02:22:53.970562+0000","last_fullsized":"2024-05-09T02:22:53.970562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:40.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.982448+0000","last_change":"2024-05-09T02:18:13.152042+0000","last_active":"2024-05-09T02:23:15.982448+0000","last_peered":"2024-05-09T02:23:15.982448+0000","last_clean":"2024-05-09T02:23:15.982448+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:23:15.982448+0000","last_undegraded":"2024-05-09T02:23:15.982448+0000","last_fullsized":"2024-05-09T02:23:15.982448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971985+0000","last_change":"2024-05-09T02:18:14.150540+0000","last_active":"2024-05-09T02:22:53.971985+0000","last_peered":"2024-05-09T02:22:53.971985+0000","last_clean":"2024-05-09T02:22:53.971985+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:22:53.971985+0000","last_undegraded":"2024-05-09T02:22:53.971985+0000","last_fullsized":"2024-05-09T02:22:53.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:19.469059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985846+0000","last_change":"2024-05-09T02:18:22.199000+0000","last_active":"2024-05-09T02:22:53.985846+0000","last_peered":"2024-05-09T02:22:53.985846+0000","last_clean":"2024-05-09T02:22:53.985846+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:22:53.985846+0000","last_undegraded":"2024-05-09T02:22:53.985846+0000","last_fullsized":"2024-05-09T02:22:53.985846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:21.168013+0000","last_clean_scrub_stamp":"2024-05-09T02:18:21.168013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"32'183","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986029+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:22:53.986029+0000","last_peered":"2024-05-09T02:22:53.986029+0000","last_clean":"2024-05-09T02:22:53.986029+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:22:53.986029+0000","last_undegraded":"2024-05-09T02:22:53.986029+0000","last_fullsized":"2024-05-09T02:22:53.986029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980177+0000","last_change":"2024-05-09T02:18:14.154368+0000","last_active":"2024-05-09T02:22:53.980177+0000","last_peered":"2024-05-09T02:22:53.980177+0000","last_clean":"2024-05-09T02:22:53.980177+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:22:53.980177+0000","last_undegraded":"2024-05-09T02:22:53.980177+0000","last_fullsized":"2024-05-09T02:22:53.980177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:37.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974996+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:22:53.974996+0000","last_peered":"2024-05-09T02:22:53.974996+0000","last_clean":"2024-05-09T02:22:53.974996+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:22:53.974996+0000","last_undegraded":"2024-05-09T02:22:53.974996+0000","last_fullsized":"2024-05-09T02:22:53.974996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"31'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978125+0000","last_change":"2024-05-09T02:18:14.149901+0000","last_active":"2024-05-09T02:22:53.978125+0000","last_peered":"2024-05-09T02:22:53.978125+0000","last_clean":"2024-05-09T02:22:53.978125+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:22:53.978125+0000","last_undegraded":"2024-05-09T02:22:53.978125+0000","last_fullsized":"2024-05-09T02:22:53.978125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107639+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:22:54.107639+0000","last_peered":"2024-05-09T02:22:54.107639+0000","last_clean":"2024-05-09T02:22:54.107639+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:22:54.107639+0000","last_undegraded":"2024-05-09T02:22:54.107639+0000","last_fullsized":"2024-05-09T02:22:54.107639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'123","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107926+0000","last_change":"2024-05-09T02:18:14.159692+0000","last_active":"2024-05-09T02:22:54.107926+0000","last_peered":"2024-05-09T02:22:54.107926+0000","last_clean":"2024-05-09T02:22:54.107926+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:22:54.107926+0000","last_undegraded":"2024-05-09T02:22:54.107926+0000","last_fullsized":"2024-05-09T02:22:54.107926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:34.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974638+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:22:53.974638+0000","last_peered":"2024-05-09T02:22:53.974638+0000","last_clean":"2024-05-09T02:22:53.974638+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:22:53.974638+0000","last_undegraded":"2024-05-09T02:22:53.974638+0000","last_fullsized":"2024-05-09T02:22:53.974638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"31'111","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971365+0000","last_change":"2024-05-09T02:18:14.143923+0000","last_active":"2024-05-09T02:22:53.971365+0000","last_peered":"2024-05-09T02:22:53.971365+0000","last_clean":"2024-05-09T02:22:53.971365+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:22:53.971365+0000","last_undegraded":"2024-05-09T02:22:53.971365+0000","last_fullsized":"2024-05-09T02:22:53.971365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"32'123","reported_seq":153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976759+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:22:53.976759+0000","last_peered":"2024-05-09T02:22:53.976759+0000","last_clean":"2024-05-09T02:22:53.976759+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:22:53.976759+0000","last_undegraded":"2024-05-09T02:22:53.976759+0000","last_fullsized":"2024-05-09T02:22:53.976759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:01.936267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"31'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986354+0000","last_change":"2024-05-09T02:18:14.147374+0000","last_active":"2024-05-09T02:22:53.986354+0000","last_peered":"2024-05-09T02:22:53.986354+0000","last_clean":"2024-05-09T02:22:53.986354+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:22:53.986354+0000","last_undegraded":"2024-05-09T02:22:53.986354+0000","last_fullsized":"2024-05-09T02:22:53.986354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"32'111","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970144+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:22:53.970144+0000","last_peered":"2024-05-09T02:22:53.970144+0000","last_clean":"2024-05-09T02:22:53.970144+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:22:53.970144+0000","last_undegraded":"2024-05-09T02:22:53.970144+0000","last_fullsized":"2024-05-09T02:22:53.970144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.975116+0000","last_change":"2024-05-09T02:18:14.142176+0000","last_active":"2024-05-09T02:22:53.975116+0000","last_peered":"2024-05-09T02:22:53.975116+0000","last_clean":"2024-05-09T02:22:53.975116+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:22:53.975116+0000","last_undegraded":"2024-05-09T02:22:53.975116+0000","last_fullsized":"2024-05-09T02:22:53.975116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976427+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:22:53.976427+0000","last_peered":"2024-05-09T02:22:53.976427+0000","last_clean":"2024-05-09T02:22:53.976427+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:22:53.976427+0000","last_undegraded":"2024-05-09T02:22:53.976427+0000","last_fullsized":"2024-05-09T02:22:53.976427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:39.681945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981218+0000","last_change":"2024-05-09T02:18:14.159994+0000","last_active":"2024-05-09T02:22:53.981218+0000","last_peered":"2024-05-09T02:22:53.981218+0000","last_clean":"2024-05-09T02:22:53.981218+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:22:53.981218+0000","last_undegraded":"2024-05-09T02:22:53.981218+0000","last_fullsized":"2024-05-09T02:22:53.981218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"32'123","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980262+0000","last_change":"2024-05-09T02:18:23.199567+0000","last_active":"2024-05-09T02:22:53.980262+0000","last_peered":"2024-05-09T02:22:53.980262+0000","last_clean":"2024-05-09T02:22:53.980262+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:22:53.980262+0000","last_undegraded":"2024-05-09T02:22:53.980262+0000","last_fullsized":"2024-05-09T02:22:53.980262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:22.309534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985393+0000","last_change":"2024-05-09T02:18:14.146493+0000","last_active":"2024-05-09T02:22:53.985393+0000","last_peered":"2024-05-09T02:22:53.985393+0000","last_clean":"2024-05-09T02:22:53.985393+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:22:53.985393+0000","last_undegraded":"2024-05-09T02:22:53.985393+0000","last_fullsized":"2024-05-09T02:22:53.985393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"32'147","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577311+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:23:06.577311+0000","last_peered":"2024-05-09T02:23:06.577311+0000","last_clean":"2024-05-09T02:23:06.577311+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:23:06.577311+0000","last_undegraded":"2024-05-09T02:23:06.577311+0000","last_fullsized":"2024-05-09T02:23:06.577311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'174","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107316+0000","last_change":"2024-05-09T02:18:14.159639+0000","last_active":"2024-05-09T02:22:54.107316+0000","last_peered":"2024-05-09T02:22:54.107316+0000","last_clean":"2024-05-09T02:22:54.107316+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:22:54.107316+0000","last_undegraded":"2024-05-09T02:22:54.107316+0000","last_fullsized":"2024-05-09T02:22:54.107316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978652+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:22:53.978652+0000","last_peered":"2024-05-09T02:22:53.978652+0000","last_clean":"2024-05-09T02:22:53.978652+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:22:53.978652+0000","last_undegraded":"2024-05-09T02:22:53.978652+0000","last_fullsized":"2024-05-09T02:22:53.978652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:12.571932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984666+0000","last_change":"2024-05-09T02:18:14.146713+0000","last_active":"2024-05-09T02:22:53.984666+0000","last_peered":"2024-05-09T02:22:53.984666+0000","last_clean":"2024-05-09T02:22:53.984666+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:22:53.984666+0000","last_undegraded":"2024-05-09T02:22:53.984666+0000","last_fullsized":"2024-05-09T02:22:53.984666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"32'153","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.563544+0000","last_change":"2024-05-09T02:18:23.205440+0000","last_active":"2024-05-09T02:22:56.563544+0000","last_peered":"2024-05-09T02:22:56.563544+0000","last_clean":"2024-05-09T02:22:56.563544+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:22:56.563544+0000","last_undegraded":"2024-05-09T02:22:56.563544+0000","last_fullsized":"2024-05-09T02:22:56.563544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"31'156","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107220+0000","last_change":"2024-05-09T02:18:14.157678+0000","last_active":"2024-05-09T02:22:54.107220+0000","last_peered":"2024-05-09T02:22:54.107220+0000","last_clean":"2024-05-09T02:22:54.107220+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:22:54.107220+0000","last_undegraded":"2024-05-09T02:22:54.107220+0000","last_fullsized":"2024-05-09T02:22:54.107220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:32:41.105010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"32'165","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.576019+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:22:56.576019+0000","last_peered":"2024-05-09T02:22:56.576019+0000","last_clean":"2024-05-09T02:22:56.576019+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:22:56.576019+0000","last_undegraded":"2024-05-09T02:22:56.576019+0000","last_fullsized":"2024-05-09T02:22:56.576019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"31'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970643+0000","last_change":"2024-05-09T02:18:14.153550+0000","last_active":"2024-05-09T02:22:53.970643+0000","last_peered":"2024-05-09T02:22:53.970643+0000","last_clean":"2024-05-09T02:22:53.970643+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:22:53.970643+0000","last_undegraded":"2024-05-09T02:22:53.970643+0000","last_fullsized":"2024-05-09T02:22:53.970643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"32'156","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971445+0000","last_change":"2024-05-09T02:18:23.219901+0000","last_active":"2024-05-09T02:22:53.971445+0000","last_peered":"2024-05-09T02:22:53.971445+0000","last_clean":"2024-05-09T02:22:53.971445+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:22:53.971445+0000","last_undegraded":"2024-05-09T02:22:53.971445+0000","last_fullsized":"2024-05-09T02:22:53.971445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:26.546859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'153","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980789+0000","last_change":"2024-05-09T02:18:14.153059+0000","last_active":"2024-05-09T02:22:53.980789+0000","last_peered":"2024-05-09T02:22:53.980789+0000","last_clean":"2024-05-09T02:22:53.980789+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:22:53.980789+0000","last_undegraded":"2024-05-09T02:22:53.980789+0000","last_fullsized":"2024-05-09T02:22:53.980789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:13.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970169+0000","last_change":"2024-05-09T02:18:23.212394+0000","last_active":"2024-05-09T02:22:53.970169+0000","last_peered":"2024-05-09T02:22:53.970169+0000","last_clean":"2024-05-09T02:22:53.970169+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:22:53.970169+0000","last_undegraded":"2024-05-09T02:22:53.970169+0000","last_fullsized":"2024-05-09T02:22:53.970169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:10.721828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"31'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978983+0000","last_change":"2024-05-09T02:18:14.149661+0000","last_active":"2024-05-09T02:22:53.978983+0000","last_peered":"2024-05-09T02:22:53.978983+0000","last_clean":"2024-05-09T02:22:53.978983+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:22:53.978983+0000","last_undegraded":"2024-05-09T02:22:53.978983+0000","last_fullsized":"2024-05-09T02:22:53.978983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:59.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"32'174","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106722+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:22:54.106722+0000","last_peered":"2024-05-09T02:22:54.106722+0000","last_clean":"2024-05-09T02:22:54.106722+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:22:54.106722+0000","last_undegraded":"2024-05-09T02:22:54.106722+0000","last_fullsized":"2024-05-09T02:22:54.106722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:45.760289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"31'147","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.563576+0000","last_change":"2024-05-09T02:18:14.154089+0000","last_active":"2024-05-09T02:22:56.563576+0000","last_peered":"2024-05-09T02:22:56.563576+0000","last_clean":"2024-05-09T02:22:56.563576+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:22:56.563576+0000","last_undegraded":"2024-05-09T02:22:56.563576+0000","last_fullsized":"2024-05-09T02:22:56.563576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"32'126","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.576953+0000","last_change":"2024-05-09T02:18:23.211615+0000","last_active":"2024-05-09T02:22:56.576953+0000","last_peered":"2024-05-09T02:22:56.576953+0000","last_clean":"2024-05-09T02:22:56.576953+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:22:56.576953+0000","last_undegraded":"2024-05-09T02:22:56.576953+0000","last_fullsized":"2024-05-09T02:22:56.576953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"31'138","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.979972+0000","last_change":"2024-05-09T02:18:55.680326+0000","last_active":"2024-05-09T02:22:53.979972+0000","last_peered":"2024-05-09T02:22:53.979972+0000","last_clean":"2024-05-09T02:22:53.979972+0000","last_became_active":"2024-05-09T02:18:55.680014+0000","last_became_peered":"2024-05-09T02:18:55.680014+0000","last_unstale":"2024-05-09T02:22:53.979972+0000","last_undegraded":"2024-05-09T02:22:53.979972+0000","last_fullsized":"2024-05-09T02:22:53.979972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.998815+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:23:14.998815+0000","last_peered":"2024-05-09T02:23:14.998815+0000","last_clean":"2024-05-09T02:23:14.998815+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:23:14.998815+0000","last_undegraded":"2024-05-09T02:23:14.998815+0000","last_fullsized":"2024-05-09T02:23:14.998815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"31'138","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107142+0000","last_change":"2024-05-09T02:18:14.148947+0000","last_active":"2024-05-09T02:22:54.107142+0000","last_peered":"2024-05-09T02:22:54.107142+0000","last_clean":"2024-05-09T02:22:54.107142+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:22:54.107142+0000","last_undegraded":"2024-05-09T02:22:54.107142+0000","last_fullsized":"2024-05-09T02:22:54.107142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"32'141","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971005+0000","last_change":"2024-05-09T02:18:23.205978+0000","last_active":"2024-05-09T02:22:53.971005+0000","last_peered":"2024-05-09T02:22:53.971005+0000","last_clean":"2024-05-09T02:22:53.971005+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:22:53.971005+0000","last_undegraded":"2024-05-09T02:22:53.971005+0000","last_fullsized":"2024-05-09T02:22:53.971005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:59.912237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.571590+0000","last_change":"2024-05-09T02:18:14.138461+0000","last_active":"2024-05-09T02:22:56.571590+0000","last_peered":"2024-05-09T02:22:56.571590+0000","last_clean":"2024-05-09T02:22:56.571590+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:22:56.571590+0000","last_undegraded":"2024-05-09T02:22:56.571590+0000","last_fullsized":"2024-05-09T02:22:56.571590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"32'135","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107391+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:22:54.107391+0000","last_peered":"2024-05-09T02:22:54.107391+0000","last_clean":"2024-05-09T02:22:54.107391+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:22:54.107391+0000","last_undegraded":"2024-05-09T02:22:54.107391+0000","last_fullsized":"2024-05-09T02:22:54.107391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:29.921758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'141","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.576980+0000","last_change":"2024-05-09T02:18:14.145797+0000","last_active":"2024-05-09T02:22:56.576980+0000","last_peered":"2024-05-09T02:22:56.576980+0000","last_clean":"2024-05-09T02:22:56.576980+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:22:56.576980+0000","last_undegraded":"2024-05-09T02:22:56.576980+0000","last_fullsized":"2024-05-09T02:22:56.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"32'183","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977362+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:22:53.977362+0000","last_peered":"2024-05-09T02:22:53.977362+0000","last_clean":"2024-05-09T02:22:53.977362+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:22:53.977362+0000","last_undegraded":"2024-05-09T02:22:53.977362+0000","last_fullsized":"2024-05-09T02:22:53.977362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:15:47.708859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577275+0000","last_change":"2024-05-09T02:18:14.148484+0000","last_active":"2024-05-09T02:23:06.577275+0000","last_peered":"2024-05-09T02:23:06.577275+0000","last_clean":"2024-05-09T02:23:06.577275+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:23:06.577275+0000","last_undegraded":"2024-05-09T02:23:06.577275+0000","last_fullsized":"2024-05-09T02:23:06.577275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577243+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:23:06.577243+0000","last_peered":"2024-05-09T02:23:06.577243+0000","last_clean":"2024-05-09T02:23:06.577243+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:23:06.577243+0000","last_undegraded":"2024-05-09T02:23:06.577243+0000","last_fullsized":"2024-05-09T02:23:06.577243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.971405+0000","last_change":"2024-05-09T02:18:14.153453+0000","last_active":"2024-05-09T02:22:53.971405+0000","last_peered":"2024-05-09T02:22:53.971405+0000","last_clean":"2024-05-09T02:22:53.971405+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:22:53.971405+0000","last_undegraded":"2024-05-09T02:22:53.971405+0000","last_fullsized":"2024-05-09T02:22:53.971405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:42.293336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.490797+0000","last_change":"2024-05-09T02:18:23.205511+0000","last_active":"2024-05-09T02:23:15.490797+0000","last_peered":"2024-05-09T02:23:15.490797+0000","last_clean":"2024-05-09T02:23:15.490797+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:23:15.490797+0000","last_undegraded":"2024-05-09T02:23:15.490797+0000","last_fullsized":"2024-05-09T02:23:15.490797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"31'183","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.980636+0000","last_change":"2024-05-09T02:18:14.155528+0000","last_active":"2024-05-09T02:22:53.980636+0000","last_peered":"2024-05-09T02:22:53.980636+0000","last_clean":"2024-05-09T02:22:53.980636+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:22:53.980636+0000","last_undegraded":"2024-05-09T02:22:53.980636+0000","last_fullsized":"2024-05-09T02:22:53.980636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:25.242639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:59.272494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"31'141","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981266+0000","last_change":"2024-05-09T02:18:14.158003+0000","last_active":"2024-05-09T02:22:53.981266+0000","last_peered":"2024-05-09T02:22:53.981266+0000","last_clean":"2024-05-09T02:22:53.981266+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:22:53.981266+0000","last_undegraded":"2024-05-09T02:22:53.981266+0000","last_fullsized":"2024-05-09T02:22:53.981266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106954+0000","last_change":"2024-05-09T02:18:23.204726+0000","last_active":"2024-05-09T02:22:54.106954+0000","last_peered":"2024-05-09T02:22:54.106954+0000","last_clean":"2024-05-09T02:22:54.106954+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:22:54.106954+0000","last_undegraded":"2024-05-09T02:22:54.106954+0000","last_fullsized":"2024-05-09T02:22:54.106954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"31'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978197+0000","last_change":"2024-05-09T02:18:14.153990+0000","last_active":"2024-05-09T02:22:53.978197+0000","last_peered":"2024-05-09T02:22:53.978197+0000","last_clean":"2024-05-09T02:22:53.978197+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:22:53.978197+0000","last_undegraded":"2024-05-09T02:22:53.978197+0000","last_fullsized":"2024-05-09T02:22:53.978197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:35.876604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"32'126","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985147+0000","last_change":"2024-05-09T02:18:23.211656+0000","last_active":"2024-05-09T02:22:53.985147+0000","last_peered":"2024-05-09T02:22:53.985147+0000","last_clean":"2024-05-09T02:22:53.985147+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:22:53.985147+0000","last_undegraded":"2024-05-09T02:22:53.985147+0000","last_fullsized":"2024-05-09T02:22:53.985147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":215,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.982685+0000","last_change":"2024-05-09T02:18:14.158281+0000","last_active":"2024-05-09T02:23:15.982685+0000","last_peered":"2024-05-09T02:23:15.982685+0000","last_clean":"2024-05-09T02:23:15.982685+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:23:15.982685+0000","last_undegraded":"2024-05-09T02:23:15.982685+0000","last_fullsized":"2024-05-09T02:23:15.982685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"32'138","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.981348+0000","last_change":"2024-05-09T02:18:23.206248+0000","last_active":"2024-05-09T02:22:53.981348+0000","last_peered":"2024-05-09T02:22:53.981348+0000","last_clean":"2024-05-09T02:22:53.981348+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:22:53.981348+0000","last_undegraded":"2024-05-09T02:22:53.981348+0000","last_fullsized":"2024-05-09T02:22:53.981348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:55.905271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"31'159","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977532+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:22:53.977532+0000","last_peered":"2024-05-09T02:22:53.977532+0000","last_clean":"2024-05-09T02:22:53.977532+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:22:53.977532+0000","last_undegraded":"2024-05-09T02:22:53.977532+0000","last_fullsized":"2024-05-09T02:22:53.977532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"32'165","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970689+0000","last_change":"2024-05-09T02:18:23.215386+0000","last_active":"2024-05-09T02:22:53.970689+0000","last_peered":"2024-05-09T02:22:53.970689+0000","last_clean":"2024-05-09T02:22:53.970689+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:22:53.970689+0000","last_undegraded":"2024-05-09T02:22:53.970689+0000","last_fullsized":"2024-05-09T02:22:53.970689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'129","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107103+0000","last_change":"2024-05-09T02:18:14.148475+0000","last_active":"2024-05-09T02:22:54.107103+0000","last_peered":"2024-05-09T02:22:54.107103+0000","last_clean":"2024-05-09T02:22:54.107103+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:22:54.107103+0000","last_undegraded":"2024-05-09T02:22:54.107103+0000","last_fullsized":"2024-05-09T02:22:54.107103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:17.891910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107507+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:22:54.107507+0000","last_peered":"2024-05-09T02:22:54.107507+0000","last_clean":"2024-05-09T02:22:54.107507+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:22:54.107507+0000","last_undegraded":"2024-05-09T02:22:54.107507+0000","last_fullsized":"2024-05-09T02:22:54.107507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:01.055546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'144","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977075+0000","last_change":"2024-05-09T02:18:14.148397+0000","last_active":"2024-05-09T02:22:53.977075+0000","last_peered":"2024-05-09T02:22:53.977075+0000","last_clean":"2024-05-09T02:22:53.977075+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:22:53.977075+0000","last_undegraded":"2024-05-09T02:22:53.977075+0000","last_fullsized":"2024-05-09T02:22:53.977075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:29.630178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"32'129","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984921+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:22:53.984921+0000","last_peered":"2024-05-09T02:22:53.984921+0000","last_clean":"2024-05-09T02:22:53.984921+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:22:53.984921+0000","last_undegraded":"2024-05-09T02:22:53.984921+0000","last_fullsized":"2024-05-09T02:22:53.984921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'165","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.108415+0000","last_change":"2024-05-09T02:18:14.161513+0000","last_active":"2024-05-09T02:22:54.108415+0000","last_peered":"2024-05-09T02:22:54.108415+0000","last_clean":"2024-05-09T02:22:54.108415+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:22:54.108415+0000","last_undegraded":"2024-05-09T02:22:54.108415+0000","last_fullsized":"2024-05-09T02:22:54.108415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:59.721135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"32'144","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978449+0000","last_change":"2024-05-09T02:18:23.210589+0000","last_active":"2024-05-09T02:22:53.978449+0000","last_peered":"2024-05-09T02:22:53.978449+0000","last_clean":"2024-05-09T02:22:53.978449+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:22:53.978449+0000","last_undegraded":"2024-05-09T02:22:53.978449+0000","last_fullsized":"2024-05-09T02:22:53.978449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'144","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.969897+0000","last_change":"2024-05-09T02:18:14.148703+0000","last_active":"2024-05-09T02:22:53.969897+0000","last_peered":"2024-05-09T02:22:53.969897+0000","last_clean":"2024-05-09T02:22:53.969897+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:22:53.969897+0000","last_undegraded":"2024-05-09T02:22:53.969897+0000","last_fullsized":"2024-05-09T02:22:53.969897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"32'177","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976418+0000","last_change":"2024-05-09T02:18:23.221661+0000","last_active":"2024-05-09T02:22:53.976418+0000","last_peered":"2024-05-09T02:22:53.976418+0000","last_clean":"2024-05-09T02:22:53.976418+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:22:53.976418+0000","last_undegraded":"2024-05-09T02:22:53.976418+0000","last_fullsized":"2024-05-09T02:22:53.976418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:50.532659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"31'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974841+0000","last_change":"2024-05-09T02:18:14.138544+0000","last_active":"2024-05-09T02:22:53.974841+0000","last_peered":"2024-05-09T02:22:53.974841+0000","last_clean":"2024-05-09T02:22:53.974841+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:22:53.974841+0000","last_undegraded":"2024-05-09T02:22:53.974841+0000","last_fullsized":"2024-05-09T02:22:53.974841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"32'159","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976524+0000","last_change":"2024-05-09T02:18:23.222579+0000","last_active":"2024-05-09T02:22:53.976524+0000","last_peered":"2024-05-09T02:22:53.976524+0000","last_clean":"2024-05-09T02:22:53.976524+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:22:53.976524+0000","last_undegraded":"2024-05-09T02:22:53.976524+0000","last_fullsized":"2024-05-09T02:22:53.976524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:40.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"31'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.977969+0000","last_change":"2024-05-09T02:18:14.156370+0000","last_active":"2024-05-09T02:22:53.977969+0000","last_peered":"2024-05-09T02:22:53.977969+0000","last_clean":"2024-05-09T02:22:53.977969+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:22:53.977969+0000","last_undegraded":"2024-05-09T02:22:53.977969+0000","last_fullsized":"2024-05-09T02:22:53.977969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:35.572321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":211620,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":435,"num_write":199,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":423240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216648,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":455,"num_write":196,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":433296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":966656,"data_stored":752122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58128,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313712,"statfs":{"total":96636764160,"available":96577241088,"internally_reserved":0,"allocated":598016,"data_stored":377043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":380928,"data_stored":162349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45444,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326396,"statfs":{"total":96636764160,"available":96590229504,"internally_reserved":0,"allocated":389120,"data_stored":161817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54184,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317656,"statfs":{"total":96636764160,"available":96581279744,"internally_reserved":0,"allocated":819200,"data_stored":587271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":372736,"data_stored":161657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49808,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":598016,"data_stored":371581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50172,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321668,"statfs":{"total":96636764160,"available":96585388032,"internally_reserved":0,"allocated":970752,"data_stored":752088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":215850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":215345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.375 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.376 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.377 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.378 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.379 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.380 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T02:18:03.018072+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=3, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.381 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.382 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.383 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.384 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.385 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.386 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.387 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T02:18:21.168013+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.388 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.389 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.390 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.391 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.392 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.393 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.394 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.395 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.395 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.395 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:18.395 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T02:23:18.651 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:23:18.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:23:38.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:23:38.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.522+0000 7f75b4227640 1 Processor -- start 2024-05-09T02:23:38.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.522+0000 7f75b4227640 1 -- start start 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.523+0000 7f75b4227640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f75ac0a91e0 0x7f75ac0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.523+0000 7f75b4227640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f75ac154720 0x7f75ac0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.523+0000 7f75b4227640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ac0733b0 con 0x7f75ac151ef0 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.523+0000 7f75b4227640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f75ac0ab290 con 0x7f75ac0a91e0 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.523+0000 7f75b4227640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f75ac0ab570 con 0x7f75ac154720 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f75ac0a91e0 0x7f75ac0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f75ac0a91e0 0x7f75ac0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39392/0 (socket says 172.21.15.46:39392) 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 -- 172.21.15.46:0/2195016982 learned_addr learned my addr 172.21.15.46:0/2195016982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b27c4640 1 --2- 172.21.15.46:0/2195016982 >> v2:172.21.15.107:3300/0 conn(0x7f75ac154720 0x7f75ac0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:38.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 -- 172.21.15.46:0/2195016982 >> v2:172.21.15.107:3300/0 conn(0x7f75ac154720 msgr2=0x7f75ac0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:38.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 --2- 172.21.15.46:0/2195016982 >> v2:172.21.15.107:3300/0 conn(0x7f75ac154720 0x7f75ac0c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 -- 172.21.15.46:0/2195016982 >> v1:172.21.15.46:6789/0 conn(0x7f75ac151ef0 legacy=0x7f75ac073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:38.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b0fc1640 1 -- 172.21.15.46:0/2195016982 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315432895 0 0) 0x7f75ac0733b0 con 0x7f75ac151ef0 2024-05-09T02:23:38.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b17c2640 1 -- 172.21.15.46:0/2195016982 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac073620 con 0x7f75ac0a91e0 2024-05-09T02:23:38.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.524+0000 7f75b27c4640 1 --2- 172.21.15.46:0/2195016982 >> v2:172.21.15.107:3300/0 conn(0x7f75ac154720 0x7f75ac0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.525+0000 7f75b17c2640 1 --2- 172.21.15.46:0/2195016982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac0aac90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0709c0 tx=0x7f759c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db5c985dcad18b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.525+0000 7f75b0fc1640 1 -- 172.21.15.46:0/2195016982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c037070 con 0x7f75ac0a91e0 2024-05-09T02:23:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.525+0000 7f75b0fc1640 1 -- 172.21.15.46:0/2195016982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759c032440 con 0x7f75ac0a91e0 2024-05-09T02:23:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.525+0000 7f75b0fc1640 1 -- 172.21.15.46:0/2195016982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c032810 con 0x7f75ac0a91e0 2024-05-09T02:23:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 -- 172.21.15.46:0/2195016982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 msgr2=0x7f75ac0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 --2- 172.21.15.46:0/2195016982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac0aac90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0709c0 tx=0x7f759c02a270 comp rx=0 tx=0).stop 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 -- 172.21.15.46:0/2195016982 shutdown_connections 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 --2- 172.21.15.46:0/2195016982 >> v2:172.21.15.107:3300/0 conn(0x7f75ac154720 0x7f75ac0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 --2- 172.21.15.46:0/2195016982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac0aac90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 -- 172.21.15.46:0/2195016982 >> 172.21.15.46:0/2195016982 conn(0x7f75ac0c5940 msgr2=0x7f75ac0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 -- 172.21.15.46:0/2195016982 shutdown_connections 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.526+0000 7f75b4227640 1 -- 172.21.15.46:0/2195016982 wait complete. 2024-05-09T02:23:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.528+0000 7f75b4227640 1 Processor -- start 2024-05-09T02:23:38.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.528+0000 7f75b4227640 1 -- start start 2024-05-09T02:23:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b4227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac1ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b4227640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75ac151ef0 0x7f75ac156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b4227640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75ac154720 0x7f75ac14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b4227640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac0c55e0 con 0x7f75ac0a91e0 2024-05-09T02:23:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b4227640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac0c5460 con 0x7f75ac151ef0 2024-05-09T02:23:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b4227640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f75ac154b30 con 0x7f75ac154720 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac1ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac1ecb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39400/0 (socket says 172.21.15.46:39400) 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 -- 172.21.15.46:0/2902595227 learned_addr learned my addr 172.21.15.46:0/2902595227 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b17c2640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75ac151ef0 0x7f75ac156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b27c4640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75ac154720 0x7f75ac14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 -- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75ac154720 msgr2=0x7f75ac14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75ac154720 0x7f75ac14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 -- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75ac151ef0 msgr2=0x7f75ac156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75ac151ef0 0x7f75ac156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b1fc3640 1 -- 172.21.15.46:0/2902595227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac1585a0 con 0x7f75ac0a91e0 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.529+0000 7f75b27c4640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75ac154720 0x7f75ac14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.530+0000 7f75b1fc3640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac1ecb30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c390 tx=0x7f75a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.530+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8017070 con 0x7f75ac0a91e0 2024-05-09T02:23:38.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.530+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a80035f0 con 0x7f75ac0a91e0 2024-05-09T02:23:38.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.530+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a80039c0 con 0x7f75ac0a91e0 2024-05-09T02:23:38.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.530+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac1ed070 con 0x7f75ac0a91e0 2024-05-09T02:23:38.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.530+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac1ea340 con 0x7f75ac0a91e0 2024-05-09T02:23:38.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.531+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac06a330 con 0x7f75ac0a91e0 2024-05-09T02:23:38.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.532+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75a801a070 con 0x7f75ac0a91e0 2024-05-09T02:23:38.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.532+0000 7f75a27fc640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7590076300 0x7f7590078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:38.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.532+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f75a8096d90 con 0x7f75ac0a91e0 2024-05-09T02:23:38.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.532+0000 7f75b17c2640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7590076300 0x7f7590078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:38.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.533+0000 7f75b17c2640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7590076300 0x7f7590078810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f759c034000 tx=0x7f759c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.537+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75a805fb80 con 0x7f75ac0a91e0 2024-05-09T02:23:38.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.731+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75ac0730f0 con 0x7f7590076300 2024-05-09T02:23:38.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.743+0000 7f75a27fc640 1 -- 172.21.15.46:0/2902595227 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+491829 (secure 0 0 0) 0x7f75ac0730f0 con 0x7f7590076300 2024-05-09T02:23:38.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:23:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7590076300 msgr2=0x7f7590078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7590076300 0x7f7590078810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f759c034000 tx=0x7f759c02e000 comp rx=0 tx=0).stop 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 msgr2=0x7f75ac1ecb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac1ecb30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c390 tx=0x7f75a800c850 comp rx=0 tx=0).stop 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 shutdown_connections 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f7590076300 0x7f7590078810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f75ac154720 0x7f75ac14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75ac151ef0 0x7f75ac156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 --2- 172.21.15.46:0/2902595227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ac0a91e0 0x7f75ac1ecb30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 >> 172.21.15.46:0/2902595227 conn(0x7f75ac0c5940 msgr2=0x7f75ac0c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 shutdown_connections 2024-05-09T02:23:38.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:38.747+0000 7f75b4227640 1 -- 172.21.15.46:0/2902595227 wait complete. 2024-05-09T02:23:38.762 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-05-09T02:23:38.598165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018636,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":546,"num_read_kb":945,"num_write":18928,"num_write_kb":50333845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18946,"ondisk_log_size":18946,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415408,"kb_used_data":4976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754559312,"statfs":{"total":773094113280,"available":772668735488,"internally_reserved":0,"allocated":5095424,"data_stored":3325928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":420204083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004151"},"pg_stats":[{"pgid":"5.18","version":"32'162","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.553031+0000","last_change":"2024-05-09T02:23:31.553062+0000","last_active":"2024-05-09T02:23:31.553031+0000","last_peered":"2024-05-09T02:23:31.553031+0000","last_clean":"2024-05-09T02:23:31.553031+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:23:31.553031+0000","last_undegraded":"2024-05-09T02:23:31.553031+0000","last_fullsized":"2024-05-09T02:23:31.553031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'162","last_scrub_stamp":"2024-05-09T02:23:31.552921+0000","last_deep_scrub":"32'162","last_deep_scrub_stamp":"2024-05-09T02:23:31.552921+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.552921+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:13.397097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"33'9","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.720026+0000","last_change":"2024-05-09T02:23:19.720059+0000","last_active":"2024-05-09T02:23:19.720026+0000","last_peered":"2024-05-09T02:23:19.720026+0000","last_clean":"2024-05-09T02:23:19.720026+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:23:19.720026+0000","last_undegraded":"2024-05-09T02:23:19.720026+0000","last_fullsized":"2024-05-09T02:23:19.720026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-05-09T02:23:19.719930+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-05-09T02:23:19.719930+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.719930+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:58.886675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'147","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.325356+0000","last_change":"2024-05-09T02:23:25.325386+0000","last_active":"2024-05-09T02:23:25.325356+0000","last_peered":"2024-05-09T02:23:25.325356+0000","last_clean":"2024-05-09T02:23:25.325356+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:23:25.325356+0000","last_undegraded":"2024-05-09T02:23:25.325356+0000","last_fullsized":"2024-05-09T02:23:25.325356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2024-05-09T02:23:25.325246+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2024-05-09T02:23:25.325246+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.325246+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:18.471703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.348714+0000","last_change":"2024-05-09T02:23:17.348737+0000","last_active":"2024-05-09T02:23:17.348714+0000","last_peered":"2024-05-09T02:23:17.348714+0000","last_clean":"2024-05-09T02:23:17.348714+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:23:17.348714+0000","last_undegraded":"2024-05-09T02:23:17.348714+0000","last_fullsized":"2024-05-09T02:23:17.348714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.348621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.348621+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.348621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:10.960779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"32'147","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.735473+0000","last_change":"2024-05-09T02:23:23.735531+0000","last_active":"2024-05-09T02:23:23.735473+0000","last_peered":"2024-05-09T02:23:23.735473+0000","last_clean":"2024-05-09T02:23:23.735473+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:23:23.735473+0000","last_undegraded":"2024-05-09T02:23:23.735473+0000","last_fullsized":"2024-05-09T02:23:23.735473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'147","last_scrub_stamp":"2024-05-09T02:23:23.735357+0000","last_deep_scrub":"32'147","last_deep_scrub_stamp":"2024-05-09T02:23:23.735357+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.735357+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:23.064318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.183172+0000","last_change":"2024-05-09T02:23:32.183214+0000","last_active":"2024-05-09T02:23:32.183172+0000","last_peered":"2024-05-09T02:23:32.183172+0000","last_clean":"2024-05-09T02:23:32.183172+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:23:32.183172+0000","last_undegraded":"2024-05-09T02:23:32.183172+0000","last_fullsized":"2024-05-09T02:23:32.183172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:32.183066+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:32.183066+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.183066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:26.137402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.706501+0000","last_change":"2024-05-09T02:23:14.706526+0000","last_active":"2024-05-09T02:23:14.706501+0000","last_peered":"2024-05-09T02:23:14.706501+0000","last_clean":"2024-05-09T02:23:14.706501+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:23:14.706501+0000","last_undegraded":"2024-05-09T02:23:14.706501+0000","last_fullsized":"2024-05-09T02:23:14.706501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:14.706404+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:14.706404+0000","last_clean_scrub_stamp":"2024-05-09T02:23:14.706404+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:15.880208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.740804+0000","last_change":"2024-05-09T02:23:21.740850+0000","last_active":"2024-05-09T02:23:21.740804+0000","last_peered":"2024-05-09T02:23:21.740804+0000","last_clean":"2024-05-09T02:23:21.740804+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:23:21.740804+0000","last_undegraded":"2024-05-09T02:23:21.740804+0000","last_fullsized":"2024-05-09T02:23:21.740804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:21.740663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:21.740663+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.740663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:17.959617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'123","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.961726+0000","last_change":"2024-05-09T02:18:23.225489+0000","last_active":"2024-05-09T02:23:17.961726+0000","last_peered":"2024-05-09T02:23:17.961726+0000","last_clean":"2024-05-09T02:23:17.961726+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:23:17.961726+0000","last_undegraded":"2024-05-09T02:23:17.961726+0000","last_fullsized":"2024-05-09T02:23:17.961726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"33'5","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.058531+0000","last_change":"2024-05-09T02:23:36.058565+0000","last_active":"2024-05-09T02:23:36.058531+0000","last_peered":"2024-05-09T02:23:36.058531+0000","last_clean":"2024-05-09T02:23:36.058531+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:23:36.058531+0000","last_undegraded":"2024-05-09T02:23:36.058531+0000","last_fullsized":"2024-05-09T02:23:36.058531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-09T02:23:36.058433+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-09T02:23:36.058433+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.058433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:30.658462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'132","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.588072+0000","last_change":"2024-05-09T02:23:34.588105+0000","last_active":"2024-05-09T02:23:34.588072+0000","last_peered":"2024-05-09T02:23:34.588072+0000","last_clean":"2024-05-09T02:23:34.588072+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:23:34.588072+0000","last_undegraded":"2024-05-09T02:23:34.588072+0000","last_fullsized":"2024-05-09T02:23:34.588072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:34.587965+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:34.587965+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.587965+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:32.382529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.725663+0000","last_change":"2024-05-09T02:23:22.725691+0000","last_active":"2024-05-09T02:23:22.725663+0000","last_peered":"2024-05-09T02:23:22.725663+0000","last_clean":"2024-05-09T02:23:22.725663+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:23:22.725663+0000","last_undegraded":"2024-05-09T02:23:22.725663+0000","last_fullsized":"2024-05-09T02:23:22.725663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T02:23:22.725547+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T02:23:22.725547+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.725547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:41.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.621709+0000","last_change":"2024-05-09T02:23:35.621739+0000","last_active":"2024-05-09T02:23:35.621709+0000","last_peered":"2024-05-09T02:23:35.621709+0000","last_clean":"2024-05-09T02:23:35.621709+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:23:35.621709+0000","last_undegraded":"2024-05-09T02:23:35.621709+0000","last_fullsized":"2024-05-09T02:23:35.621709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:35.621607+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:35.621607+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.621607+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:30.221635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.776840+0000","last_change":"2024-05-09T02:18:13.145435+0000","last_active":"2024-05-09T02:23:16.776840+0000","last_peered":"2024-05-09T02:23:16.776840+0000","last_clean":"2024-05-09T02:23:16.776840+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:23:16.776840+0000","last_undegraded":"2024-05-09T02:23:16.776840+0000","last_fullsized":"2024-05-09T02:23:16.776840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'168","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.582207+0000","last_change":"2024-05-09T02:23:32.582235+0000","last_active":"2024-05-09T02:23:32.582207+0000","last_peered":"2024-05-09T02:23:32.582207+0000","last_clean":"2024-05-09T02:23:32.582207+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:23:32.582207+0000","last_undegraded":"2024-05-09T02:23:32.582207+0000","last_fullsized":"2024-05-09T02:23:32.582207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2024-05-09T02:23:32.582096+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2024-05-09T02:23:32.582096+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.582096+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:18.585969+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.724488+0000","last_change":"2024-05-09T02:23:20.724488+0000","last_active":"2024-05-09T02:23:20.724488+0000","last_peered":"2024-05-09T02:23:20.724488+0000","last_clean":"2024-05-09T02:23:20.724488+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:23:20.724488+0000","last_undegraded":"2024-05-09T02:23:20.724488+0000","last_fullsized":"2024-05-09T02:23:20.724488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T02:23:20.724359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T02:23:20.724359+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.724359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:23.322074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.681038+0000","last_change":"2024-05-09T02:23:34.681070+0000","last_active":"2024-05-09T02:23:34.681038+0000","last_peered":"2024-05-09T02:23:34.681038+0000","last_clean":"2024-05-09T02:23:34.681038+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:23:34.681038+0000","last_undegraded":"2024-05-09T02:23:34.681038+0000","last_fullsized":"2024-05-09T02:23:34.681038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:34.680930+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:34.680930+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.680930+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:05.235217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.614867+0000","last_change":"2024-05-09T02:23:18.614913+0000","last_active":"2024-05-09T02:23:18.614867+0000","last_peered":"2024-05-09T02:23:18.614867+0000","last_clean":"2024-05-09T02:23:18.614867+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:23:18.614867+0000","last_undegraded":"2024-05-09T02:23:18.614867+0000","last_fullsized":"2024-05-09T02:23:18.614867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:18.614738+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:18.614738+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.614738+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:54.695345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.037810+0000","last_change":"2024-05-09T02:23:35.037842+0000","last_active":"2024-05-09T02:23:35.037810+0000","last_peered":"2024-05-09T02:23:35.037810+0000","last_clean":"2024-05-09T02:23:35.037810+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:23:35.037810+0000","last_undegraded":"2024-05-09T02:23:35.037810+0000","last_fullsized":"2024-05-09T02:23:35.037810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-05-09T02:23:35.037700+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-05-09T02:23:35.037700+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.037700+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:32.832264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.529780+0000","last_change":"2024-05-09T02:23:30.529849+0000","last_active":"2024-05-09T02:23:30.529780+0000","last_peered":"2024-05-09T02:23:30.529780+0000","last_clean":"2024-05-09T02:23:30.529780+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:23:30.529780+0000","last_undegraded":"2024-05-09T02:23:30.529780+0000","last_fullsized":"2024-05-09T02:23:30.529780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:30.529653+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:30.529653+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.529653+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:32.725129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.375798+0000","last_change":"2024-05-09T02:23:30.375846+0000","last_active":"2024-05-09T02:23:30.375798+0000","last_peered":"2024-05-09T02:23:30.375798+0000","last_clean":"2024-05-09T02:23:30.375798+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:23:30.375798+0000","last_undegraded":"2024-05-09T02:23:30.375798+0000","last_fullsized":"2024-05-09T02:23:30.375798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:30.375683+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:30.375683+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.375683+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:50.437848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'135","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.184660+0000","last_change":"2024-05-09T02:23:33.184694+0000","last_active":"2024-05-09T02:23:33.184660+0000","last_peered":"2024-05-09T02:23:33.184660+0000","last_clean":"2024-05-09T02:23:33.184660+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:23:33.184660+0000","last_undegraded":"2024-05-09T02:23:33.184660+0000","last_fullsized":"2024-05-09T02:23:33.184660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2024-05-09T02:23:33.184543+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2024-05-09T02:23:33.184543+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.184543+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:49.077729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.658756+0000","last_change":"2024-05-09T02:23:30.658808+0000","last_active":"2024-05-09T02:23:30.658756+0000","last_peered":"2024-05-09T02:23:30.658756+0000","last_clean":"2024-05-09T02:23:30.658756+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:23:30.658756+0000","last_undegraded":"2024-05-09T02:23:30.658756+0000","last_fullsized":"2024-05-09T02:23:30.658756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.658639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.658639+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.658639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:05.135226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.771337+0000","last_change":"2024-05-09T02:23:16.771365+0000","last_active":"2024-05-09T02:23:16.771337+0000","last_peered":"2024-05-09T02:23:16.771337+0000","last_clean":"2024-05-09T02:23:16.771337+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:23:16.771337+0000","last_undegraded":"2024-05-09T02:23:16.771337+0000","last_fullsized":"2024-05-09T02:23:16.771337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:16.771184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:16.771184+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.771184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:00.157243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"32'141","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.573501+0000","last_change":"2024-05-09T02:23:32.573532+0000","last_active":"2024-05-09T02:23:32.573501+0000","last_peered":"2024-05-09T02:23:32.573501+0000","last_clean":"2024-05-09T02:23:32.573501+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:23:32.573501+0000","last_undegraded":"2024-05-09T02:23:32.573501+0000","last_fullsized":"2024-05-09T02:23:32.573501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:32.573372+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:32.573372+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.573372+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:57.569794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.985423+0000","last_change":"2024-05-09T02:18:14.148366+0000","last_active":"2024-05-09T02:22:53.985423+0000","last_peered":"2024-05-09T02:22:53.985423+0000","last_clean":"2024-05-09T02:22:53.985423+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:22:53.985423+0000","last_undegraded":"2024-05-09T02:22:53.985423+0000","last_fullsized":"2024-05-09T02:22:53.985423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.713466+0000","last_change":"2024-05-09T02:23:27.713493+0000","last_active":"2024-05-09T02:23:27.713466+0000","last_peered":"2024-05-09T02:23:27.713466+0000","last_clean":"2024-05-09T02:23:27.713466+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:23:27.713466+0000","last_undegraded":"2024-05-09T02:23:27.713466+0000","last_fullsized":"2024-05-09T02:23:27.713466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:27.713363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:27.713363+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.713363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:51.203058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.632072+0000","last_change":"2024-05-09T02:23:19.632109+0000","last_active":"2024-05-09T02:23:19.632072+0000","last_peered":"2024-05-09T02:23:19.632072+0000","last_clean":"2024-05-09T02:23:19.632072+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:23:19.632072+0000","last_undegraded":"2024-05-09T02:23:19.632072+0000","last_fullsized":"2024-05-09T02:23:19.632072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:19.631974+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:19.631974+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.631974+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:38.690659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'129","reported_seq":159,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.600956+0000","last_change":"2024-05-09T02:18:23.211769+0000","last_active":"2024-05-09T02:22:56.600956+0000","last_peered":"2024-05-09T02:22:56.600956+0000","last_clean":"2024-05-09T02:22:56.600956+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:22:56.600956+0000","last_undegraded":"2024-05-09T02:22:56.600956+0000","last_fullsized":"2024-05-09T02:22:56.600956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'132","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.605560+0000","last_change":"2024-05-09T02:23:28.605615+0000","last_active":"2024-05-09T02:23:28.605560+0000","last_peered":"2024-05-09T02:23:28.605560+0000","last_clean":"2024-05-09T02:23:28.605560+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:23:28.605560+0000","last_undegraded":"2024-05-09T02:23:28.605560+0000","last_fullsized":"2024-05-09T02:23:28.605560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:28.605430+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:28.605430+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.605430+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:53.824976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.018678+0000","last_change":"2024-05-09T02:23:33.018703+0000","last_active":"2024-05-09T02:23:33.018678+0000","last_peered":"2024-05-09T02:23:33.018678+0000","last_clean":"2024-05-09T02:23:33.018678+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:23:33.018678+0000","last_undegraded":"2024-05-09T02:23:33.018678+0000","last_fullsized":"2024-05-09T02:23:33.018678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:33.018563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:33.018563+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.018563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:19.022436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'3","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.690877+0000","last_change":"2024-05-09T02:23:19.690931+0000","last_active":"2024-05-09T02:23:19.690877+0000","last_peered":"2024-05-09T02:23:19.690877+0000","last_clean":"2024-05-09T02:23:19.690877+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:23:19.690877+0000","last_undegraded":"2024-05-09T02:23:19.690877+0000","last_fullsized":"2024-05-09T02:23:19.690877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:19.690785+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:19.690785+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.690785+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:46.749852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"32'123","reported_seq":153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.984247+0000","last_change":"2024-05-09T02:18:23.220829+0000","last_active":"2024-05-09T02:22:53.984247+0000","last_peered":"2024-05-09T02:22:53.984247+0000","last_clean":"2024-05-09T02:22:53.984247+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:22:53.984247+0000","last_undegraded":"2024-05-09T02:22:53.984247+0000","last_fullsized":"2024-05-09T02:22:53.984247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'156","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.655546+0000","last_change":"2024-05-09T02:23:25.655585+0000","last_active":"2024-05-09T02:23:25.655546+0000","last_peered":"2024-05-09T02:23:25.655546+0000","last_clean":"2024-05-09T02:23:25.655546+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:23:25.655546+0000","last_undegraded":"2024-05-09T02:23:25.655546+0000","last_fullsized":"2024-05-09T02:23:25.655546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2024-05-09T02:23:25.655433+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2024-05-09T02:23:25.655433+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.655433+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:32.787111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.651689+0000","last_change":"2024-05-09T02:23:24.651719+0000","last_active":"2024-05-09T02:23:24.651689+0000","last_peered":"2024-05-09T02:23:24.651689+0000","last_clean":"2024-05-09T02:23:24.651689+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:23:24.651689+0000","last_undegraded":"2024-05-09T02:23:24.651689+0000","last_fullsized":"2024-05-09T02:23:24.651689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:24.651595+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:24.651595+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.651595+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:20.870550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'7","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.564573+0000","last_change":"2024-05-09T02:23:29.564626+0000","last_active":"2024-05-09T02:23:29.564573+0000","last_peered":"2024-05-09T02:23:29.564573+0000","last_clean":"2024-05-09T02:23:29.564573+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:23:29.564573+0000","last_undegraded":"2024-05-09T02:23:29.564573+0000","last_fullsized":"2024-05-09T02:23:29.564573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-09T02:23:29.564446+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-09T02:23:29.564446+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.564446+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:54.204411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"32'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.614870+0000","last_change":"2024-05-09T02:23:35.614952+0000","last_active":"2024-05-09T02:23:35.614870+0000","last_peered":"2024-05-09T02:23:35.614870+0000","last_clean":"2024-05-09T02:23:35.614870+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:23:35.614870+0000","last_undegraded":"2024-05-09T02:23:35.614870+0000","last_fullsized":"2024-05-09T02:23:35.614870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:35.614737+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:35.614737+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.614737+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:10.091325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.232314+0000","last_change":"2024-05-09T02:23:27.232362+0000","last_active":"2024-05-09T02:23:27.232314+0000","last_peered":"2024-05-09T02:23:27.232314+0000","last_clean":"2024-05-09T02:23:27.232314+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:23:27.232314+0000","last_undegraded":"2024-05-09T02:23:27.232314+0000","last_fullsized":"2024-05-09T02:23:27.232314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:27.232191+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:27.232191+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.232191+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:40.601131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'21","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.669157+0000","last_change":"2024-05-09T02:23:25.669201+0000","last_active":"2024-05-09T02:23:25.669157+0000","last_peered":"2024-05-09T02:23:25.669157+0000","last_clean":"2024-05-09T02:23:25.669157+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:23:25.669157+0000","last_undegraded":"2024-05-09T02:23:25.669157+0000","last_fullsized":"2024-05-09T02:23:25.669157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-05-09T02:23:25.669041+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-05-09T02:23:25.669041+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.669041+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:50.309007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.356894+0000","last_change":"2024-05-09T02:23:24.356967+0000","last_active":"2024-05-09T02:23:24.356894+0000","last_peered":"2024-05-09T02:23:24.356894+0000","last_clean":"2024-05-09T02:23:24.356894+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:23:24.356894+0000","last_undegraded":"2024-05-09T02:23:24.356894+0000","last_fullsized":"2024-05-09T02:23:24.356894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:24.356774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:24.356774+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.356774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:14.905536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'150","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.475506+0000","last_change":"2024-05-09T02:23:33.475538+0000","last_active":"2024-05-09T02:23:33.475506+0000","last_peered":"2024-05-09T02:23:33.475506+0000","last_clean":"2024-05-09T02:23:33.475506+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:23:33.475506+0000","last_undegraded":"2024-05-09T02:23:33.475506+0000","last_fullsized":"2024-05-09T02:23:33.475506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'150","last_scrub_stamp":"2024-05-09T02:23:33.475389+0000","last_deep_scrub":"32'150","last_deep_scrub_stamp":"2024-05-09T02:23:33.475389+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.475389+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:15.319566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"31'135","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.672905+0000","last_change":"2024-05-09T02:23:20.672933+0000","last_active":"2024-05-09T02:23:20.672905+0000","last_peered":"2024-05-09T02:23:20.672905+0000","last_clean":"2024-05-09T02:23:20.672905+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:23:20.672905+0000","last_undegraded":"2024-05-09T02:23:20.672905+0000","last_fullsized":"2024-05-09T02:23:20.672905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2024-05-09T02:23:20.672790+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2024-05-09T02:23:20.672790+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.672790+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:48.573682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.998725+0000","last_change":"2024-05-09T02:23:33.998750+0000","last_active":"2024-05-09T02:23:33.998725+0000","last_peered":"2024-05-09T02:23:33.998725+0000","last_clean":"2024-05-09T02:23:33.998725+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:23:33.998725+0000","last_undegraded":"2024-05-09T02:23:33.998725+0000","last_fullsized":"2024-05-09T02:23:33.998725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:33.998612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:33.998612+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.998612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:24.661498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.750006+0000","last_change":"2024-05-09T02:23:17.750053+0000","last_active":"2024-05-09T02:23:17.750006+0000","last_peered":"2024-05-09T02:23:17.750006+0000","last_clean":"2024-05-09T02:23:17.750006+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:23:17.750006+0000","last_undegraded":"2024-05-09T02:23:17.750006+0000","last_fullsized":"2024-05-09T02:23:17.750006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.749896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.749896+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.749896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:39.044135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'138","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.602071+0000","last_change":"2024-05-09T02:23:31.602103+0000","last_active":"2024-05-09T02:23:31.602071+0000","last_peered":"2024-05-09T02:23:31.602071+0000","last_clean":"2024-05-09T02:23:31.602071+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:23:31.602071+0000","last_undegraded":"2024-05-09T02:23:31.602071+0000","last_fullsized":"2024-05-09T02:23:31.602071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:31.601959+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:31.601959+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.601959+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:56.598381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.694439+0000","last_change":"2024-05-09T02:23:18.694472+0000","last_active":"2024-05-09T02:23:18.694439+0000","last_peered":"2024-05-09T02:23:18.694439+0000","last_clean":"2024-05-09T02:23:18.694439+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:23:18.694439+0000","last_undegraded":"2024-05-09T02:23:18.694439+0000","last_fullsized":"2024-05-09T02:23:18.694439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:18.694336+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:18.694336+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.694336+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:51.329288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.689063+0000","last_change":"2024-05-09T02:23:28.689089+0000","last_active":"2024-05-09T02:23:28.689063+0000","last_peered":"2024-05-09T02:23:28.689063+0000","last_clean":"2024-05-09T02:23:28.689063+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:23:28.689063+0000","last_undegraded":"2024-05-09T02:23:28.689063+0000","last_fullsized":"2024-05-09T02:23:28.689063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:28.688956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:28.688956+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.688956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:19.237718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.611732+0000","last_change":"2024-05-09T02:23:17.611754+0000","last_active":"2024-05-09T02:23:17.611732+0000","last_peered":"2024-05-09T02:23:17.611732+0000","last_clean":"2024-05-09T02:23:17.611732+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:23:17.611732+0000","last_undegraded":"2024-05-09T02:23:17.611732+0000","last_fullsized":"2024-05-09T02:23:17.611732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.611635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.611635+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.611635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:20.209350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'138","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.635303+0000","last_change":"2024-05-09T02:23:34.635332+0000","last_active":"2024-05-09T02:23:34.635303+0000","last_peered":"2024-05-09T02:23:34.635303+0000","last_clean":"2024-05-09T02:23:34.635303+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:23:34.635303+0000","last_undegraded":"2024-05-09T02:23:34.635303+0000","last_fullsized":"2024-05-09T02:23:34.635303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:34.635179+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:34.635179+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.635179+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:09.111766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'138","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.649295+0000","last_change":"2024-05-09T02:23:24.649323+0000","last_active":"2024-05-09T02:23:24.649295+0000","last_peered":"2024-05-09T02:23:24.649295+0000","last_clean":"2024-05-09T02:23:24.649295+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:23:24.649295+0000","last_undegraded":"2024-05-09T02:23:24.649295+0000","last_fullsized":"2024-05-09T02:23:24.649295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:24.649184+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:24.649184+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.649184+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:05.574640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.629699+0000","last_change":"2024-05-09T02:23:30.629726+0000","last_active":"2024-05-09T02:23:30.629699+0000","last_peered":"2024-05-09T02:23:30.629699+0000","last_clean":"2024-05-09T02:23:30.629699+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:23:30.629699+0000","last_undegraded":"2024-05-09T02:23:30.629699+0000","last_fullsized":"2024-05-09T02:23:30.629699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.629594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.629594+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.629594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:08.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.568267+0000","last_change":"2024-05-09T02:23:16.568296+0000","last_active":"2024-05-09T02:23:16.568267+0000","last_peered":"2024-05-09T02:23:16.568267+0000","last_clean":"2024-05-09T02:23:16.568267+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:23:16.568267+0000","last_undegraded":"2024-05-09T02:23:16.568267+0000","last_fullsized":"2024-05-09T02:23:16.568267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:16.568139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:16.568139+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.568139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:43.627206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"32'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.342587+0000","last_change":"2024-05-09T02:23:28.342617+0000","last_active":"2024-05-09T02:23:28.342587+0000","last_peered":"2024-05-09T02:23:28.342587+0000","last_clean":"2024-05-09T02:23:28.342587+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:23:28.342587+0000","last_undegraded":"2024-05-09T02:23:28.342587+0000","last_fullsized":"2024-05-09T02:23:28.342587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'156","last_scrub_stamp":"2024-05-09T02:23:28.342476+0000","last_deep_scrub":"32'156","last_deep_scrub_stamp":"2024-05-09T02:23:28.342476+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.342476+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:49.882581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.650866+0000","last_change":"2024-05-09T02:23:18.650894+0000","last_active":"2024-05-09T02:23:18.650866+0000","last_peered":"2024-05-09T02:23:18.650866+0000","last_clean":"2024-05-09T02:23:18.650866+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:23:18.650866+0000","last_undegraded":"2024-05-09T02:23:18.650866+0000","last_fullsized":"2024-05-09T02:23:18.650866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:18.650744+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:18.650744+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.650744+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:14.869698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'7","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.232534+0000","last_change":"2024-05-09T02:23:20.232577+0000","last_active":"2024-05-09T02:23:20.232534+0000","last_peered":"2024-05-09T02:23:20.232534+0000","last_clean":"2024-05-09T02:23:20.232534+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:23:20.232534+0000","last_undegraded":"2024-05-09T02:23:20.232534+0000","last_fullsized":"2024-05-09T02:23:20.232534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-09T02:23:20.232407+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-09T02:23:20.232407+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.232407+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:21.406211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.575848+0000","last_change":"2024-05-09T02:23:15.575875+0000","last_active":"2024-05-09T02:23:15.575848+0000","last_peered":"2024-05-09T02:23:15.575848+0000","last_clean":"2024-05-09T02:23:15.575848+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:23:15.575848+0000","last_undegraded":"2024-05-09T02:23:15.575848+0000","last_fullsized":"2024-05-09T02:23:15.575848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:15.575763+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:15.575763+0000","last_clean_scrub_stamp":"2024-05-09T02:23:15.575763+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:36.158577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.699777+0000","last_change":"2024-05-09T02:23:25.699855+0000","last_active":"2024-05-09T02:23:25.699777+0000","last_peered":"2024-05-09T02:23:25.699777+0000","last_clean":"2024-05-09T02:23:25.699777+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:23:25.699777+0000","last_undegraded":"2024-05-09T02:23:25.699777+0000","last_fullsized":"2024-05-09T02:23:25.699777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:25.699656+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:25.699656+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.699656+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:30.113263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"31'126","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.705583+0000","last_change":"2024-05-09T02:23:21.705638+0000","last_active":"2024-05-09T02:23:21.705583+0000","last_peered":"2024-05-09T02:23:21.705583+0000","last_clean":"2024-05-09T02:23:21.705583+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:23:21.705583+0000","last_undegraded":"2024-05-09T02:23:21.705583+0000","last_fullsized":"2024-05-09T02:23:21.705583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:21.705409+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:21.705409+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.705409+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:06.714013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.978043+0000","last_change":"2024-05-09T02:18:13.148167+0000","last_active":"2024-05-09T02:22:53.978043+0000","last_peered":"2024-05-09T02:22:53.978043+0000","last_clean":"2024-05-09T02:22:53.978043+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:22:53.978043+0000","last_undegraded":"2024-05-09T02:22:53.978043+0000","last_fullsized":"2024-05-09T02:22:53.978043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:12.114146+0000","last_clean_scrub_stamp":"2024-05-09T02:18:12.114146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'22","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.568430+0000","last_change":"2024-05-09T02:23:30.568467+0000","last_active":"2024-05-09T02:23:30.568430+0000","last_peered":"2024-05-09T02:23:30.568430+0000","last_clean":"2024-05-09T02:23:30.568430+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:23:30.568430+0000","last_undegraded":"2024-05-09T02:23:30.568430+0000","last_fullsized":"2024-05-09T02:23:30.568430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-09T02:23:30.568314+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-09T02:23:30.568314+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.568314+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:12.412491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'135","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.026259+0000","last_change":"2024-05-09T02:23:26.026290+0000","last_active":"2024-05-09T02:23:26.026259+0000","last_peered":"2024-05-09T02:23:26.026259+0000","last_clean":"2024-05-09T02:23:26.026259+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:23:26.026259+0000","last_undegraded":"2024-05-09T02:23:26.026259+0000","last_fullsized":"2024-05-09T02:23:26.026259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'135","last_scrub_stamp":"2024-05-09T02:23:26.026153+0000","last_deep_scrub":"32'135","last_deep_scrub_stamp":"2024-05-09T02:23:26.026153+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.026153+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:30.439760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'150","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.330870+0000","last_change":"2024-05-09T02:23:21.330933+0000","last_active":"2024-05-09T02:23:21.330870+0000","last_peered":"2024-05-09T02:23:21.330870+0000","last_clean":"2024-05-09T02:23:21.330870+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:23:21.330870+0000","last_undegraded":"2024-05-09T02:23:21.330870+0000","last_fullsized":"2024-05-09T02:23:21.330870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2024-05-09T02:23:21.330750+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2024-05-09T02:23:21.330750+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.330750+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:23.526226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.611129+0000","last_change":"2024-05-09T02:23:27.611159+0000","last_active":"2024-05-09T02:23:27.611129+0000","last_peered":"2024-05-09T02:23:27.611129+0000","last_clean":"2024-05-09T02:23:27.611129+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:23:27.611129+0000","last_undegraded":"2024-05-09T02:23:27.611129+0000","last_fullsized":"2024-05-09T02:23:27.611129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:27.611013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:27.611013+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.611013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:17.386612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.053099+0000","last_change":"2024-05-09T02:23:32.053193+0000","last_active":"2024-05-09T02:23:32.053099+0000","last_peered":"2024-05-09T02:23:32.053099+0000","last_clean":"2024-05-09T02:23:32.053099+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:23:32.053099+0000","last_undegraded":"2024-05-09T02:23:32.053099+0000","last_fullsized":"2024-05-09T02:23:32.053099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-05-09T02:23:32.052980+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-05-09T02:23:32.052980+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.052980+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:28.069653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.556517+0000","last_change":"2024-05-09T02:23:29.556546+0000","last_active":"2024-05-09T02:23:29.556517+0000","last_peered":"2024-05-09T02:23:29.556517+0000","last_clean":"2024-05-09T02:23:29.556517+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:23:29.556517+0000","last_undegraded":"2024-05-09T02:23:29.556517+0000","last_fullsized":"2024-05-09T02:23:29.556517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:29.556411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:29.556411+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.556411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:53.602152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"32'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.247355+0000","last_change":"2024-05-09T02:23:25.247398+0000","last_active":"2024-05-09T02:23:25.247355+0000","last_peered":"2024-05-09T02:23:25.247355+0000","last_clean":"2024-05-09T02:23:25.247355+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:23:25.247355+0000","last_undegraded":"2024-05-09T02:23:25.247355+0000","last_fullsized":"2024-05-09T02:23:25.247355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'135","last_scrub_stamp":"2024-05-09T02:23:25.247234+0000","last_deep_scrub":"32'135","last_deep_scrub_stamp":"2024-05-09T02:23:25.247234+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.247234+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:04.413980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.979835+0000","last_change":"2024-05-09T02:23:20.979869+0000","last_active":"2024-05-09T02:23:20.979835+0000","last_peered":"2024-05-09T02:23:20.979835+0000","last_clean":"2024-05-09T02:23:20.979835+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:23:20.979835+0000","last_undegraded":"2024-05-09T02:23:20.979835+0000","last_fullsized":"2024-05-09T02:23:20.979835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:20.979724+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:20.979724+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.979724+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:14.591883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.203297+0000","last_change":"2024-05-09T02:23:18.203321+0000","last_active":"2024-05-09T02:23:18.203297+0000","last_peered":"2024-05-09T02:23:18.203297+0000","last_clean":"2024-05-09T02:23:18.203297+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:23:18.203297+0000","last_undegraded":"2024-05-09T02:23:18.203297+0000","last_fullsized":"2024-05-09T02:23:18.203297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:18.203206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:18.203206+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.203206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:57.469982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.517093+0000","last_change":"2024-05-09T02:23:30.517126+0000","last_active":"2024-05-09T02:23:30.517093+0000","last_peered":"2024-05-09T02:23:30.517093+0000","last_clean":"2024-05-09T02:23:30.517093+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:23:30.517093+0000","last_undegraded":"2024-05-09T02:23:30.517093+0000","last_fullsized":"2024-05-09T02:23:30.517093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.516987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.516987+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.516987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:19.076365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"32'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.224847+0000","last_change":"2024-05-09T02:23:16.224895+0000","last_active":"2024-05-09T02:23:16.224847+0000","last_peered":"2024-05-09T02:23:16.224847+0000","last_clean":"2024-05-09T02:23:16.224847+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:23:16.224847+0000","last_undegraded":"2024-05-09T02:23:16.224847+0000","last_fullsized":"2024-05-09T02:23:16.224847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:16.224705+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:16.224705+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.224705+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:35.610074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'138","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.363335+0000","last_change":"2024-05-09T02:23:33.363422+0000","last_active":"2024-05-09T02:23:33.363335+0000","last_peered":"2024-05-09T02:23:33.363335+0000","last_clean":"2024-05-09T02:23:33.363335+0000","last_became_active":"2024-05-09T02:18:55.756398+0000","last_became_peered":"2024-05-09T02:18:55.756398+0000","last_unstale":"2024-05-09T02:23:33.363335+0000","last_undegraded":"2024-05-09T02:23:33.363335+0000","last_fullsized":"2024-05-09T02:23:33.363335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:33.363198+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:33.363198+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.363198+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:58.582744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"33'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.703692+0000","last_change":"2024-05-09T02:23:29.703769+0000","last_active":"2024-05-09T02:23:29.703692+0000","last_peered":"2024-05-09T02:23:29.703692+0000","last_clean":"2024-05-09T02:23:29.703692+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:23:29.703692+0000","last_undegraded":"2024-05-09T02:23:29.703692+0000","last_fullsized":"2024-05-09T02:23:29.703692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:29.703566+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:29.703566+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.703566+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:22.850023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'8","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.575575+0000","last_change":"2024-05-09T02:23:29.575604+0000","last_active":"2024-05-09T02:23:29.575575+0000","last_peered":"2024-05-09T02:23:29.575575+0000","last_clean":"2024-05-09T02:23:29.575575+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:23:29.575575+0000","last_undegraded":"2024-05-09T02:23:29.575575+0000","last_fullsized":"2024-05-09T02:23:29.575575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-05-09T02:23:29.575478+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-05-09T02:23:29.575478+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.575478+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:31.770954+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"32'132","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976609+0000","last_change":"2024-05-09T02:18:23.224526+0000","last_active":"2024-05-09T02:22:53.976609+0000","last_peered":"2024-05-09T02:22:53.976609+0000","last_clean":"2024-05-09T02:22:53.976609+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:22:53.976609+0000","last_undegraded":"2024-05-09T02:22:53.976609+0000","last_fullsized":"2024-05-09T02:22:53.976609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.027297+0000","last_change":"2024-05-09T02:23:22.027347+0000","last_active":"2024-05-09T02:23:22.027297+0000","last_peered":"2024-05-09T02:23:22.027297+0000","last_clean":"2024-05-09T02:23:22.027297+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:23:22.027297+0000","last_undegraded":"2024-05-09T02:23:22.027297+0000","last_fullsized":"2024-05-09T02:23:22.027297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:22.027134+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:22.027134+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.027134+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:21.356095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'3","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.225426+0000","last_change":"2024-05-09T02:23:21.225464+0000","last_active":"2024-05-09T02:23:21.225426+0000","last_peered":"2024-05-09T02:23:21.225426+0000","last_clean":"2024-05-09T02:23:21.225426+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:23:21.225426+0000","last_undegraded":"2024-05-09T02:23:21.225426+0000","last_fullsized":"2024-05-09T02:23:21.225426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:21.225323+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:21.225323+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.225323+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:10.505514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.699839+0000","last_change":"2024-05-09T02:23:19.699866+0000","last_active":"2024-05-09T02:23:19.699839+0000","last_peered":"2024-05-09T02:23:19.699839+0000","last_clean":"2024-05-09T02:23:19.699839+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:23:19.699839+0000","last_undegraded":"2024-05-09T02:23:19.699839+0000","last_fullsized":"2024-05-09T02:23:19.699839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:19.699736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:19.699736+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.699736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:04.306690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.250701+0000","last_change":"2024-05-09T02:23:17.250726+0000","last_active":"2024-05-09T02:23:17.250701+0000","last_peered":"2024-05-09T02:23:17.250701+0000","last_clean":"2024-05-09T02:23:17.250701+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:23:17.250701+0000","last_undegraded":"2024-05-09T02:23:17.250701+0000","last_fullsized":"2024-05-09T02:23:17.250701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:17.250603+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:17.250603+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.250603+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:48:29.937306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'141","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.987173+0000","last_change":"2024-05-09T02:23:22.987227+0000","last_active":"2024-05-09T02:23:22.987173+0000","last_peered":"2024-05-09T02:23:22.987173+0000","last_clean":"2024-05-09T02:23:22.987173+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:23:22.987173+0000","last_undegraded":"2024-05-09T02:23:22.987173+0000","last_fullsized":"2024-05-09T02:23:22.987173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:22.987025+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:22.987025+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.987025+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:48.206571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'2","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.689309+0000","last_change":"2024-05-09T02:23:23.689342+0000","last_active":"2024-05-09T02:23:23.689309+0000","last_peered":"2024-05-09T02:23:23.689309+0000","last_clean":"2024-05-09T02:23:23.689309+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:23:23.689309+0000","last_undegraded":"2024-05-09T02:23:23.689309+0000","last_fullsized":"2024-05-09T02:23:23.689309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:23.689222+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:23.689222+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.689222+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:51.590114+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.773918+0000","last_change":"2024-05-09T02:23:17.773960+0000","last_active":"2024-05-09T02:23:17.773918+0000","last_peered":"2024-05-09T02:23:17.773918+0000","last_clean":"2024-05-09T02:23:17.773918+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:23:17.773918+0000","last_undegraded":"2024-05-09T02:23:17.773918+0000","last_fullsized":"2024-05-09T02:23:17.773918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.773807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.773807+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.773807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:33.459440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.982951+0000","last_change":"2024-05-09T02:18:23.220785+0000","last_active":"2024-05-09T02:23:15.982951+0000","last_peered":"2024-05-09T02:23:15.982951+0000","last_clean":"2024-05-09T02:23:15.982951+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:23:15.982951+0000","last_undegraded":"2024-05-09T02:23:15.982951+0000","last_fullsized":"2024-05-09T02:23:15.982951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'183","reported_seq":230,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.061173+0000","last_change":"2024-05-09T02:23:27.061201+0000","last_active":"2024-05-09T02:23:27.061173+0000","last_peered":"2024-05-09T02:23:27.061173+0000","last_clean":"2024-05-09T02:23:27.061173+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:23:27.061173+0000","last_undegraded":"2024-05-09T02:23:27.061173+0000","last_fullsized":"2024-05-09T02:23:27.061173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'183","last_scrub_stamp":"2024-05-09T02:23:27.061064+0000","last_deep_scrub":"31'183","last_deep_scrub_stamp":"2024-05-09T02:23:27.061064+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.061064+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:50.550759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'13","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.246659+0000","last_change":"2024-05-09T02:23:19.246696+0000","last_active":"2024-05-09T02:23:19.246659+0000","last_peered":"2024-05-09T02:23:19.246659+0000","last_clean":"2024-05-09T02:23:19.246659+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:23:19.246659+0000","last_undegraded":"2024-05-09T02:23:19.246659+0000","last_fullsized":"2024-05-09T02:23:19.246659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-09T02:23:19.246557+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-09T02:23:19.246557+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.246557+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:47.440976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.619072+0000","last_change":"2024-05-09T02:23:28.619100+0000","last_active":"2024-05-09T02:23:28.619072+0000","last_peered":"2024-05-09T02:23:28.619072+0000","last_clean":"2024-05-09T02:23:28.619072+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:23:28.619072+0000","last_undegraded":"2024-05-09T02:23:28.619072+0000","last_fullsized":"2024-05-09T02:23:28.619072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:28.618963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:28.618963+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.618963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:53.258928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"32'219","reported_seq":249,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.603828+0000","last_change":"2024-05-09T02:18:23.219421+0000","last_active":"2024-05-09T02:23:16.603828+0000","last_peered":"2024-05-09T02:23:16.603828+0000","last_clean":"2024-05-09T02:23:16.603828+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:23:16.603828+0000","last_undegraded":"2024-05-09T02:23:16.603828+0000","last_fullsized":"2024-05-09T02:23:16.603828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'159","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.587657+0000","last_change":"2024-05-09T02:23:27.587712+0000","last_active":"2024-05-09T02:23:27.587657+0000","last_peered":"2024-05-09T02:23:27.587657+0000","last_clean":"2024-05-09T02:23:27.587657+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:23:27.587657+0000","last_undegraded":"2024-05-09T02:23:27.587657+0000","last_fullsized":"2024-05-09T02:23:27.587657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'159","last_scrub_stamp":"2024-05-09T02:23:27.587524+0000","last_deep_scrub":"31'159","last_deep_scrub_stamp":"2024-05-09T02:23:27.587524+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.587524+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:47.649689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.636559+0000","last_change":"2024-05-09T02:23:22.636616+0000","last_active":"2024-05-09T02:23:22.636559+0000","last_peered":"2024-05-09T02:23:22.636559+0000","last_clean":"2024-05-09T02:23:22.636559+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:23:22.636559+0000","last_undegraded":"2024-05-09T02:23:22.636559+0000","last_fullsized":"2024-05-09T02:23:22.636559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:22.636406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:22.636406+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.636406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:01.803152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.373584+0000","last_change":"2024-05-09T02:23:22.373614+0000","last_active":"2024-05-09T02:23:22.373584+0000","last_peered":"2024-05-09T02:23:22.373584+0000","last_clean":"2024-05-09T02:23:22.373584+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:23:22.373584+0000","last_undegraded":"2024-05-09T02:23:22.373584+0000","last_fullsized":"2024-05-09T02:23:22.373584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T02:23:22.373470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T02:23:22.373470+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.373470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:04.217646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"32'144","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.603791+0000","last_change":"2024-05-09T02:18:23.216402+0000","last_active":"2024-05-09T02:23:16.603791+0000","last_peered":"2024-05-09T02:23:16.603791+0000","last_clean":"2024-05-09T02:23:16.603791+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:23:16.603791+0000","last_undegraded":"2024-05-09T02:23:16.603791+0000","last_fullsized":"2024-05-09T02:23:16.603791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'156","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.994627+0000","last_change":"2024-05-09T02:23:23.994658+0000","last_active":"2024-05-09T02:23:23.994627+0000","last_peered":"2024-05-09T02:23:23.994627+0000","last_clean":"2024-05-09T02:23:23.994627+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:23:23.994627+0000","last_undegraded":"2024-05-09T02:23:23.994627+0000","last_fullsized":"2024-05-09T02:23:23.994627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2024-05-09T02:23:23.994520+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2024-05-09T02:23:23.994520+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.994520+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:48.634485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.614316+0000","last_change":"2024-05-09T02:23:31.614343+0000","last_active":"2024-05-09T02:23:31.614316+0000","last_peered":"2024-05-09T02:23:31.614316+0000","last_clean":"2024-05-09T02:23:31.614316+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:23:31.614316+0000","last_undegraded":"2024-05-09T02:23:31.614316+0000","last_fullsized":"2024-05-09T02:23:31.614316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:31.614214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:31.614214+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.614214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:27.630887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'113","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.356282+0000","last_change":"2024-05-09T02:23:18.356318+0000","last_active":"2024-05-09T02:23:18.356282+0000","last_peered":"2024-05-09T02:23:18.356282+0000","last_clean":"2024-05-09T02:23:18.356282+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:23:18.356282+0000","last_undegraded":"2024-05-09T02:23:18.356282+0000","last_fullsized":"2024-05-09T02:23:18.356282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'113","last_scrub_stamp":"2024-05-09T02:23:18.356179+0000","last_deep_scrub":"33'113","last_deep_scrub_stamp":"2024-05-09T02:23:18.356179+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.356179+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:42.401921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":214,"num_write":106,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577290+0000","last_change":"2024-05-09T02:18:23.219747+0000","last_active":"2024-05-09T02:23:06.577290+0000","last_peered":"2024-05-09T02:23:06.577290+0000","last_clean":"2024-05-09T02:23:06.577290+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:23:06.577290+0000","last_undegraded":"2024-05-09T02:23:06.577290+0000","last_fullsized":"2024-05-09T02:23:06.577290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'148","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.748772+0000","last_change":"2024-05-09T02:23:15.748796+0000","last_active":"2024-05-09T02:23:15.748772+0000","last_peered":"2024-05-09T02:23:15.748772+0000","last_clean":"2024-05-09T02:23:15.748772+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:23:15.748772+0000","last_undegraded":"2024-05-09T02:23:15.748772+0000","last_fullsized":"2024-05-09T02:23:15.748772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2024-05-09T02:23:15.748682+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2024-05-09T02:23:15.748682+0000","last_clean_scrub_stamp":"2024-05-09T02:23:15.748682+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:05.028873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.689394+0000","last_change":"2024-05-09T02:23:20.689431+0000","last_active":"2024-05-09T02:23:20.689394+0000","last_peered":"2024-05-09T02:23:20.689394+0000","last_clean":"2024-05-09T02:23:20.689394+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:23:20.689394+0000","last_undegraded":"2024-05-09T02:23:20.689394+0000","last_fullsized":"2024-05-09T02:23:20.689394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:20.689279+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:20.689279+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.689279+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:23.286994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.692640+0000","last_change":"2024-05-09T02:23:21.692681+0000","last_active":"2024-05-09T02:23:21.692640+0000","last_peered":"2024-05-09T02:23:21.692640+0000","last_clean":"2024-05-09T02:23:21.692640+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:23:21.692640+0000","last_undegraded":"2024-05-09T02:23:21.692640+0000","last_fullsized":"2024-05-09T02:23:21.692640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-05-09T02:23:21.692535+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-05-09T02:23:21.692535+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.692535+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:21.021496+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"32'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.214337+0000","last_change":"2024-05-09T02:23:28.214371+0000","last_active":"2024-05-09T02:23:28.214337+0000","last_peered":"2024-05-09T02:23:28.214337+0000","last_clean":"2024-05-09T02:23:28.214337+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:23:28.214337+0000","last_undegraded":"2024-05-09T02:23:28.214337+0000","last_fullsized":"2024-05-09T02:23:28.214337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'156","last_scrub_stamp":"2024-05-09T02:23:28.214219+0000","last_deep_scrub":"32'156","last_deep_scrub_stamp":"2024-05-09T02:23:28.214219+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.214219+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:34.270151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.905070+0000","last_change":"2024-05-09T02:23:18.905104+0000","last_active":"2024-05-09T02:23:18.905070+0000","last_peered":"2024-05-09T02:23:18.905070+0000","last_clean":"2024-05-09T02:23:18.905070+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:23:18.905070+0000","last_undegraded":"2024-05-09T02:23:18.905070+0000","last_fullsized":"2024-05-09T02:23:18.905070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:18.904967+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:18.904967+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.904967+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:51.539919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'113","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.649720+0000","last_change":"2024-05-09T02:23:25.649756+0000","last_active":"2024-05-09T02:23:25.649720+0000","last_peered":"2024-05-09T02:23:25.649720+0000","last_clean":"2024-05-09T02:23:25.649720+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:23:25.649720+0000","last_undegraded":"2024-05-09T02:23:25.649720+0000","last_fullsized":"2024-05-09T02:23:25.649720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'113","last_scrub_stamp":"2024-05-09T02:23:25.649604+0000","last_deep_scrub":"33'113","last_deep_scrub_stamp":"2024-05-09T02:23:25.649604+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.649604+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:47.189710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":234,"num_write":106,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.719740+0000","last_change":"2024-05-09T02:23:21.719796+0000","last_active":"2024-05-09T02:23:21.719740+0000","last_peered":"2024-05-09T02:23:21.719740+0000","last_clean":"2024-05-09T02:23:21.719740+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:23:21.719740+0000","last_undegraded":"2024-05-09T02:23:21.719740+0000","last_fullsized":"2024-05-09T02:23:21.719740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:21.719619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:21.719619+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.719619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:02.645075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"32'148","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.662725+0000","last_change":"2024-05-09T02:23:33.662790+0000","last_active":"2024-05-09T02:23:33.662725+0000","last_peered":"2024-05-09T02:23:33.662725+0000","last_clean":"2024-05-09T02:23:33.662725+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:23:33.662725+0000","last_undegraded":"2024-05-09T02:23:33.662725+0000","last_fullsized":"2024-05-09T02:23:33.662725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'148","last_scrub_stamp":"2024-05-09T02:23:33.662595+0000","last_deep_scrub":"32'148","last_deep_scrub_stamp":"2024-05-09T02:23:33.662595+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.662595+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:10.604723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'138","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.642373+0000","last_change":"2024-05-09T02:23:26.642417+0000","last_active":"2024-05-09T02:23:26.642373+0000","last_peered":"2024-05-09T02:23:26.642373+0000","last_clean":"2024-05-09T02:23:26.642373+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:23:26.642373+0000","last_undegraded":"2024-05-09T02:23:26.642373+0000","last_fullsized":"2024-05-09T02:23:26.642373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:26.642252+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:26.642252+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.642252+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:25.971213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'11","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.674638+0000","last_change":"2024-05-09T02:23:26.674674+0000","last_active":"2024-05-09T02:23:26.674638+0000","last_peered":"2024-05-09T02:23:26.674638+0000","last_clean":"2024-05-09T02:23:26.674638+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:23:26.674638+0000","last_undegraded":"2024-05-09T02:23:26.674638+0000","last_fullsized":"2024-05-09T02:23:26.674638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-05-09T02:23:26.674533+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-05-09T02:23:26.674533+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.674533+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:52.833097+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.729931+0000","last_change":"2024-05-09T02:23:18.729975+0000","last_active":"2024-05-09T02:23:18.729931+0000","last_peered":"2024-05-09T02:23:18.729931+0000","last_clean":"2024-05-09T02:23:18.729931+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:23:18.729931+0000","last_undegraded":"2024-05-09T02:23:18.729931+0000","last_fullsized":"2024-05-09T02:23:18.729931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:18.729805+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:18.729805+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.729805+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:39.312619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"32'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.439433+0000","last_change":"2024-05-09T02:23:34.439492+0000","last_active":"2024-05-09T02:23:34.439433+0000","last_peered":"2024-05-09T02:23:34.439433+0000","last_clean":"2024-05-09T02:23:34.439433+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:23:34.439433+0000","last_undegraded":"2024-05-09T02:23:34.439433+0000","last_fullsized":"2024-05-09T02:23:34.439433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'183","last_scrub_stamp":"2024-05-09T02:23:34.439275+0000","last_deep_scrub":"32'183","last_deep_scrub_stamp":"2024-05-09T02:23:34.439275+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.439275+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:59.435696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'132","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.719627+0000","last_change":"2024-05-09T02:23:16.719680+0000","last_active":"2024-05-09T02:23:16.719627+0000","last_peered":"2024-05-09T02:23:16.719627+0000","last_clean":"2024-05-09T02:23:16.719627+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:23:16.719627+0000","last_undegraded":"2024-05-09T02:23:16.719627+0000","last_fullsized":"2024-05-09T02:23:16.719627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:16.719483+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:16.719483+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.719483+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:54.274974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.636240+0000","last_change":"2024-05-09T02:23:29.636267+0000","last_active":"2024-05-09T02:23:29.636240+0000","last_peered":"2024-05-09T02:23:29.636240+0000","last_clean":"2024-05-09T02:23:29.636240+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:23:29.636240+0000","last_undegraded":"2024-05-09T02:23:29.636240+0000","last_fullsized":"2024-05-09T02:23:29.636240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:29.636128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:29.636128+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.636128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:23.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'13","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.328837+0000","last_change":"2024-05-09T02:23:16.328894+0000","last_active":"2024-05-09T02:23:16.328837+0000","last_peered":"2024-05-09T02:23:16.328837+0000","last_clean":"2024-05-09T02:23:16.328837+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:23:16.328837+0000","last_undegraded":"2024-05-09T02:23:16.328837+0000","last_fullsized":"2024-05-09T02:23:16.328837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-09T02:23:16.328709+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-09T02:23:16.328709+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.328709+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:00.935663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'159","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.775437+0000","last_change":"2024-05-09T02:18:23.223030+0000","last_active":"2024-05-09T02:23:06.775437+0000","last_peered":"2024-05-09T02:23:06.775437+0000","last_clean":"2024-05-09T02:23:06.775437+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:23:06.775437+0000","last_undegraded":"2024-05-09T02:23:06.775437+0000","last_fullsized":"2024-05-09T02:23:06.775437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'219","reported_seq":250,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.364292+0000","last_change":"2024-05-09T02:23:32.364360+0000","last_active":"2024-05-09T02:23:32.364292+0000","last_peered":"2024-05-09T02:23:32.364292+0000","last_clean":"2024-05-09T02:23:32.364292+0000","last_became_active":"2024-05-09T02:18:55.680219+0000","last_became_peered":"2024-05-09T02:18:55.680219+0000","last_unstale":"2024-05-09T02:23:32.364292+0000","last_undegraded":"2024-05-09T02:23:32.364292+0000","last_fullsized":"2024-05-09T02:23:32.364292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'219","last_scrub_stamp":"2024-05-09T02:23:32.364147+0000","last_deep_scrub":"31'219","last_deep_scrub_stamp":"2024-05-09T02:23:32.364147+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.364147+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:56.409889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.626856+0000","last_change":"2024-05-09T02:23:23.626935+0000","last_active":"2024-05-09T02:23:23.626856+0000","last_peered":"2024-05-09T02:23:23.626856+0000","last_clean":"2024-05-09T02:23:23.626856+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:23:23.626856+0000","last_undegraded":"2024-05-09T02:23:23.626856+0000","last_fullsized":"2024-05-09T02:23:23.626856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:23.626725+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:23.626725+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.626725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:26.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.341665+0000","last_change":"2024-05-09T02:23:19.341696+0000","last_active":"2024-05-09T02:23:19.341665+0000","last_peered":"2024-05-09T02:23:19.341665+0000","last_clean":"2024-05-09T02:23:19.341665+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:23:19.341665+0000","last_undegraded":"2024-05-09T02:23:19.341665+0000","last_fullsized":"2024-05-09T02:23:19.341665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:19.341558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:19.341558+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.341558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:07.900936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.450835+0000","last_change":"2024-05-09T02:23:36.450865+0000","last_active":"2024-05-09T02:23:36.450835+0000","last_peered":"2024-05-09T02:23:36.450835+0000","last_clean":"2024-05-09T02:23:36.450835+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:23:36.450835+0000","last_undegraded":"2024-05-09T02:23:36.450835+0000","last_fullsized":"2024-05-09T02:23:36.450835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:36.450713+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:36.450713+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.450713+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:29.597170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.617115+0000","last_change":"2024-05-09T02:23:27.617159+0000","last_active":"2024-05-09T02:23:27.617115+0000","last_peered":"2024-05-09T02:23:27.617115+0000","last_clean":"2024-05-09T02:23:27.617115+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:23:27.617115+0000","last_undegraded":"2024-05-09T02:23:27.617115+0000","last_fullsized":"2024-05-09T02:23:27.617115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T02:23:27.616991+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T02:23:27.616991+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.616991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:16.176369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'147","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.770043+0000","last_change":"2024-05-09T02:23:22.770072+0000","last_active":"2024-05-09T02:23:22.770043+0000","last_peered":"2024-05-09T02:23:22.770043+0000","last_clean":"2024-05-09T02:23:22.770043+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:23:22.770043+0000","last_undegraded":"2024-05-09T02:23:22.770043+0000","last_fullsized":"2024-05-09T02:23:22.770043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2024-05-09T02:23:22.769932+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2024-05-09T02:23:22.769932+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.769932+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:16.382091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.613751+0000","last_change":"2024-05-09T02:23:28.613795+0000","last_active":"2024-05-09T02:23:28.613751+0000","last_peered":"2024-05-09T02:23:28.613751+0000","last_clean":"2024-05-09T02:23:28.613751+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:23:28.613751+0000","last_undegraded":"2024-05-09T02:23:28.613751+0000","last_fullsized":"2024-05-09T02:23:28.613751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:28.613608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:28.613608+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.613608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:06.871240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"32'147","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.592973+0000","last_change":"2024-05-09T02:23:33.593004+0000","last_active":"2024-05-09T02:23:33.592973+0000","last_peered":"2024-05-09T02:23:33.592973+0000","last_clean":"2024-05-09T02:23:33.592973+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:23:33.592973+0000","last_undegraded":"2024-05-09T02:23:33.592973+0000","last_fullsized":"2024-05-09T02:23:33.592973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'147","last_scrub_stamp":"2024-05-09T02:23:33.592862+0000","last_deep_scrub":"32'147","last_deep_scrub_stamp":"2024-05-09T02:23:33.592862+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.592862+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:26.739318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.517925+0000","last_change":"2024-05-09T02:23:31.517959+0000","last_active":"2024-05-09T02:23:31.517925+0000","last_peered":"2024-05-09T02:23:31.517925+0000","last_clean":"2024-05-09T02:23:31.517925+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:23:31.517925+0000","last_undegraded":"2024-05-09T02:23:31.517925+0000","last_fullsized":"2024-05-09T02:23:31.517925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-05-09T02:23:31.517816+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-05-09T02:23:31.517816+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.517816+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:56.157781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'162","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970420+0000","last_change":"2024-05-09T02:18:55.678178+0000","last_active":"2024-05-09T02:22:53.970420+0000","last_peered":"2024-05-09T02:22:53.970420+0000","last_clean":"2024-05-09T02:22:53.970420+0000","last_became_active":"2024-05-09T02:18:55.677782+0000","last_became_peered":"2024-05-09T02:18:55.677782+0000","last_unstale":"2024-05-09T02:22:53.970420+0000","last_undegraded":"2024-05-09T02:22:53.970420+0000","last_fullsized":"2024-05-09T02:22:53.970420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.188981+0000","last_change":"2024-05-09T02:23:30.189011+0000","last_active":"2024-05-09T02:23:30.188981+0000","last_peered":"2024-05-09T02:23:30.188981+0000","last_clean":"2024-05-09T02:23:30.188981+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:23:30.188981+0000","last_undegraded":"2024-05-09T02:23:30.188981+0000","last_fullsized":"2024-05-09T02:23:30.188981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.188853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.188853+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.188853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:00.743140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'168","reported_seq":198,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.998700+0000","last_change":"2024-05-09T02:18:23.228502+0000","last_active":"2024-05-09T02:23:14.998700+0000","last_peered":"2024-05-09T02:23:14.998700+0000","last_clean":"2024-05-09T02:23:14.998700+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:23:14.998700+0000","last_undegraded":"2024-05-09T02:23:14.998700+0000","last_fullsized":"2024-05-09T02:23:14.998700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.672853+0000","last_change":"2024-05-09T02:23:21.672880+0000","last_active":"2024-05-09T02:23:21.672853+0000","last_peered":"2024-05-09T02:23:21.672853+0000","last_clean":"2024-05-09T02:23:21.672853+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:23:21.672853+0000","last_undegraded":"2024-05-09T02:23:21.672853+0000","last_fullsized":"2024-05-09T02:23:21.672853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:21.672734+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:21.672734+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.672734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:29.604157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.733975+0000","last_change":"2024-05-09T02:23:22.734032+0000","last_active":"2024-05-09T02:23:22.733975+0000","last_peered":"2024-05-09T02:23:22.733975+0000","last_clean":"2024-05-09T02:23:22.733975+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:23:22.733975+0000","last_undegraded":"2024-05-09T02:23:22.733975+0000","last_fullsized":"2024-05-09T02:23:22.733975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:22.733815+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:22.733815+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.733815+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:44.273921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.257890+0000","last_change":"2024-05-09T02:23:24.257984+0000","last_active":"2024-05-09T02:23:24.257890+0000","last_peered":"2024-05-09T02:23:24.257890+0000","last_clean":"2024-05-09T02:23:24.257890+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:23:24.257890+0000","last_undegraded":"2024-05-09T02:23:24.257890+0000","last_fullsized":"2024-05-09T02:23:24.257890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:24.257754+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:24.257754+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.257754+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:32.189177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"32'132","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.477933+0000","last_change":"2024-05-09T02:18:23.222780+0000","last_active":"2024-05-09T02:23:16.477933+0000","last_peered":"2024-05-09T02:23:16.477933+0000","last_clean":"2024-05-09T02:23:16.477933+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:23:16.477933+0000","last_undegraded":"2024-05-09T02:23:16.477933+0000","last_fullsized":"2024-05-09T02:23:16.477933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.203716+0000","last_change":"2024-05-09T02:23:31.203748+0000","last_active":"2024-05-09T02:23:31.203716+0000","last_peered":"2024-05-09T02:23:31.203716+0000","last_clean":"2024-05-09T02:23:31.203716+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:23:31.203716+0000","last_undegraded":"2024-05-09T02:23:31.203716+0000","last_fullsized":"2024-05-09T02:23:31.203716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:31.203613+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:31.203613+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.203613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:36.598591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'123","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.625364+0000","last_change":"2024-05-09T02:23:25.625439+0000","last_active":"2024-05-09T02:23:25.625364+0000","last_peered":"2024-05-09T02:23:25.625364+0000","last_clean":"2024-05-09T02:23:25.625364+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:23:25.625364+0000","last_undegraded":"2024-05-09T02:23:25.625364+0000","last_fullsized":"2024-05-09T02:23:25.625364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:25.625238+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:25.625238+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.625238+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:45.687403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'5","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.374799+0000","last_change":"2024-05-09T02:23:20.374799+0000","last_active":"2024-05-09T02:23:20.374799+0000","last_peered":"2024-05-09T02:23:20.374799+0000","last_clean":"2024-05-09T02:23:20.374799+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:23:20.374799+0000","last_undegraded":"2024-05-09T02:23:20.374799+0000","last_fullsized":"2024-05-09T02:23:20.374799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-09T02:23:20.374662+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-09T02:23:20.374662+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.374662+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:45.014627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"32'183","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.986029+0000","last_change":"2024-05-09T02:18:23.219809+0000","last_active":"2024-05-09T02:22:53.986029+0000","last_peered":"2024-05-09T02:22:53.986029+0000","last_clean":"2024-05-09T02:22:53.986029+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:22:53.986029+0000","last_undegraded":"2024-05-09T02:22:53.986029+0000","last_fullsized":"2024-05-09T02:22:53.986029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'141","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.558678+0000","last_change":"2024-05-09T02:23:28.558708+0000","last_active":"2024-05-09T02:23:28.558678+0000","last_peered":"2024-05-09T02:23:28.558678+0000","last_clean":"2024-05-09T02:23:28.558678+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:23:28.558678+0000","last_undegraded":"2024-05-09T02:23:28.558678+0000","last_fullsized":"2024-05-09T02:23:28.558678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:28.558556+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:28.558556+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.558556+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:35.690234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"32'132","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974996+0000","last_change":"2024-05-09T02:18:23.221885+0000","last_active":"2024-05-09T02:22:53.974996+0000","last_peered":"2024-05-09T02:22:53.974996+0000","last_clean":"2024-05-09T02:22:53.974996+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:22:53.974996+0000","last_undegraded":"2024-05-09T02:22:53.974996+0000","last_fullsized":"2024-05-09T02:22:53.974996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.207049+0000","last_change":"2024-05-09T02:23:22.207079+0000","last_active":"2024-05-09T02:23:22.207049+0000","last_peered":"2024-05-09T02:23:22.207049+0000","last_clean":"2024-05-09T02:23:22.207049+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:23:22.207049+0000","last_undegraded":"2024-05-09T02:23:22.207049+0000","last_fullsized":"2024-05-09T02:23:22.207049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:22.206927+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:22.206927+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.206927+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:59.762418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"32'129","reported_seq":159,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107704+0000","last_change":"2024-05-09T02:18:23.210967+0000","last_active":"2024-05-09T02:22:54.107704+0000","last_peered":"2024-05-09T02:22:54.107704+0000","last_clean":"2024-05-09T02:22:54.107704+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:22:54.107704+0000","last_undegraded":"2024-05-09T02:22:54.107704+0000","last_fullsized":"2024-05-09T02:22:54.107704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.710308+0000","last_change":"2024-05-09T02:23:20.710334+0000","last_active":"2024-05-09T02:23:20.710308+0000","last_peered":"2024-05-09T02:23:20.710308+0000","last_clean":"2024-05-09T02:23:20.710308+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:23:20.710308+0000","last_undegraded":"2024-05-09T02:23:20.710308+0000","last_fullsized":"2024-05-09T02:23:20.710308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:20.710206+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:20.710206+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.710206+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:14.322364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"32'138","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.974638+0000","last_change":"2024-05-09T02:18:23.228528+0000","last_active":"2024-05-09T02:22:53.974638+0000","last_peered":"2024-05-09T02:22:53.974638+0000","last_clean":"2024-05-09T02:22:53.974638+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:22:53.974638+0000","last_undegraded":"2024-05-09T02:22:53.974638+0000","last_fullsized":"2024-05-09T02:22:53.974638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"31'111","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.698937+0000","last_change":"2024-05-09T02:23:23.698976+0000","last_active":"2024-05-09T02:23:23.698937+0000","last_peered":"2024-05-09T02:23:23.698937+0000","last_clean":"2024-05-09T02:23:23.698937+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:23:23.698937+0000","last_undegraded":"2024-05-09T02:23:23.698937+0000","last_fullsized":"2024-05-09T02:23:23.698937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'111","last_scrub_stamp":"2024-05-09T02:23:23.698818+0000","last_deep_scrub":"31'111","last_deep_scrub_stamp":"2024-05-09T02:23:23.698818+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.698818+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:04.624274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"32'123","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976830+0000","last_change":"2024-05-09T02:18:23.223440+0000","last_active":"2024-05-09T02:22:53.976830+0000","last_peered":"2024-05-09T02:22:53.976830+0000","last_clean":"2024-05-09T02:22:53.976830+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:22:53.976830+0000","last_undegraded":"2024-05-09T02:22:53.976830+0000","last_fullsized":"2024-05-09T02:22:53.976830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"31'129","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.108399+0000","last_change":"2024-05-09T02:23:36.108430+0000","last_active":"2024-05-09T02:23:36.108399+0000","last_peered":"2024-05-09T02:23:36.108399+0000","last_clean":"2024-05-09T02:23:36.108399+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:23:36.108399+0000","last_undegraded":"2024-05-09T02:23:36.108399+0000","last_fullsized":"2024-05-09T02:23:36.108399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:36.108285+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:36.108285+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.108285+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:20.387758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"32'111","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.970214+0000","last_change":"2024-05-09T02:18:23.222443+0000","last_active":"2024-05-09T02:22:53.970214+0000","last_peered":"2024-05-09T02:22:53.970214+0000","last_clean":"2024-05-09T02:22:53.970214+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:22:53.970214+0000","last_undegraded":"2024-05-09T02:22:53.970214+0000","last_fullsized":"2024-05-09T02:22:53.970214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.714465+0000","last_change":"2024-05-09T02:23:24.714494+0000","last_active":"2024-05-09T02:23:24.714465+0000","last_peered":"2024-05-09T02:23:24.714465+0000","last_clean":"2024-05-09T02:23:24.714465+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:23:24.714465+0000","last_undegraded":"2024-05-09T02:23:24.714465+0000","last_fullsized":"2024-05-09T02:23:24.714465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:24.714361+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:24.714361+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.714361+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:00.040479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"32'141","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:53.976491+0000","last_change":"2024-05-09T02:18:23.222605+0000","last_active":"2024-05-09T02:22:53.976491+0000","last_peered":"2024-05-09T02:22:53.976491+0000","last_clean":"2024-05-09T02:22:53.976491+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:22:53.976491+0000","last_undegraded":"2024-05-09T02:22:53.976491+0000","last_fullsized":"2024-05-09T02:22:53.976491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"31'183","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.651115+0000","last_change":"2024-05-09T02:23:19.651142+0000","last_active":"2024-05-09T02:23:19.651115+0000","last_peered":"2024-05-09T02:23:19.651115+0000","last_clean":"2024-05-09T02:23:19.651115+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:23:19.651115+0000","last_undegraded":"2024-05-09T02:23:19.651115+0000","last_fullsized":"2024-05-09T02:23:19.651115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'183","last_scrub_stamp":"2024-05-09T02:23:19.651003+0000","last_deep_scrub":"31'183","last_deep_scrub_stamp":"2024-05-09T02:23:19.651003+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.651003+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:57.206494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"32'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.508046+0000","last_change":"2024-05-09T02:23:32.508079+0000","last_active":"2024-05-09T02:23:32.508046+0000","last_peered":"2024-05-09T02:23:32.508046+0000","last_clean":"2024-05-09T02:23:32.508046+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:23:32.508046+0000","last_undegraded":"2024-05-09T02:23:32.508046+0000","last_fullsized":"2024-05-09T02:23:32.508046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:32.507920+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:32.507920+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.507920+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:34.703396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'132","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.142781+0000","last_change":"2024-05-09T02:23:34.142811+0000","last_active":"2024-05-09T02:23:34.142781+0000","last_peered":"2024-05-09T02:23:34.142781+0000","last_clean":"2024-05-09T02:23:34.142781+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:23:34.142781+0000","last_undegraded":"2024-05-09T02:23:34.142781+0000","last_fullsized":"2024-05-09T02:23:34.142781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:34.142651+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:34.142651+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.142651+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:16.194381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"32'147","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577311+0000","last_change":"2024-05-09T02:18:23.220902+0000","last_active":"2024-05-09T02:23:06.577311+0000","last_peered":"2024-05-09T02:23:06.577311+0000","last_clean":"2024-05-09T02:23:06.577311+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:23:06.577311+0000","last_undegraded":"2024-05-09T02:23:06.577311+0000","last_fullsized":"2024-05-09T02:23:06.577311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'174","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.646123+0000","last_change":"2024-05-09T02:23:22.646184+0000","last_active":"2024-05-09T02:23:22.646123+0000","last_peered":"2024-05-09T02:23:22.646123+0000","last_clean":"2024-05-09T02:23:22.646123+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:23:22.646123+0000","last_undegraded":"2024-05-09T02:23:22.646123+0000","last_fullsized":"2024-05-09T02:23:22.646123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'174","last_scrub_stamp":"2024-05-09T02:23:22.646001+0000","last_deep_scrub":"31'174","last_deep_scrub_stamp":"2024-05-09T02:23:22.646001+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.646001+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:47.865548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"32'138","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.775543+0000","last_change":"2024-05-09T02:18:23.225774+0000","last_active":"2024-05-09T02:23:06.775543+0000","last_peered":"2024-05-09T02:23:06.775543+0000","last_clean":"2024-05-09T02:23:06.775543+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:23:06.775543+0000","last_undegraded":"2024-05-09T02:23:06.775543+0000","last_fullsized":"2024-05-09T02:23:06.775543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"31'126","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.127951+0000","last_change":"2024-05-09T02:23:35.127986+0000","last_active":"2024-05-09T02:23:35.127951+0000","last_peered":"2024-05-09T02:23:35.127951+0000","last_clean":"2024-05-09T02:23:35.127951+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:23:35.127951+0000","last_undegraded":"2024-05-09T02:23:35.127951+0000","last_fullsized":"2024-05-09T02:23:35.127951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:35.127824+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:35.127824+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.127824+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:13.860723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"32'153","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.291239+0000","last_change":"2024-05-09T02:23:26.291268+0000","last_active":"2024-05-09T02:23:26.291239+0000","last_peered":"2024-05-09T02:23:26.291239+0000","last_clean":"2024-05-09T02:23:26.291239+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:23:26.291239+0000","last_undegraded":"2024-05-09T02:23:26.291239+0000","last_fullsized":"2024-05-09T02:23:26.291239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'153","last_scrub_stamp":"2024-05-09T02:23:26.291123+0000","last_deep_scrub":"32'153","last_deep_scrub_stamp":"2024-05-09T02:23:26.291123+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.291123+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:28.888838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"31'156","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.712888+0000","last_change":"2024-05-09T02:23:24.712929+0000","last_active":"2024-05-09T02:23:24.712888+0000","last_peered":"2024-05-09T02:23:24.712888+0000","last_clean":"2024-05-09T02:23:24.712888+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:23:24.712888+0000","last_undegraded":"2024-05-09T02:23:24.712888+0000","last_fullsized":"2024-05-09T02:23:24.712888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2024-05-09T02:23:24.712759+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2024-05-09T02:23:24.712759+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.712759+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:50.871323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"32'165","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:56.576019+0000","last_change":"2024-05-09T02:18:23.221808+0000","last_active":"2024-05-09T02:22:56.576019+0000","last_peered":"2024-05-09T02:22:56.576019+0000","last_clean":"2024-05-09T02:22:56.576019+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:22:56.576019+0000","last_undegraded":"2024-05-09T02:22:56.576019+0000","last_fullsized":"2024-05-09T02:22:56.576019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"31'126","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.626609+0000","last_change":"2024-05-09T02:23:26.626643+0000","last_active":"2024-05-09T02:23:26.626609+0000","last_peered":"2024-05-09T02:23:26.626609+0000","last_clean":"2024-05-09T02:23:26.626609+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:23:26.626609+0000","last_undegraded":"2024-05-09T02:23:26.626609+0000","last_fullsized":"2024-05-09T02:23:26.626609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:26.626488+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:26.626488+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.626488+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:50.672230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"32'156","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.622501+0000","last_change":"2024-05-09T02:23:36.622544+0000","last_active":"2024-05-09T02:23:36.622501+0000","last_peered":"2024-05-09T02:23:36.622501+0000","last_clean":"2024-05-09T02:23:36.622501+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:23:36.622501+0000","last_undegraded":"2024-05-09T02:23:36.622501+0000","last_fullsized":"2024-05-09T02:23:36.622501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'156","last_scrub_stamp":"2024-05-09T02:23:36.622386+0000","last_deep_scrub":"32'156","last_deep_scrub_stamp":"2024-05-09T02:23:36.622386+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.622386+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:49.991326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'153","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.616037+0000","last_change":"2024-05-09T02:23:26.616068+0000","last_active":"2024-05-09T02:23:26.616037+0000","last_peered":"2024-05-09T02:23:26.616037+0000","last_clean":"2024-05-09T02:23:26.616037+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:23:26.616037+0000","last_undegraded":"2024-05-09T02:23:26.616037+0000","last_fullsized":"2024-05-09T02:23:26.616037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2024-05-09T02:23:26.615925+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2024-05-09T02:23:26.615925+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.615925+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:07.541380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"32'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.593316+0000","last_change":"2024-05-09T02:23:34.593343+0000","last_active":"2024-05-09T02:23:34.593316+0000","last_peered":"2024-05-09T02:23:34.593316+0000","last_clean":"2024-05-09T02:23:34.593316+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:23:34.593316+0000","last_undegraded":"2024-05-09T02:23:34.593316+0000","last_fullsized":"2024-05-09T02:23:34.593316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:34.593214+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:34.593214+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.593214+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:27.739671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"31'165","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.004069+0000","last_change":"2024-05-09T02:23:29.004106+0000","last_active":"2024-05-09T02:23:29.004069+0000","last_peered":"2024-05-09T02:23:29.004069+0000","last_clean":"2024-05-09T02:23:29.004069+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:23:29.004069+0000","last_undegraded":"2024-05-09T02:23:29.004069+0000","last_fullsized":"2024-05-09T02:23:29.004069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2024-05-09T02:23:29.003969+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2024-05-09T02:23:29.003969+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.003969+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:07.261602+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"32'174","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.106794+0000","last_change":"2024-05-09T02:18:23.221302+0000","last_active":"2024-05-09T02:22:54.106794+0000","last_peered":"2024-05-09T02:22:54.106794+0000","last_clean":"2024-05-09T02:22:54.106794+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:22:54.106794+0000","last_undegraded":"2024-05-09T02:22:54.106794+0000","last_fullsized":"2024-05-09T02:22:54.106794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"31'147","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.216742+0000","last_change":"2024-05-09T02:23:23.216803+0000","last_active":"2024-05-09T02:23:23.216742+0000","last_peered":"2024-05-09T02:23:23.216742+0000","last_clean":"2024-05-09T02:23:23.216742+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:23:23.216742+0000","last_undegraded":"2024-05-09T02:23:23.216742+0000","last_fullsized":"2024-05-09T02:23:23.216742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2024-05-09T02:23:23.216607+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2024-05-09T02:23:23.216607+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.216607+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:44.510847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"32'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.596171+0000","last_change":"2024-05-09T02:23:32.596209+0000","last_active":"2024-05-09T02:23:32.596171+0000","last_peered":"2024-05-09T02:23:32.596171+0000","last_clean":"2024-05-09T02:23:32.596171+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:23:32.596171+0000","last_undegraded":"2024-05-09T02:23:32.596171+0000","last_fullsized":"2024-05-09T02:23:32.596171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:32.596052+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:32.596052+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.596052+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:23.144814+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"31'138","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.355876+0000","last_change":"2024-05-09T02:23:31.355876+0000","last_active":"2024-05-09T02:23:31.355876+0000","last_peered":"2024-05-09T02:23:31.355876+0000","last_clean":"2024-05-09T02:23:31.355876+0000","last_became_active":"2024-05-09T02:18:55.680014+0000","last_became_peered":"2024-05-09T02:18:55.680014+0000","last_unstale":"2024-05-09T02:23:31.355876+0000","last_undegraded":"2024-05-09T02:23:31.355876+0000","last_fullsized":"2024-05-09T02:23:31.355876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:31.355727+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:31.355727+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.355727+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:38.487405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.998815+0000","last_change":"2024-05-09T02:18:23.220964+0000","last_active":"2024-05-09T02:23:14.998815+0000","last_peered":"2024-05-09T02:23:14.998815+0000","last_clean":"2024-05-09T02:23:14.998815+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:23:14.998815+0000","last_undegraded":"2024-05-09T02:23:14.998815+0000","last_fullsized":"2024-05-09T02:23:14.998815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.659646+0000","last_change":"2024-05-09T02:23:26.659710+0000","last_active":"2024-05-09T02:23:26.659646+0000","last_peered":"2024-05-09T02:23:26.659646+0000","last_clean":"2024-05-09T02:23:26.659646+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:23:26.659646+0000","last_undegraded":"2024-05-09T02:23:26.659646+0000","last_fullsized":"2024-05-09T02:23:26.659646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:26.659509+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:26.659509+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.659509+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:50.149204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"32'141","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.564035+0000","last_change":"2024-05-09T02:23:33.564062+0000","last_active":"2024-05-09T02:23:33.564035+0000","last_peered":"2024-05-09T02:23:33.564035+0000","last_clean":"2024-05-09T02:23:33.564035+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:23:33.564035+0000","last_undegraded":"2024-05-09T02:23:33.564035+0000","last_fullsized":"2024-05-09T02:23:33.564035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:33.563934+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:33.563934+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.563934+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:24.112696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"31'144","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.674278+0000","last_change":"2024-05-09T02:23:31.674306+0000","last_active":"2024-05-09T02:23:31.674278+0000","last_peered":"2024-05-09T02:23:31.674278+0000","last_clean":"2024-05-09T02:23:31.674278+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:23:31.674278+0000","last_undegraded":"2024-05-09T02:23:31.674278+0000","last_fullsized":"2024-05-09T02:23:31.674278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:31.674160+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:31.674160+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.674160+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:45.043100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"32'135","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.603760+0000","last_change":"2024-05-09T02:18:23.219545+0000","last_active":"2024-05-09T02:23:16.603760+0000","last_peered":"2024-05-09T02:23:16.603760+0000","last_clean":"2024-05-09T02:23:16.603760+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:23:16.603760+0000","last_undegraded":"2024-05-09T02:23:16.603760+0000","last_fullsized":"2024-05-09T02:23:16.603760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'141","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.652898+0000","last_change":"2024-05-09T02:23:24.652932+0000","last_active":"2024-05-09T02:23:24.652898+0000","last_peered":"2024-05-09T02:23:24.652898+0000","last_clean":"2024-05-09T02:23:24.652898+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:23:24.652898+0000","last_undegraded":"2024-05-09T02:23:24.652898+0000","last_fullsized":"2024-05-09T02:23:24.652898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:24.652791+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:24.652791+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.652791+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:44.714956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"32'183","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.776851+0000","last_change":"2024-05-09T02:18:23.223532+0000","last_active":"2024-05-09T02:23:16.776851+0000","last_peered":"2024-05-09T02:23:16.776851+0000","last_clean":"2024-05-09T02:23:16.776851+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:23:16.776851+0000","last_undegraded":"2024-05-09T02:23:16.776851+0000","last_fullsized":"2024-05-09T02:23:16.776851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"31'141","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.220671+0000","last_change":"2024-05-09T02:23:29.220704+0000","last_active":"2024-05-09T02:23:29.220671+0000","last_peered":"2024-05-09T02:23:29.220671+0000","last_clean":"2024-05-09T02:23:29.220671+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:23:29.220671+0000","last_undegraded":"2024-05-09T02:23:29.220671+0000","last_fullsized":"2024-05-09T02:23:29.220671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:29.220546+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:29.220546+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.220546+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:06.162674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"32'141","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.577243+0000","last_change":"2024-05-09T02:18:23.222016+0000","last_active":"2024-05-09T02:23:06.577243+0000","last_peered":"2024-05-09T02:23:06.577243+0000","last_clean":"2024-05-09T02:23:06.577243+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:23:06.577243+0000","last_undegraded":"2024-05-09T02:23:06.577243+0000","last_fullsized":"2024-05-09T02:23:06.577243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'135","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.645260+0000","last_change":"2024-05-09T02:23:27.645293+0000","last_active":"2024-05-09T02:23:27.645260+0000","last_peered":"2024-05-09T02:23:27.645260+0000","last_clean":"2024-05-09T02:23:27.645260+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:23:27.645260+0000","last_undegraded":"2024-05-09T02:23:27.645260+0000","last_fullsized":"2024-05-09T02:23:27.645260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2024-05-09T02:23:27.645149+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2024-05-09T02:23:27.645149+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.645149+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:02.971266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"32'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.322088+0000","last_change":"2024-05-09T02:23:27.322141+0000","last_active":"2024-05-09T02:23:27.322088+0000","last_peered":"2024-05-09T02:23:27.322088+0000","last_clean":"2024-05-09T02:23:27.322088+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:23:27.322088+0000","last_undegraded":"2024-05-09T02:23:27.322088+0000","last_fullsized":"2024-05-09T02:23:27.322088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:27.321947+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:27.321947+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.321947+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:12.330551+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"31'183","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.655735+0000","last_change":"2024-05-09T02:23:20.655788+0000","last_active":"2024-05-09T02:23:20.655735+0000","last_peered":"2024-05-09T02:23:20.655735+0000","last_clean":"2024-05-09T02:23:20.655735+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:23:20.655735+0000","last_undegraded":"2024-05-09T02:23:20.655735+0000","last_fullsized":"2024-05-09T02:23:20.655735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'183","last_scrub_stamp":"2024-05-09T02:23:20.655585+0000","last_deep_scrub":"31'183","last_deep_scrub_stamp":"2024-05-09T02:23:20.655585+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.655585+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:36.341218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"32'138","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:06.775465+0000","last_change":"2024-05-09T02:18:23.225307+0000","last_active":"2024-05-09T02:23:06.775465+0000","last_peered":"2024-05-09T02:23:06.775465+0000","last_clean":"2024-05-09T02:23:06.775465+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:23:06.775465+0000","last_undegraded":"2024-05-09T02:23:06.775465+0000","last_fullsized":"2024-05-09T02:23:06.775465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"31'141","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.608152+0000","last_change":"2024-05-09T02:23:17.608190+0000","last_active":"2024-05-09T02:23:17.608152+0000","last_peered":"2024-05-09T02:23:17.608152+0000","last_clean":"2024-05-09T02:23:17.608152+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:23:17.608152+0000","last_undegraded":"2024-05-09T02:23:17.608152+0000","last_fullsized":"2024-05-09T02:23:17.608152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:17.607976+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:17.607976+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.607976+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:18.781780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.672271+0000","last_change":"2024-05-09T02:23:23.672363+0000","last_active":"2024-05-09T02:23:23.672271+0000","last_peered":"2024-05-09T02:23:23.672271+0000","last_clean":"2024-05-09T02:23:23.672271+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:23:23.672271+0000","last_undegraded":"2024-05-09T02:23:23.672271+0000","last_fullsized":"2024-05-09T02:23:23.672271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:23.672154+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:23.672154+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.672154+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:48.312119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"31'141","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.040764+0000","last_change":"2024-05-09T02:23:25.040790+0000","last_active":"2024-05-09T02:23:25.040764+0000","last_peered":"2024-05-09T02:23:25.040764+0000","last_clean":"2024-05-09T02:23:25.040764+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:23:25.040764+0000","last_undegraded":"2024-05-09T02:23:25.040764+0000","last_fullsized":"2024-05-09T02:23:25.040764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:25.040669+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:25.040669+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.040669+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:51.199233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"32'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.277818+0000","last_change":"2024-05-09T02:23:26.277857+0000","last_active":"2024-05-09T02:23:26.277818+0000","last_peered":"2024-05-09T02:23:26.277818+0000","last_clean":"2024-05-09T02:23:26.277818+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:23:26.277818+0000","last_undegraded":"2024-05-09T02:23:26.277818+0000","last_fullsized":"2024-05-09T02:23:26.277818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:26.277341+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:26.277341+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.277341+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:00.753928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":223,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.332756+0000","last_change":"2024-05-09T02:23:23.332788+0000","last_active":"2024-05-09T02:23:23.332756+0000","last_peered":"2024-05-09T02:23:23.332756+0000","last_clean":"2024-05-09T02:23:23.332756+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:23:23.332756+0000","last_undegraded":"2024-05-09T02:23:23.332756+0000","last_fullsized":"2024-05-09T02:23:23.332756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'177","last_scrub_stamp":"2024-05-09T02:23:23.332648+0000","last_deep_scrub":"31'177","last_deep_scrub_stamp":"2024-05-09T02:23:23.332648+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.332648+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:48.329069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.489019+0000","last_change":"2024-05-09T02:23:35.489051+0000","last_active":"2024-05-09T02:23:35.489019+0000","last_peered":"2024-05-09T02:23:35.489019+0000","last_clean":"2024-05-09T02:23:35.489019+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:23:35.489019+0000","last_undegraded":"2024-05-09T02:23:35.489019+0000","last_fullsized":"2024-05-09T02:23:35.489019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:35.488862+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:35.488862+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.488862+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:26.037624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"31'159","reported_seq":198,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.776793+0000","last_change":"2024-05-09T02:18:14.147853+0000","last_active":"2024-05-09T02:23:16.776793+0000","last_peered":"2024-05-09T02:23:16.776793+0000","last_clean":"2024-05-09T02:23:16.776793+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:23:16.776793+0000","last_undegraded":"2024-05-09T02:23:16.776793+0000","last_fullsized":"2024-05-09T02:23:16.776793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:13.119519+0000","last_clean_scrub_stamp":"2024-05-09T02:18:13.119519+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"32'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.729260+0000","last_change":"2024-05-09T02:23:35.729339+0000","last_active":"2024-05-09T02:23:35.729260+0000","last_peered":"2024-05-09T02:23:35.729260+0000","last_clean":"2024-05-09T02:23:35.729260+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:23:35.729260+0000","last_undegraded":"2024-05-09T02:23:35.729260+0000","last_fullsized":"2024-05-09T02:23:35.729260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'165","last_scrub_stamp":"2024-05-09T02:23:35.729099+0000","last_deep_scrub":"32'165","last_deep_scrub_stamp":"2024-05-09T02:23:35.729099+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.729099+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:30.329128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'129","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.628571+0000","last_change":"2024-05-09T02:23:33.628645+0000","last_active":"2024-05-09T02:23:33.628571+0000","last_peered":"2024-05-09T02:23:33.628571+0000","last_clean":"2024-05-09T02:23:33.628571+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:23:33.628571+0000","last_undegraded":"2024-05-09T02:23:33.628571+0000","last_fullsized":"2024-05-09T02:23:33.628571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:33.628455+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:33.628455+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.628455+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:24.291341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"32'144","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:22:54.107598+0000","last_change":"2024-05-09T02:18:23.216400+0000","last_active":"2024-05-09T02:22:54.107598+0000","last_peered":"2024-05-09T02:22:54.107598+0000","last_clean":"2024-05-09T02:22:54.107598+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:22:54.107598+0000","last_undegraded":"2024-05-09T02:22:54.107598+0000","last_fullsized":"2024-05-09T02:22:54.107598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.017257+0000","last_change":"2024-05-09T02:23:31.017287+0000","last_active":"2024-05-09T02:23:31.017257+0000","last_peered":"2024-05-09T02:23:31.017257+0000","last_clean":"2024-05-09T02:23:31.017257+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:23:31.017257+0000","last_undegraded":"2024-05-09T02:23:31.017257+0000","last_fullsized":"2024-05-09T02:23:31.017257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:31.017154+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:31.017154+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.017154+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:09.172215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"32'129","reported_seq":159,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.983063+0000","last_change":"2024-05-09T02:18:23.219531+0000","last_active":"2024-05-09T02:23:15.983063+0000","last_peered":"2024-05-09T02:23:15.983063+0000","last_clean":"2024-05-09T02:23:15.983063+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:23:15.983063+0000","last_undegraded":"2024-05-09T02:23:15.983063+0000","last_fullsized":"2024-05-09T02:23:15.983063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:18:22.174035+0000","last_clean_scrub_stamp":"2024-05-09T02:18:22.174035+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'165","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.656371+0000","last_change":"2024-05-09T02:23:17.656402+0000","last_active":"2024-05-09T02:23:17.656371+0000","last_peered":"2024-05-09T02:23:17.656371+0000","last_clean":"2024-05-09T02:23:17.656371+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:23:17.656371+0000","last_undegraded":"2024-05-09T02:23:17.656371+0000","last_fullsized":"2024-05-09T02:23:17.656371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2024-05-09T02:23:17.656260+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2024-05-09T02:23:17.656260+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.656260+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:36.714946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.351059+0000","last_change":"2024-05-09T02:23:29.351088+0000","last_active":"2024-05-09T02:23:29.351059+0000","last_peered":"2024-05-09T02:23:29.351059+0000","last_clean":"2024-05-09T02:23:29.351059+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:23:29.351059+0000","last_undegraded":"2024-05-09T02:23:29.351059+0000","last_fullsized":"2024-05-09T02:23:29.351059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:29.350945+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:29.350945+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.350945+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:10.276401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.750665+0000","last_change":"2024-05-09T02:23:18.750695+0000","last_active":"2024-05-09T02:23:18.750665+0000","last_peered":"2024-05-09T02:23:18.750665+0000","last_clean":"2024-05-09T02:23:18.750665+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:23:18.750665+0000","last_undegraded":"2024-05-09T02:23:18.750665+0000","last_fullsized":"2024-05-09T02:23:18.750665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:18.750553+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:18.750553+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.750553+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:26.681975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"32'177","reported_seq":216,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.031965+0000","last_change":"2024-05-09T02:23:28.031996+0000","last_active":"2024-05-09T02:23:28.031965+0000","last_peered":"2024-05-09T02:23:28.031965+0000","last_clean":"2024-05-09T02:23:28.031965+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:23:28.031965+0000","last_undegraded":"2024-05-09T02:23:28.031965+0000","last_fullsized":"2024-05-09T02:23:28.031965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'177","last_scrub_stamp":"2024-05-09T02:23:28.031847+0000","last_deep_scrub":"32'177","last_deep_scrub_stamp":"2024-05-09T02:23:28.031847+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.031847+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:17.807446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"31'126","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.710091+0000","last_change":"2024-05-09T02:23:32.710127+0000","last_active":"2024-05-09T02:23:32.710091+0000","last_peered":"2024-05-09T02:23:32.710091+0000","last_clean":"2024-05-09T02:23:32.710091+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:23:32.710091+0000","last_undegraded":"2024-05-09T02:23:32.710091+0000","last_fullsized":"2024-05-09T02:23:32.710091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:32.709972+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:32.709972+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.709972+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:38.765905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"32'159","reported_seq":198,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.010580+0000","last_change":"2024-05-09T02:23:30.010609+0000","last_active":"2024-05-09T02:23:30.010580+0000","last_peered":"2024-05-09T02:23:30.010580+0000","last_clean":"2024-05-09T02:23:30.010580+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:23:30.010580+0000","last_undegraded":"2024-05-09T02:23:30.010580+0000","last_fullsized":"2024-05-09T02:23:30.010580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'159","last_scrub_stamp":"2024-05-09T02:23:30.010475+0000","last_deep_scrub":"32'159","last_deep_scrub_stamp":"2024-05-09T02:23:30.010475+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.010475+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:24.320750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"31'138","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.942511+0000","last_change":"2024-05-09T02:23:19.942561+0000","last_active":"2024-05-09T02:23:19.942511+0000","last_peered":"2024-05-09T02:23:19.942511+0000","last_clean":"2024-05-09T02:23:19.942511+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:23:19.942511+0000","last_undegraded":"2024-05-09T02:23:19.942511+0000","last_fullsized":"2024-05-09T02:23:19.942511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:19.942369+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:19.942369+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.942369+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:04.549323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":211620,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":435,"num_write":199,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":423240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216648,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":455,"num_write":196,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":433296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":966656,"data_stored":752122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58128,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313712,"statfs":{"total":96636764160,"available":96577241088,"internally_reserved":0,"allocated":598016,"data_stored":377043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":380928,"data_stored":162349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45444,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326396,"statfs":{"total":96636764160,"available":96590229504,"internally_reserved":0,"allocated":389120,"data_stored":161817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54184,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317656,"statfs":{"total":96636764160,"available":96581279744,"internally_reserved":0,"allocated":819200,"data_stored":587271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":372736,"data_stored":161657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49808,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":598016,"data_stored":371581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50172,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321668,"statfs":{"total":96636764160,"available":96585388032,"internally_reserved":0,"allocated":970752,"data_stored":752088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":215850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":215345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:23:38.770 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.770 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.770 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.771 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.771 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.772 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T02:18:12.114146+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.772 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.772 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.772 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.772 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.773 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.773 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.773 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.773 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.773 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.774 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.774 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.774 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.774 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.774 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.774 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.775 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T02:18:13.119519+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-09T02:18:22.174035+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=18, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T02:23:38.776 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T02:23:48.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:23:48.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:23:58.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T02:23:58.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.906+0000 7ff562ba8640 1 Processor -- start 2024-05-09T02:23:58.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.906+0000 7ff562ba8640 1 -- start start 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.907+0000 7ff562ba8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff55c151ef0 0x7ff55c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.907+0000 7ff562ba8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c073b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff562ba8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55c0733b0 con 0x7ff55c154720 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff562ba8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff55c0ab290 con 0x7ff55c151ef0 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff562ba8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c0ab570 con 0x7ff55c0a91e0 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff560944640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff55c151ef0 0x7ff55c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c073b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56634/0 (socket says 172.21.15.46:56634) 2024-05-09T02:23:58.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55bfff640 1 -- 172.21.15.46:0/1923482669 learned_addr learned my addr 172.21.15.46:0/1923482669 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:58.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55bfff640 1 -- 172.21.15.46:0/1923482669 >> v2:172.21.15.107:3300/0 conn(0x7ff55c151ef0 msgr2=0x7ff55c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:58.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55bfff640 1 --2- 172.21.15.46:0/1923482669 >> v2:172.21.15.107:3300/0 conn(0x7ff55c151ef0 0x7ff55c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:58.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55bfff640 1 -- 172.21.15.46:0/1923482669 >> v1:172.21.15.107:6789/0 conn(0x7ff55c154720 legacy=0x7ff55c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.909+0000 7ff55bfff640 1 -- 172.21.15.46:0/1923482669 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c073620 con 0x7ff55c0a91e0 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.908+0000 7ff55b7fe640 1 -- 172.21.15.46:0/1923482669 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637863152 0 0) 0x7ff55c0733b0 con 0x7ff55c154720 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.909+0000 7ff560944640 1 --2- 172.21.15.46:0/1923482669 >> v2:172.21.15.107:3300/0 conn(0x7ff55c151ef0 0x7ff55c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.909+0000 7ff55bfff640 1 --2- 172.21.15.46:0/1923482669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c073b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff544009870 tx=0x7ff54402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d50f6688f7ef29a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.909+0000 7ff55b7fe640 1 -- 172.21.15.46:0/1923482669 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544037070 con 0x7ff55c0a91e0 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff55b7fe640 1 -- 172.21.15.46:0/1923482669 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff544032440 con 0x7ff55c0a91e0 2024-05-09T02:23:58.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff55b7fe640 1 -- 172.21.15.46:0/1923482669 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544032810 con 0x7ff55c0a91e0 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 -- 172.21.15.46:0/1923482669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 msgr2=0x7ff55c073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1923482669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c073b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff544009870 tx=0x7ff54402a270 comp rx=0 tx=0).stop 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 -- 172.21.15.46:0/1923482669 shutdown_connections 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1923482669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c073b40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1923482669 >> v2:172.21.15.107:3300/0 conn(0x7ff55c151ef0 0x7ff55c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 -- 172.21.15.46:0/1923482669 >> 172.21.15.46:0/1923482669 conn(0x7ff55c0c5940 msgr2=0x7ff55c0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 -- 172.21.15.46:0/1923482669 shutdown_connections 2024-05-09T02:23:58.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.910+0000 7ff562ba8640 1 -- 172.21.15.46:0/1923482669 wait complete. 2024-05-09T02:23:58.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.912+0000 7ff562ba8640 1 Processor -- start 2024-05-09T02:23:58.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.912+0000 7ff562ba8640 1 -- start start 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.913+0000 7ff562ba8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.913+0000 7ff562ba8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 0x7ff55c1e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.913+0000 7ff562ba8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff55c154720 0x7ff55c1ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.913+0000 7ff562ba8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c0c5460 con 0x7ff55c151ef0 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.913+0000 7ff562ba8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c0ab850 con 0x7ff55c154720 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.913+0000 7ff562ba8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c0c55e0 con 0x7ff55c0a91e0 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 0x7ff55c1e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 0x7ff55c1e1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40674/0 (socket says 172.21.15.46:40674) 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 -- 172.21.15.46:0/1196299145 learned_addr learned my addr 172.21.15.46:0/1196299145 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff560944640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff561145640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff55c154720 0x7ff55c1ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 -- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 msgr2=0x7ff55c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c14f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 -- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff55c154720 msgr2=0x7ff55c1ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff55c154720 0x7ff55c1ebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 -- 172.21.15.46:0/1196299145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c0c8920 con 0x7ff55c151ef0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff561145640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff55c154720 0x7ff55c1ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff55bfff640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 0x7ff55c1e1e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff544009870 tx=0x7ff5440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544041020 con 0x7ff55c151ef0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff544030640 con 0x7ff55c151ef0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c1e2bb0 con 0x7ff55c151ef0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544037040 con 0x7ff55c151ef0 2024-05-09T02:23:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.914+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c0c8360 con 0x7ff55c151ef0 2024-05-09T02:23:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.915+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c072c20 con 0x7ff55c151ef0 2024-05-09T02:23:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.916+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff544044020 con 0x7ff55c151ef0 2024-05-09T02:23:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.917+0000 7ff5597fa640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff53c0762d0 0x7ff53c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.917+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ff5440b8260 con 0x7ff55c151ef0 2024-05-09T02:23:58.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.917+0000 7ff560944640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff53c0762d0 0x7ff53c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:58.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.918+0000 7ff560944640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff53c0762d0 0x7ff53c0787e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009a30 tx=0x7ff54c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:58.922+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff55c072c20 con 0x7ff55c151ef0 2024-05-09T02:23:59.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.111+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 --> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff55c1efb50 con 0x7ff53c0762d0 2024-05-09T02:23:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.123+0000 7ff5597fa640 1 -- 172.21.15.46:0/1196299145 <== mgr.4105 v2:172.21.15.107:6832/2302910508 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493281 (secure 0 0 0) 0x7ff55c1efb50 con 0x7ff53c0762d0 2024-05-09T02:23:59.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:59.133 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff53c0762d0 msgr2=0x7ff53c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff53c0762d0 0x7ff53c0787e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009a30 tx=0x7ff54c008040 comp rx=0 tx=0).stop 2024-05-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 msgr2=0x7ff55c1e1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 0x7ff55c1e1e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff544009870 tx=0x7ff5440046c0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 shutdown_connections 2024-05-09T02:23:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7ff53c0762d0 0x7ff53c0787e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff55c154720 0x7ff55c1ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff55c151ef0 0x7ff55c1e1e80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 --2- 172.21.15.46:0/1196299145 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff55c0a91e0 0x7ff55c14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 >> 172.21.15.46:0/1196299145 conn(0x7ff55c0c5940 msgr2=0x7ff55c0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 shutdown_connections 2024-05-09T02:23:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.127+0000 7ff562ba8640 1 -- 172.21.15.46:0/1196299145 wait complete. 2024-05-09T02:23:59.141 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-05-09T02:23:58.604673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018636,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":546,"num_read_kb":945,"num_write":18928,"num_write_kb":50333845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18947,"ondisk_log_size":18947,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":415408,"kb_used_data":4976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754559312,"statfs":{"total":773094113280,"available":772668735488,"internally_reserved":0,"allocated":5095424,"data_stored":3325928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":420204083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003820"},"pg_stats":[{"pgid":"5.18","version":"32'162","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.553031+0000","last_change":"2024-05-09T02:23:31.553062+0000","last_active":"2024-05-09T02:23:31.553031+0000","last_peered":"2024-05-09T02:23:31.553031+0000","last_clean":"2024-05-09T02:23:31.553031+0000","last_became_active":"2024-05-09T02:18:23.202659+0000","last_became_peered":"2024-05-09T02:18:23.202659+0000","last_unstale":"2024-05-09T02:23:31.553031+0000","last_undegraded":"2024-05-09T02:23:31.553031+0000","last_fullsized":"2024-05-09T02:23:31.553031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'162","last_scrub_stamp":"2024-05-09T02:23:31.552921+0000","last_deep_scrub":"32'162","last_deep_scrub_stamp":"2024-05-09T02:23:31.552921+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.552921+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:13.397097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"33'9","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.720026+0000","last_change":"2024-05-09T02:23:19.720059+0000","last_active":"2024-05-09T02:23:19.720026+0000","last_peered":"2024-05-09T02:23:19.720026+0000","last_clean":"2024-05-09T02:23:19.720026+0000","last_became_active":"2024-05-09T02:18:13.134732+0000","last_became_peered":"2024-05-09T02:18:13.134732+0000","last_unstale":"2024-05-09T02:23:19.720026+0000","last_undegraded":"2024-05-09T02:23:19.720026+0000","last_fullsized":"2024-05-09T02:23:19.720026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-05-09T02:23:19.719930+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-05-09T02:23:19.719930+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.719930+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:58.886675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'147","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.325356+0000","last_change":"2024-05-09T02:23:25.325386+0000","last_active":"2024-05-09T02:23:25.325356+0000","last_peered":"2024-05-09T02:23:25.325356+0000","last_clean":"2024-05-09T02:23:25.325356+0000","last_became_active":"2024-05-09T02:18:14.155764+0000","last_became_peered":"2024-05-09T02:18:14.155764+0000","last_unstale":"2024-05-09T02:23:25.325356+0000","last_undegraded":"2024-05-09T02:23:25.325356+0000","last_fullsized":"2024-05-09T02:23:25.325356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2024-05-09T02:23:25.325246+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2024-05-09T02:23:25.325246+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.325246+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:18.471703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.348714+0000","last_change":"2024-05-09T02:23:17.348737+0000","last_active":"2024-05-09T02:23:17.348714+0000","last_peered":"2024-05-09T02:23:17.348714+0000","last_clean":"2024-05-09T02:23:17.348714+0000","last_became_active":"2024-05-09T02:18:22.194979+0000","last_became_peered":"2024-05-09T02:18:22.194979+0000","last_unstale":"2024-05-09T02:23:17.348714+0000","last_undegraded":"2024-05-09T02:23:17.348714+0000","last_fullsized":"2024-05-09T02:23:17.348714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.348621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.348621+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.348621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:10.960779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"32'147","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.735473+0000","last_change":"2024-05-09T02:23:23.735531+0000","last_active":"2024-05-09T02:23:23.735473+0000","last_peered":"2024-05-09T02:23:23.735473+0000","last_clean":"2024-05-09T02:23:23.735473+0000","last_became_active":"2024-05-09T02:18:23.203641+0000","last_became_peered":"2024-05-09T02:18:23.203641+0000","last_unstale":"2024-05-09T02:23:23.735473+0000","last_undegraded":"2024-05-09T02:23:23.735473+0000","last_fullsized":"2024-05-09T02:23:23.735473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'147","last_scrub_stamp":"2024-05-09T02:23:23.735357+0000","last_deep_scrub":"32'147","last_deep_scrub_stamp":"2024-05-09T02:23:23.735357+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.735357+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:23.064318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.183172+0000","last_change":"2024-05-09T02:23:32.183214+0000","last_active":"2024-05-09T02:23:32.183172+0000","last_peered":"2024-05-09T02:23:32.183172+0000","last_clean":"2024-05-09T02:23:32.183172+0000","last_became_active":"2024-05-09T02:18:13.152308+0000","last_became_peered":"2024-05-09T02:18:13.152308+0000","last_unstale":"2024-05-09T02:23:32.183172+0000","last_undegraded":"2024-05-09T02:23:32.183172+0000","last_fullsized":"2024-05-09T02:23:32.183172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:32.183066+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:32.183066+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.183066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:26.137402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:14.706501+0000","last_change":"2024-05-09T02:23:14.706526+0000","last_active":"2024-05-09T02:23:14.706501+0000","last_peered":"2024-05-09T02:23:14.706501+0000","last_clean":"2024-05-09T02:23:14.706501+0000","last_became_active":"2024-05-09T02:18:14.149813+0000","last_became_peered":"2024-05-09T02:18:14.149813+0000","last_unstale":"2024-05-09T02:23:14.706501+0000","last_undegraded":"2024-05-09T02:23:14.706501+0000","last_fullsized":"2024-05-09T02:23:14.706501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:14.706404+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:14.706404+0000","last_clean_scrub_stamp":"2024-05-09T02:23:14.706404+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:15.880208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.740804+0000","last_change":"2024-05-09T02:23:21.740850+0000","last_active":"2024-05-09T02:23:21.740804+0000","last_peered":"2024-05-09T02:23:21.740804+0000","last_clean":"2024-05-09T02:23:21.740804+0000","last_became_active":"2024-05-09T02:18:22.201377+0000","last_became_peered":"2024-05-09T02:18:22.201377+0000","last_unstale":"2024-05-09T02:23:21.740804+0000","last_undegraded":"2024-05-09T02:23:21.740804+0000","last_fullsized":"2024-05-09T02:23:21.740804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:21.740663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:21.740663+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.740663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:17.959617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"32'123","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:46.024242+0000","last_change":"2024-05-09T02:23:46.024272+0000","last_active":"2024-05-09T02:23:46.024242+0000","last_peered":"2024-05-09T02:23:46.024242+0000","last_clean":"2024-05-09T02:23:46.024242+0000","last_became_active":"2024-05-09T02:18:23.225125+0000","last_became_peered":"2024-05-09T02:18:23.225125+0000","last_unstale":"2024-05-09T02:23:46.024242+0000","last_undegraded":"2024-05-09T02:23:46.024242+0000","last_fullsized":"2024-05-09T02:23:46.024242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:46.024127+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:46.024127+0000","last_clean_scrub_stamp":"2024-05-09T02:23:46.024127+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:08.446506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"33'5","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.058531+0000","last_change":"2024-05-09T02:23:36.058565+0000","last_active":"2024-05-09T02:23:36.058531+0000","last_peered":"2024-05-09T02:23:36.058531+0000","last_clean":"2024-05-09T02:23:36.058531+0000","last_became_active":"2024-05-09T02:18:13.142730+0000","last_became_peered":"2024-05-09T02:18:13.142730+0000","last_unstale":"2024-05-09T02:23:36.058531+0000","last_undegraded":"2024-05-09T02:23:36.058531+0000","last_fullsized":"2024-05-09T02:23:36.058531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-09T02:23:36.058433+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-09T02:23:36.058433+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.058433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:30.658462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'132","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.588072+0000","last_change":"2024-05-09T02:23:34.588105+0000","last_active":"2024-05-09T02:23:34.588072+0000","last_peered":"2024-05-09T02:23:34.588072+0000","last_clean":"2024-05-09T02:23:34.588072+0000","last_became_active":"2024-05-09T02:18:14.146855+0000","last_became_peered":"2024-05-09T02:18:14.146855+0000","last_unstale":"2024-05-09T02:23:34.588072+0000","last_undegraded":"2024-05-09T02:23:34.588072+0000","last_fullsized":"2024-05-09T02:23:34.588072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:34.587965+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:34.587965+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.587965+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:32.382529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.725663+0000","last_change":"2024-05-09T02:23:22.725691+0000","last_active":"2024-05-09T02:23:22.725663+0000","last_peered":"2024-05-09T02:23:22.725663+0000","last_clean":"2024-05-09T02:23:22.725663+0000","last_became_active":"2024-05-09T02:18:22.194793+0000","last_became_peered":"2024-05-09T02:18:22.194793+0000","last_unstale":"2024-05-09T02:23:22.725663+0000","last_undegraded":"2024-05-09T02:23:22.725663+0000","last_fullsized":"2024-05-09T02:23:22.725663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T02:23:22.725547+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T02:23:22.725547+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.725547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:41.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.621709+0000","last_change":"2024-05-09T02:23:35.621739+0000","last_active":"2024-05-09T02:23:35.621709+0000","last_peered":"2024-05-09T02:23:35.621709+0000","last_clean":"2024-05-09T02:23:35.621709+0000","last_became_active":"2024-05-09T02:18:23.209872+0000","last_became_peered":"2024-05-09T02:18:23.209872+0000","last_unstale":"2024-05-09T02:23:35.621709+0000","last_undegraded":"2024-05-09T02:23:35.621709+0000","last_fullsized":"2024-05-09T02:23:35.621709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:35.621607+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:35.621607+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.621607+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:30.221635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"33'3","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:37.100445+0000","last_change":"2024-05-09T02:23:37.100478+0000","last_active":"2024-05-09T02:23:37.100445+0000","last_peered":"2024-05-09T02:23:37.100445+0000","last_clean":"2024-05-09T02:23:37.100445+0000","last_became_active":"2024-05-09T02:18:13.145145+0000","last_became_peered":"2024-05-09T02:18:13.145145+0000","last_unstale":"2024-05-09T02:23:37.100445+0000","last_undegraded":"2024-05-09T02:23:37.100445+0000","last_fullsized":"2024-05-09T02:23:37.100445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:37.100327+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:37.100327+0000","last_clean_scrub_stamp":"2024-05-09T02:23:37.100327+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:31.054663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'168","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.582207+0000","last_change":"2024-05-09T02:23:32.582235+0000","last_active":"2024-05-09T02:23:32.582207+0000","last_peered":"2024-05-09T02:23:32.582207+0000","last_clean":"2024-05-09T02:23:32.582207+0000","last_became_active":"2024-05-09T02:18:14.146579+0000","last_became_peered":"2024-05-09T02:18:14.146579+0000","last_unstale":"2024-05-09T02:23:32.582207+0000","last_undegraded":"2024-05-09T02:23:32.582207+0000","last_fullsized":"2024-05-09T02:23:32.582207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2024-05-09T02:23:32.582096+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2024-05-09T02:23:32.582096+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.582096+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:18.585969+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.724488+0000","last_change":"2024-05-09T02:23:20.724488+0000","last_active":"2024-05-09T02:23:20.724488+0000","last_peered":"2024-05-09T02:23:20.724488+0000","last_clean":"2024-05-09T02:23:20.724488+0000","last_became_active":"2024-05-09T02:18:22.196573+0000","last_became_peered":"2024-05-09T02:18:22.196573+0000","last_unstale":"2024-05-09T02:23:20.724488+0000","last_undegraded":"2024-05-09T02:23:20.724488+0000","last_fullsized":"2024-05-09T02:23:20.724488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T02:23:20.724359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T02:23:20.724359+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.724359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:23.322074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.681038+0000","last_change":"2024-05-09T02:23:34.681070+0000","last_active":"2024-05-09T02:23:34.681038+0000","last_peered":"2024-05-09T02:23:34.681038+0000","last_clean":"2024-05-09T02:23:34.681038+0000","last_became_active":"2024-05-09T02:18:23.214858+0000","last_became_peered":"2024-05-09T02:18:23.214858+0000","last_unstale":"2024-05-09T02:23:34.681038+0000","last_undegraded":"2024-05-09T02:23:34.681038+0000","last_fullsized":"2024-05-09T02:23:34.681038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:34.680930+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:34.680930+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.680930+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:05.235217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.614867+0000","last_change":"2024-05-09T02:23:18.614913+0000","last_active":"2024-05-09T02:23:18.614867+0000","last_peered":"2024-05-09T02:23:18.614867+0000","last_clean":"2024-05-09T02:23:18.614867+0000","last_became_active":"2024-05-09T02:18:14.154713+0000","last_became_peered":"2024-05-09T02:18:14.154713+0000","last_unstale":"2024-05-09T02:23:18.614867+0000","last_undegraded":"2024-05-09T02:23:18.614867+0000","last_fullsized":"2024-05-09T02:23:18.614867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:18.614738+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:18.614738+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.614738+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:54.695345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.037810+0000","last_change":"2024-05-09T02:23:35.037842+0000","last_active":"2024-05-09T02:23:35.037810+0000","last_peered":"2024-05-09T02:23:35.037810+0000","last_clean":"2024-05-09T02:23:35.037810+0000","last_became_active":"2024-05-09T02:18:13.138430+0000","last_became_peered":"2024-05-09T02:18:13.138430+0000","last_unstale":"2024-05-09T02:23:35.037810+0000","last_undegraded":"2024-05-09T02:23:35.037810+0000","last_fullsized":"2024-05-09T02:23:35.037810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-05-09T02:23:35.037700+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-05-09T02:23:35.037700+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.037700+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:32.832264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.529780+0000","last_change":"2024-05-09T02:23:30.529849+0000","last_active":"2024-05-09T02:23:30.529780+0000","last_peered":"2024-05-09T02:23:30.529780+0000","last_clean":"2024-05-09T02:23:30.529780+0000","last_became_active":"2024-05-09T02:18:22.191897+0000","last_became_peered":"2024-05-09T02:18:22.191897+0000","last_unstale":"2024-05-09T02:23:30.529780+0000","last_undegraded":"2024-05-09T02:23:30.529780+0000","last_fullsized":"2024-05-09T02:23:30.529780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:30.529653+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:30.529653+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.529653+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:32.725129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.375798+0000","last_change":"2024-05-09T02:23:30.375846+0000","last_active":"2024-05-09T02:23:30.375798+0000","last_peered":"2024-05-09T02:23:30.375798+0000","last_clean":"2024-05-09T02:23:30.375798+0000","last_became_active":"2024-05-09T02:18:23.210525+0000","last_became_peered":"2024-05-09T02:18:23.210525+0000","last_unstale":"2024-05-09T02:23:30.375798+0000","last_undegraded":"2024-05-09T02:23:30.375798+0000","last_fullsized":"2024-05-09T02:23:30.375798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:30.375683+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:30.375683+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.375683+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:50.437848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'135","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.184660+0000","last_change":"2024-05-09T02:23:33.184694+0000","last_active":"2024-05-09T02:23:33.184660+0000","last_peered":"2024-05-09T02:23:33.184660+0000","last_clean":"2024-05-09T02:23:33.184660+0000","last_became_active":"2024-05-09T02:18:14.144497+0000","last_became_peered":"2024-05-09T02:18:14.144497+0000","last_unstale":"2024-05-09T02:23:33.184660+0000","last_undegraded":"2024-05-09T02:23:33.184660+0000","last_fullsized":"2024-05-09T02:23:33.184660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2024-05-09T02:23:33.184543+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2024-05-09T02:23:33.184543+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.184543+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:49.077729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.658756+0000","last_change":"2024-05-09T02:23:30.658808+0000","last_active":"2024-05-09T02:23:30.658756+0000","last_peered":"2024-05-09T02:23:30.658756+0000","last_clean":"2024-05-09T02:23:30.658756+0000","last_became_active":"2024-05-09T02:18:13.150774+0000","last_became_peered":"2024-05-09T02:18:13.150774+0000","last_unstale":"2024-05-09T02:23:30.658756+0000","last_undegraded":"2024-05-09T02:23:30.658756+0000","last_fullsized":"2024-05-09T02:23:30.658756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.658639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.658639+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.658639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:05.135226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.771337+0000","last_change":"2024-05-09T02:23:16.771365+0000","last_active":"2024-05-09T02:23:16.771337+0000","last_peered":"2024-05-09T02:23:16.771337+0000","last_clean":"2024-05-09T02:23:16.771337+0000","last_became_active":"2024-05-09T02:18:22.198479+0000","last_became_peered":"2024-05-09T02:18:22.198479+0000","last_unstale":"2024-05-09T02:23:16.771337+0000","last_undegraded":"2024-05-09T02:23:16.771337+0000","last_fullsized":"2024-05-09T02:23:16.771337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:16.771184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:16.771184+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.771184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:00.157243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"32'141","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.573501+0000","last_change":"2024-05-09T02:23:32.573532+0000","last_active":"2024-05-09T02:23:32.573501+0000","last_peered":"2024-05-09T02:23:32.573501+0000","last_clean":"2024-05-09T02:23:32.573501+0000","last_became_active":"2024-05-09T02:18:23.204747+0000","last_became_peered":"2024-05-09T02:18:23.204747+0000","last_unstale":"2024-05-09T02:23:32.573501+0000","last_undegraded":"2024-05-09T02:23:32.573501+0000","last_fullsized":"2024-05-09T02:23:32.573501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:32.573372+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:32.573372+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.573372+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:57.569794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'144","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:37.105889+0000","last_change":"2024-05-09T02:23:37.105919+0000","last_active":"2024-05-09T02:23:37.105889+0000","last_peered":"2024-05-09T02:23:37.105889+0000","last_clean":"2024-05-09T02:23:37.105889+0000","last_became_active":"2024-05-09T02:18:14.147604+0000","last_became_peered":"2024-05-09T02:18:14.147604+0000","last_unstale":"2024-05-09T02:23:37.105889+0000","last_undegraded":"2024-05-09T02:23:37.105889+0000","last_fullsized":"2024-05-09T02:23:37.105889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:37.105772+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:37.105772+0000","last_clean_scrub_stamp":"2024-05-09T02:23:37.105772+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:50.777278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.713466+0000","last_change":"2024-05-09T02:23:27.713493+0000","last_active":"2024-05-09T02:23:27.713466+0000","last_peered":"2024-05-09T02:23:27.713466+0000","last_clean":"2024-05-09T02:23:27.713466+0000","last_became_active":"2024-05-09T02:18:13.146731+0000","last_became_peered":"2024-05-09T02:18:13.146731+0000","last_unstale":"2024-05-09T02:23:27.713466+0000","last_undegraded":"2024-05-09T02:23:27.713466+0000","last_fullsized":"2024-05-09T02:23:27.713466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:27.713363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:27.713363+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.713363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:51.203058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.632072+0000","last_change":"2024-05-09T02:23:19.632109+0000","last_active":"2024-05-09T02:23:19.632072+0000","last_peered":"2024-05-09T02:23:19.632072+0000","last_clean":"2024-05-09T02:23:19.632072+0000","last_became_active":"2024-05-09T02:18:22.199589+0000","last_became_peered":"2024-05-09T02:18:22.199589+0000","last_unstale":"2024-05-09T02:23:19.632072+0000","last_undegraded":"2024-05-09T02:23:19.632072+0000","last_fullsized":"2024-05-09T02:23:19.632072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:19.631974+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:19.631974+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.631974+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:38.690659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:37.596865+0000","last_change":"2024-05-09T02:23:37.596898+0000","last_active":"2024-05-09T02:23:37.596865+0000","last_peered":"2024-05-09T02:23:37.596865+0000","last_clean":"2024-05-09T02:23:37.596865+0000","last_became_active":"2024-05-09T02:18:23.211362+0000","last_became_peered":"2024-05-09T02:18:23.211362+0000","last_unstale":"2024-05-09T02:23:37.596865+0000","last_undegraded":"2024-05-09T02:23:37.596865+0000","last_fullsized":"2024-05-09T02:23:37.596865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:37.596719+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:37.596719+0000","last_clean_scrub_stamp":"2024-05-09T02:23:37.596719+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:53.489905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'132","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.605560+0000","last_change":"2024-05-09T02:23:28.605615+0000","last_active":"2024-05-09T02:23:28.605560+0000","last_peered":"2024-05-09T02:23:28.605560+0000","last_clean":"2024-05-09T02:23:28.605560+0000","last_became_active":"2024-05-09T02:18:14.151547+0000","last_became_peered":"2024-05-09T02:18:14.151547+0000","last_unstale":"2024-05-09T02:23:28.605560+0000","last_undegraded":"2024-05-09T02:23:28.605560+0000","last_fullsized":"2024-05-09T02:23:28.605560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:28.605430+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:28.605430+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.605430+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:53.824976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.018678+0000","last_change":"2024-05-09T02:23:33.018703+0000","last_active":"2024-05-09T02:23:33.018678+0000","last_peered":"2024-05-09T02:23:33.018678+0000","last_clean":"2024-05-09T02:23:33.018678+0000","last_became_active":"2024-05-09T02:18:13.132988+0000","last_became_peered":"2024-05-09T02:18:13.132988+0000","last_unstale":"2024-05-09T02:23:33.018678+0000","last_undegraded":"2024-05-09T02:23:33.018678+0000","last_fullsized":"2024-05-09T02:23:33.018678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:33.018563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:33.018563+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.018563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:19.022436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'3","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.690877+0000","last_change":"2024-05-09T02:23:19.690931+0000","last_active":"2024-05-09T02:23:19.690877+0000","last_peered":"2024-05-09T02:23:19.690877+0000","last_clean":"2024-05-09T02:23:19.690877+0000","last_became_active":"2024-05-09T02:18:22.200024+0000","last_became_peered":"2024-05-09T02:18:22.200024+0000","last_unstale":"2024-05-09T02:23:19.690877+0000","last_undegraded":"2024-05-09T02:23:19.690877+0000","last_fullsized":"2024-05-09T02:23:19.690877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:19.690785+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:19.690785+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.690785+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:46.749852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"32'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:42.127779+0000","last_change":"2024-05-09T02:23:42.127811+0000","last_active":"2024-05-09T02:23:42.127779+0000","last_peered":"2024-05-09T02:23:42.127779+0000","last_clean":"2024-05-09T02:23:42.127779+0000","last_became_active":"2024-05-09T02:18:23.220440+0000","last_became_peered":"2024-05-09T02:18:23.220440+0000","last_unstale":"2024-05-09T02:23:42.127779+0000","last_undegraded":"2024-05-09T02:23:42.127779+0000","last_fullsized":"2024-05-09T02:23:42.127779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:42.127657+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:42.127657+0000","last_clean_scrub_stamp":"2024-05-09T02:23:42.127657+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.703212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'156","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.655546+0000","last_change":"2024-05-09T02:23:25.655585+0000","last_active":"2024-05-09T02:23:25.655546+0000","last_peered":"2024-05-09T02:23:25.655546+0000","last_clean":"2024-05-09T02:23:25.655546+0000","last_became_active":"2024-05-09T02:18:14.146997+0000","last_became_peered":"2024-05-09T02:18:14.146997+0000","last_unstale":"2024-05-09T02:23:25.655546+0000","last_undegraded":"2024-05-09T02:23:25.655546+0000","last_fullsized":"2024-05-09T02:23:25.655546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2024-05-09T02:23:25.655433+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2024-05-09T02:23:25.655433+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.655433+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:32.787111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.651689+0000","last_change":"2024-05-09T02:23:24.651719+0000","last_active":"2024-05-09T02:23:24.651689+0000","last_peered":"2024-05-09T02:23:24.651689+0000","last_clean":"2024-05-09T02:23:24.651689+0000","last_became_active":"2024-05-09T02:18:13.146620+0000","last_became_peered":"2024-05-09T02:18:13.146620+0000","last_unstale":"2024-05-09T02:23:24.651689+0000","last_undegraded":"2024-05-09T02:23:24.651689+0000","last_fullsized":"2024-05-09T02:23:24.651689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:24.651595+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:24.651595+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.651595+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:20.870550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'7","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.564573+0000","last_change":"2024-05-09T02:23:29.564626+0000","last_active":"2024-05-09T02:23:29.564573+0000","last_peered":"2024-05-09T02:23:29.564573+0000","last_clean":"2024-05-09T02:23:29.564573+0000","last_became_active":"2024-05-09T02:18:22.191229+0000","last_became_peered":"2024-05-09T02:18:22.191229+0000","last_unstale":"2024-05-09T02:23:29.564573+0000","last_undegraded":"2024-05-09T02:23:29.564573+0000","last_fullsized":"2024-05-09T02:23:29.564573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-09T02:23:29.564446+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-09T02:23:29.564446+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.564446+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:54.204411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"32'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.614870+0000","last_change":"2024-05-09T02:23:35.614952+0000","last_active":"2024-05-09T02:23:35.614870+0000","last_peered":"2024-05-09T02:23:35.614870+0000","last_clean":"2024-05-09T02:23:35.614870+0000","last_became_active":"2024-05-09T02:18:23.219111+0000","last_became_peered":"2024-05-09T02:18:23.219111+0000","last_unstale":"2024-05-09T02:23:35.614870+0000","last_undegraded":"2024-05-09T02:23:35.614870+0000","last_fullsized":"2024-05-09T02:23:35.614870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:35.614737+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:35.614737+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.614737+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:10.091325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.232314+0000","last_change":"2024-05-09T02:23:27.232362+0000","last_active":"2024-05-09T02:23:27.232314+0000","last_peered":"2024-05-09T02:23:27.232314+0000","last_clean":"2024-05-09T02:23:27.232314+0000","last_became_active":"2024-05-09T02:18:14.151242+0000","last_became_peered":"2024-05-09T02:18:14.151242+0000","last_unstale":"2024-05-09T02:23:27.232314+0000","last_undegraded":"2024-05-09T02:23:27.232314+0000","last_fullsized":"2024-05-09T02:23:27.232314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:27.232191+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:27.232191+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.232191+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:40.601131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'21","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.669157+0000","last_change":"2024-05-09T02:23:25.669201+0000","last_active":"2024-05-09T02:23:25.669157+0000","last_peered":"2024-05-09T02:23:25.669157+0000","last_clean":"2024-05-09T02:23:25.669157+0000","last_became_active":"2024-05-09T02:18:13.144325+0000","last_became_peered":"2024-05-09T02:18:13.144325+0000","last_unstale":"2024-05-09T02:23:25.669157+0000","last_undegraded":"2024-05-09T02:23:25.669157+0000","last_fullsized":"2024-05-09T02:23:25.669157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-05-09T02:23:25.669041+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-05-09T02:23:25.669041+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.669041+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:50.309007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.356894+0000","last_change":"2024-05-09T02:23:24.356967+0000","last_active":"2024-05-09T02:23:24.356894+0000","last_peered":"2024-05-09T02:23:24.356894+0000","last_clean":"2024-05-09T02:23:24.356894+0000","last_became_active":"2024-05-09T02:18:22.200857+0000","last_became_peered":"2024-05-09T02:18:22.200857+0000","last_unstale":"2024-05-09T02:23:24.356894+0000","last_undegraded":"2024-05-09T02:23:24.356894+0000","last_fullsized":"2024-05-09T02:23:24.356894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:24.356774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:24.356774+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.356774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:14.905536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'150","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.475506+0000","last_change":"2024-05-09T02:23:33.475538+0000","last_active":"2024-05-09T02:23:33.475506+0000","last_peered":"2024-05-09T02:23:33.475506+0000","last_clean":"2024-05-09T02:23:33.475506+0000","last_became_active":"2024-05-09T02:18:23.201282+0000","last_became_peered":"2024-05-09T02:18:23.201282+0000","last_unstale":"2024-05-09T02:23:33.475506+0000","last_undegraded":"2024-05-09T02:23:33.475506+0000","last_fullsized":"2024-05-09T02:23:33.475506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'150","last_scrub_stamp":"2024-05-09T02:23:33.475389+0000","last_deep_scrub":"32'150","last_deep_scrub_stamp":"2024-05-09T02:23:33.475389+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.475389+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:15.319566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"31'135","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.672905+0000","last_change":"2024-05-09T02:23:20.672933+0000","last_active":"2024-05-09T02:23:20.672905+0000","last_peered":"2024-05-09T02:23:20.672905+0000","last_clean":"2024-05-09T02:23:20.672905+0000","last_became_active":"2024-05-09T02:18:14.150031+0000","last_became_peered":"2024-05-09T02:18:14.150031+0000","last_unstale":"2024-05-09T02:23:20.672905+0000","last_undegraded":"2024-05-09T02:23:20.672905+0000","last_fullsized":"2024-05-09T02:23:20.672905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2024-05-09T02:23:20.672790+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2024-05-09T02:23:20.672790+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.672790+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:48.573682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.998725+0000","last_change":"2024-05-09T02:23:33.998750+0000","last_active":"2024-05-09T02:23:33.998725+0000","last_peered":"2024-05-09T02:23:33.998725+0000","last_clean":"2024-05-09T02:23:33.998725+0000","last_became_active":"2024-05-09T02:18:13.135801+0000","last_became_peered":"2024-05-09T02:18:13.135801+0000","last_unstale":"2024-05-09T02:23:33.998725+0000","last_undegraded":"2024-05-09T02:23:33.998725+0000","last_fullsized":"2024-05-09T02:23:33.998725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:33.998612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:33.998612+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.998612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:24.661498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.750006+0000","last_change":"2024-05-09T02:23:17.750053+0000","last_active":"2024-05-09T02:23:17.750006+0000","last_peered":"2024-05-09T02:23:17.750006+0000","last_clean":"2024-05-09T02:23:17.750006+0000","last_became_active":"2024-05-09T02:18:22.189620+0000","last_became_peered":"2024-05-09T02:18:22.189620+0000","last_unstale":"2024-05-09T02:23:17.750006+0000","last_undegraded":"2024-05-09T02:23:17.750006+0000","last_fullsized":"2024-05-09T02:23:17.750006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.749896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.749896+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.749896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:39.044135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'138","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.602071+0000","last_change":"2024-05-09T02:23:31.602103+0000","last_active":"2024-05-09T02:23:31.602071+0000","last_peered":"2024-05-09T02:23:31.602071+0000","last_clean":"2024-05-09T02:23:31.602071+0000","last_became_active":"2024-05-09T02:18:23.198458+0000","last_became_peered":"2024-05-09T02:18:23.198458+0000","last_unstale":"2024-05-09T02:23:31.602071+0000","last_undegraded":"2024-05-09T02:23:31.602071+0000","last_fullsized":"2024-05-09T02:23:31.602071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:31.601959+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:31.601959+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.601959+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:56.598381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.694439+0000","last_change":"2024-05-09T02:23:18.694472+0000","last_active":"2024-05-09T02:23:18.694439+0000","last_peered":"2024-05-09T02:23:18.694439+0000","last_clean":"2024-05-09T02:23:18.694439+0000","last_became_active":"2024-05-09T02:18:14.160983+0000","last_became_peered":"2024-05-09T02:18:14.160983+0000","last_unstale":"2024-05-09T02:23:18.694439+0000","last_undegraded":"2024-05-09T02:23:18.694439+0000","last_fullsized":"2024-05-09T02:23:18.694439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:18.694336+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:18.694336+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.694336+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:51.329288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.689063+0000","last_change":"2024-05-09T02:23:28.689089+0000","last_active":"2024-05-09T02:23:28.689063+0000","last_peered":"2024-05-09T02:23:28.689063+0000","last_clean":"2024-05-09T02:23:28.689063+0000","last_became_active":"2024-05-09T02:18:13.146837+0000","last_became_peered":"2024-05-09T02:18:13.146837+0000","last_unstale":"2024-05-09T02:23:28.689063+0000","last_undegraded":"2024-05-09T02:23:28.689063+0000","last_fullsized":"2024-05-09T02:23:28.689063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:28.688956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:28.688956+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.688956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:19.237718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.611732+0000","last_change":"2024-05-09T02:23:17.611754+0000","last_active":"2024-05-09T02:23:17.611732+0000","last_peered":"2024-05-09T02:23:17.611732+0000","last_clean":"2024-05-09T02:23:17.611732+0000","last_became_active":"2024-05-09T02:18:22.197206+0000","last_became_peered":"2024-05-09T02:18:22.197206+0000","last_unstale":"2024-05-09T02:23:17.611732+0000","last_undegraded":"2024-05-09T02:23:17.611732+0000","last_fullsized":"2024-05-09T02:23:17.611732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.611635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.611635+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.611635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:20.209350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'138","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.635303+0000","last_change":"2024-05-09T02:23:34.635332+0000","last_active":"2024-05-09T02:23:34.635303+0000","last_peered":"2024-05-09T02:23:34.635303+0000","last_clean":"2024-05-09T02:23:34.635303+0000","last_became_active":"2024-05-09T02:18:23.223967+0000","last_became_peered":"2024-05-09T02:18:23.223967+0000","last_unstale":"2024-05-09T02:23:34.635303+0000","last_undegraded":"2024-05-09T02:23:34.635303+0000","last_fullsized":"2024-05-09T02:23:34.635303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:34.635179+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:34.635179+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.635179+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:09.111766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'138","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.649295+0000","last_change":"2024-05-09T02:23:24.649323+0000","last_active":"2024-05-09T02:23:24.649295+0000","last_peered":"2024-05-09T02:23:24.649295+0000","last_clean":"2024-05-09T02:23:24.649295+0000","last_became_active":"2024-05-09T02:18:14.135880+0000","last_became_peered":"2024-05-09T02:18:14.135880+0000","last_unstale":"2024-05-09T02:23:24.649295+0000","last_undegraded":"2024-05-09T02:23:24.649295+0000","last_fullsized":"2024-05-09T02:23:24.649295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:24.649184+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:24.649184+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.649184+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:05.574640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.629699+0000","last_change":"2024-05-09T02:23:30.629726+0000","last_active":"2024-05-09T02:23:30.629699+0000","last_peered":"2024-05-09T02:23:30.629699+0000","last_clean":"2024-05-09T02:23:30.629699+0000","last_became_active":"2024-05-09T02:18:13.147777+0000","last_became_peered":"2024-05-09T02:18:13.147777+0000","last_unstale":"2024-05-09T02:23:30.629699+0000","last_undegraded":"2024-05-09T02:23:30.629699+0000","last_fullsized":"2024-05-09T02:23:30.629699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.629594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.629594+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.629594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:08.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.568267+0000","last_change":"2024-05-09T02:23:16.568296+0000","last_active":"2024-05-09T02:23:16.568267+0000","last_peered":"2024-05-09T02:23:16.568267+0000","last_clean":"2024-05-09T02:23:16.568267+0000","last_became_active":"2024-05-09T02:18:22.194394+0000","last_became_peered":"2024-05-09T02:18:22.194394+0000","last_unstale":"2024-05-09T02:23:16.568267+0000","last_undegraded":"2024-05-09T02:23:16.568267+0000","last_fullsized":"2024-05-09T02:23:16.568267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:16.568139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:16.568139+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.568139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:43.627206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"32'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.342587+0000","last_change":"2024-05-09T02:23:28.342617+0000","last_active":"2024-05-09T02:23:28.342587+0000","last_peered":"2024-05-09T02:23:28.342587+0000","last_clean":"2024-05-09T02:23:28.342587+0000","last_became_active":"2024-05-09T02:18:23.205959+0000","last_became_peered":"2024-05-09T02:18:23.205959+0000","last_unstale":"2024-05-09T02:23:28.342587+0000","last_undegraded":"2024-05-09T02:23:28.342587+0000","last_fullsized":"2024-05-09T02:23:28.342587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'156","last_scrub_stamp":"2024-05-09T02:23:28.342476+0000","last_deep_scrub":"32'156","last_deep_scrub_stamp":"2024-05-09T02:23:28.342476+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.342476+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:49.882581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.650866+0000","last_change":"2024-05-09T02:23:18.650894+0000","last_active":"2024-05-09T02:23:18.650866+0000","last_peered":"2024-05-09T02:23:18.650866+0000","last_clean":"2024-05-09T02:23:18.650866+0000","last_became_active":"2024-05-09T02:18:14.149598+0000","last_became_peered":"2024-05-09T02:18:14.149598+0000","last_unstale":"2024-05-09T02:23:18.650866+0000","last_undegraded":"2024-05-09T02:23:18.650866+0000","last_fullsized":"2024-05-09T02:23:18.650866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:18.650744+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:18.650744+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.650744+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:14.869698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'7","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.232534+0000","last_change":"2024-05-09T02:23:20.232577+0000","last_active":"2024-05-09T02:23:20.232534+0000","last_peered":"2024-05-09T02:23:20.232534+0000","last_clean":"2024-05-09T02:23:20.232534+0000","last_became_active":"2024-05-09T02:18:13.149552+0000","last_became_peered":"2024-05-09T02:18:13.149552+0000","last_unstale":"2024-05-09T02:23:20.232534+0000","last_undegraded":"2024-05-09T02:23:20.232534+0000","last_fullsized":"2024-05-09T02:23:20.232534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-09T02:23:20.232407+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-09T02:23:20.232407+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.232407+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:21.406211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.575848+0000","last_change":"2024-05-09T02:23:15.575875+0000","last_active":"2024-05-09T02:23:15.575848+0000","last_peered":"2024-05-09T02:23:15.575848+0000","last_clean":"2024-05-09T02:23:15.575848+0000","last_became_active":"2024-05-09T02:18:22.196644+0000","last_became_peered":"2024-05-09T02:18:22.196644+0000","last_unstale":"2024-05-09T02:23:15.575848+0000","last_undegraded":"2024-05-09T02:23:15.575848+0000","last_fullsized":"2024-05-09T02:23:15.575848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:15.575763+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:15.575763+0000","last_clean_scrub_stamp":"2024-05-09T02:23:15.575763+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:36.158577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.699777+0000","last_change":"2024-05-09T02:23:25.699855+0000","last_active":"2024-05-09T02:23:25.699777+0000","last_peered":"2024-05-09T02:23:25.699777+0000","last_clean":"2024-05-09T02:23:25.699777+0000","last_became_active":"2024-05-09T02:18:23.204960+0000","last_became_peered":"2024-05-09T02:18:23.204960+0000","last_unstale":"2024-05-09T02:23:25.699777+0000","last_undegraded":"2024-05-09T02:23:25.699777+0000","last_fullsized":"2024-05-09T02:23:25.699777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:25.699656+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:25.699656+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.699656+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:30.113263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"31'126","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.705583+0000","last_change":"2024-05-09T02:23:21.705638+0000","last_active":"2024-05-09T02:23:21.705583+0000","last_peered":"2024-05-09T02:23:21.705583+0000","last_clean":"2024-05-09T02:23:21.705583+0000","last_became_active":"2024-05-09T02:18:14.136619+0000","last_became_peered":"2024-05-09T02:18:14.136619+0000","last_unstale":"2024-05-09T02:23:21.705583+0000","last_undegraded":"2024-05-09T02:23:21.705583+0000","last_fullsized":"2024-05-09T02:23:21.705583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:21.705409+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:21.705409+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.705409+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:06.714013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:38.052460+0000","last_change":"2024-05-09T02:23:38.052513+0000","last_active":"2024-05-09T02:23:38.052460+0000","last_peered":"2024-05-09T02:23:38.052460+0000","last_clean":"2024-05-09T02:23:38.052460+0000","last_became_active":"2024-05-09T02:18:13.147723+0000","last_became_peered":"2024-05-09T02:18:13.147723+0000","last_unstale":"2024-05-09T02:23:38.052460+0000","last_undegraded":"2024-05-09T02:23:38.052460+0000","last_fullsized":"2024-05-09T02:23:38.052460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:38.052340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:38.052340+0000","last_clean_scrub_stamp":"2024-05-09T02:23:38.052340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:53.945526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'22","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.568430+0000","last_change":"2024-05-09T02:23:30.568467+0000","last_active":"2024-05-09T02:23:30.568430+0000","last_peered":"2024-05-09T02:23:30.568430+0000","last_clean":"2024-05-09T02:23:30.568430+0000","last_became_active":"2024-05-09T02:18:22.196032+0000","last_became_peered":"2024-05-09T02:18:22.196032+0000","last_unstale":"2024-05-09T02:23:30.568430+0000","last_undegraded":"2024-05-09T02:23:30.568430+0000","last_fullsized":"2024-05-09T02:23:30.568430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-09T02:23:30.568314+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-09T02:23:30.568314+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.568314+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:12.412491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"32'135","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.026259+0000","last_change":"2024-05-09T02:23:26.026290+0000","last_active":"2024-05-09T02:23:26.026259+0000","last_peered":"2024-05-09T02:23:26.026259+0000","last_clean":"2024-05-09T02:23:26.026259+0000","last_became_active":"2024-05-09T02:18:23.221154+0000","last_became_peered":"2024-05-09T02:18:23.221154+0000","last_unstale":"2024-05-09T02:23:26.026259+0000","last_undegraded":"2024-05-09T02:23:26.026259+0000","last_fullsized":"2024-05-09T02:23:26.026259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'135","last_scrub_stamp":"2024-05-09T02:23:26.026153+0000","last_deep_scrub":"32'135","last_deep_scrub_stamp":"2024-05-09T02:23:26.026153+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.026153+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:30.439760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'150","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.330870+0000","last_change":"2024-05-09T02:23:21.330933+0000","last_active":"2024-05-09T02:23:21.330870+0000","last_peered":"2024-05-09T02:23:21.330870+0000","last_clean":"2024-05-09T02:23:21.330870+0000","last_became_active":"2024-05-09T02:18:14.158577+0000","last_became_peered":"2024-05-09T02:18:14.158577+0000","last_unstale":"2024-05-09T02:23:21.330870+0000","last_undegraded":"2024-05-09T02:23:21.330870+0000","last_fullsized":"2024-05-09T02:23:21.330870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2024-05-09T02:23:21.330750+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2024-05-09T02:23:21.330750+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.330750+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:23.526226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.611129+0000","last_change":"2024-05-09T02:23:27.611159+0000","last_active":"2024-05-09T02:23:27.611129+0000","last_peered":"2024-05-09T02:23:27.611129+0000","last_clean":"2024-05-09T02:23:27.611129+0000","last_became_active":"2024-05-09T02:18:13.141494+0000","last_became_peered":"2024-05-09T02:18:13.141494+0000","last_unstale":"2024-05-09T02:23:27.611129+0000","last_undegraded":"2024-05-09T02:23:27.611129+0000","last_fullsized":"2024-05-09T02:23:27.611129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:27.611013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:27.611013+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.611013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:17.386612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.053099+0000","last_change":"2024-05-09T02:23:32.053193+0000","last_active":"2024-05-09T02:23:32.053099+0000","last_peered":"2024-05-09T02:23:32.053099+0000","last_clean":"2024-05-09T02:23:32.053099+0000","last_became_active":"2024-05-09T02:18:04.031661+0000","last_became_peered":"2024-05-09T02:18:04.031661+0000","last_unstale":"2024-05-09T02:23:32.053099+0000","last_undegraded":"2024-05-09T02:23:32.053099+0000","last_fullsized":"2024-05-09T02:23:32.053099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-05-09T02:23:32.052980+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-05-09T02:23:32.052980+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.052980+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:28.069653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.556517+0000","last_change":"2024-05-09T02:23:29.556546+0000","last_active":"2024-05-09T02:23:29.556517+0000","last_peered":"2024-05-09T02:23:29.556517+0000","last_clean":"2024-05-09T02:23:29.556517+0000","last_became_active":"2024-05-09T02:18:22.197533+0000","last_became_peered":"2024-05-09T02:18:22.197533+0000","last_unstale":"2024-05-09T02:23:29.556517+0000","last_undegraded":"2024-05-09T02:23:29.556517+0000","last_fullsized":"2024-05-09T02:23:29.556517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:29.556411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:29.556411+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.556411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:53.602152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"32'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.247355+0000","last_change":"2024-05-09T02:23:25.247398+0000","last_active":"2024-05-09T02:23:25.247355+0000","last_peered":"2024-05-09T02:23:25.247355+0000","last_clean":"2024-05-09T02:23:25.247355+0000","last_became_active":"2024-05-09T02:18:23.201864+0000","last_became_peered":"2024-05-09T02:18:23.201864+0000","last_unstale":"2024-05-09T02:23:25.247355+0000","last_undegraded":"2024-05-09T02:23:25.247355+0000","last_fullsized":"2024-05-09T02:23:25.247355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'135","last_scrub_stamp":"2024-05-09T02:23:25.247234+0000","last_deep_scrub":"32'135","last_deep_scrub_stamp":"2024-05-09T02:23:25.247234+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.247234+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:04.413980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.979835+0000","last_change":"2024-05-09T02:23:20.979869+0000","last_active":"2024-05-09T02:23:20.979835+0000","last_peered":"2024-05-09T02:23:20.979835+0000","last_clean":"2024-05-09T02:23:20.979835+0000","last_became_active":"2024-05-09T02:18:14.154939+0000","last_became_peered":"2024-05-09T02:18:14.154939+0000","last_unstale":"2024-05-09T02:23:20.979835+0000","last_undegraded":"2024-05-09T02:23:20.979835+0000","last_fullsized":"2024-05-09T02:23:20.979835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:20.979724+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:20.979724+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.979724+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:14.591883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.203297+0000","last_change":"2024-05-09T02:23:18.203321+0000","last_active":"2024-05-09T02:23:18.203297+0000","last_peered":"2024-05-09T02:23:18.203297+0000","last_clean":"2024-05-09T02:23:18.203297+0000","last_became_active":"2024-05-09T02:18:13.144218+0000","last_became_peered":"2024-05-09T02:18:13.144218+0000","last_unstale":"2024-05-09T02:23:18.203297+0000","last_undegraded":"2024-05-09T02:23:18.203297+0000","last_fullsized":"2024-05-09T02:23:18.203297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:18.203206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:18.203206+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.203206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:57.469982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.517093+0000","last_change":"2024-05-09T02:23:30.517126+0000","last_active":"2024-05-09T02:23:30.517093+0000","last_peered":"2024-05-09T02:23:30.517093+0000","last_clean":"2024-05-09T02:23:30.517093+0000","last_became_active":"2024-05-09T02:18:22.201679+0000","last_became_peered":"2024-05-09T02:18:22.201679+0000","last_unstale":"2024-05-09T02:23:30.517093+0000","last_undegraded":"2024-05-09T02:23:30.517093+0000","last_fullsized":"2024-05-09T02:23:30.517093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.516987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.516987+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.516987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:19.076365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"32'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.224847+0000","last_change":"2024-05-09T02:23:16.224895+0000","last_active":"2024-05-09T02:23:16.224847+0000","last_peered":"2024-05-09T02:23:16.224847+0000","last_clean":"2024-05-09T02:23:16.224847+0000","last_became_active":"2024-05-09T02:18:23.204509+0000","last_became_peered":"2024-05-09T02:18:23.204509+0000","last_unstale":"2024-05-09T02:23:16.224847+0000","last_undegraded":"2024-05-09T02:23:16.224847+0000","last_fullsized":"2024-05-09T02:23:16.224847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:16.224705+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:16.224705+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.224705+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:35.610074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'138","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.363335+0000","last_change":"2024-05-09T02:23:33.363422+0000","last_active":"2024-05-09T02:23:33.363335+0000","last_peered":"2024-05-09T02:23:33.363335+0000","last_clean":"2024-05-09T02:23:33.363335+0000","last_became_active":"2024-05-09T02:18:55.756398+0000","last_became_peered":"2024-05-09T02:18:55.756398+0000","last_unstale":"2024-05-09T02:23:33.363335+0000","last_undegraded":"2024-05-09T02:23:33.363335+0000","last_fullsized":"2024-05-09T02:23:33.363335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:33.363198+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:33.363198+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.363198+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:58.582744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"33'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.703692+0000","last_change":"2024-05-09T02:23:29.703769+0000","last_active":"2024-05-09T02:23:29.703692+0000","last_peered":"2024-05-09T02:23:29.703692+0000","last_clean":"2024-05-09T02:23:29.703692+0000","last_became_active":"2024-05-09T02:18:13.149648+0000","last_became_peered":"2024-05-09T02:18:13.149648+0000","last_unstale":"2024-05-09T02:23:29.703692+0000","last_undegraded":"2024-05-09T02:23:29.703692+0000","last_fullsized":"2024-05-09T02:23:29.703692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:29.703566+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:29.703566+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.703566+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:22.850023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'8","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.575575+0000","last_change":"2024-05-09T02:23:29.575604+0000","last_active":"2024-05-09T02:23:29.575575+0000","last_peered":"2024-05-09T02:23:29.575575+0000","last_clean":"2024-05-09T02:23:29.575575+0000","last_became_active":"2024-05-09T02:18:22.195178+0000","last_became_peered":"2024-05-09T02:18:22.195178+0000","last_unstale":"2024-05-09T02:23:29.575575+0000","last_undegraded":"2024-05-09T02:23:29.575575+0000","last_fullsized":"2024-05-09T02:23:29.575575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-05-09T02:23:29.575478+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-05-09T02:23:29.575478+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.575478+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:31.770954+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"32'132","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:44.052868+0000","last_change":"2024-05-09T02:23:44.052898+0000","last_active":"2024-05-09T02:23:44.052868+0000","last_peered":"2024-05-09T02:23:44.052868+0000","last_clean":"2024-05-09T02:23:44.052868+0000","last_became_active":"2024-05-09T02:18:23.224199+0000","last_became_peered":"2024-05-09T02:18:23.224199+0000","last_unstale":"2024-05-09T02:23:44.052868+0000","last_undegraded":"2024-05-09T02:23:44.052868+0000","last_fullsized":"2024-05-09T02:23:44.052868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'132","last_scrub_stamp":"2024-05-09T02:23:44.052750+0000","last_deep_scrub":"32'132","last_deep_scrub_stamp":"2024-05-09T02:23:44.052750+0000","last_clean_scrub_stamp":"2024-05-09T02:23:44.052750+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:12.027401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.027297+0000","last_change":"2024-05-09T02:23:22.027347+0000","last_active":"2024-05-09T02:23:22.027297+0000","last_peered":"2024-05-09T02:23:22.027297+0000","last_clean":"2024-05-09T02:23:22.027297+0000","last_became_active":"2024-05-09T02:18:14.157421+0000","last_became_peered":"2024-05-09T02:18:14.157421+0000","last_unstale":"2024-05-09T02:23:22.027297+0000","last_undegraded":"2024-05-09T02:23:22.027297+0000","last_fullsized":"2024-05-09T02:23:22.027297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:22.027134+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:22.027134+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.027134+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:21.356095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'3","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.225426+0000","last_change":"2024-05-09T02:23:21.225464+0000","last_active":"2024-05-09T02:23:21.225426+0000","last_peered":"2024-05-09T02:23:21.225426+0000","last_clean":"2024-05-09T02:23:21.225426+0000","last_became_active":"2024-05-09T02:18:13.150460+0000","last_became_peered":"2024-05-09T02:18:13.150460+0000","last_unstale":"2024-05-09T02:23:21.225426+0000","last_undegraded":"2024-05-09T02:23:21.225426+0000","last_fullsized":"2024-05-09T02:23:21.225426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:21.225323+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:21.225323+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.225323+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:10.505514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.699839+0000","last_change":"2024-05-09T02:23:19.699866+0000","last_active":"2024-05-09T02:23:19.699839+0000","last_peered":"2024-05-09T02:23:19.699839+0000","last_clean":"2024-05-09T02:23:19.699839+0000","last_became_active":"2024-05-09T02:18:22.199575+0000","last_became_peered":"2024-05-09T02:18:22.199575+0000","last_unstale":"2024-05-09T02:23:19.699839+0000","last_undegraded":"2024-05-09T02:23:19.699839+0000","last_fullsized":"2024-05-09T02:23:19.699839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:19.699736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:19.699736+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.699736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:04.306690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.250701+0000","last_change":"2024-05-09T02:23:17.250726+0000","last_active":"2024-05-09T02:23:17.250701+0000","last_peered":"2024-05-09T02:23:17.250701+0000","last_clean":"2024-05-09T02:23:17.250701+0000","last_became_active":"2024-05-09T02:18:23.202773+0000","last_became_peered":"2024-05-09T02:18:23.202773+0000","last_unstale":"2024-05-09T02:23:17.250701+0000","last_undegraded":"2024-05-09T02:23:17.250701+0000","last_fullsized":"2024-05-09T02:23:17.250701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:17.250603+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:17.250603+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.250603+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:48:29.937306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'141","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.987173+0000","last_change":"2024-05-09T02:23:22.987227+0000","last_active":"2024-05-09T02:23:22.987173+0000","last_peered":"2024-05-09T02:23:22.987173+0000","last_clean":"2024-05-09T02:23:22.987173+0000","last_became_active":"2024-05-09T02:18:14.153983+0000","last_became_peered":"2024-05-09T02:18:14.153983+0000","last_unstale":"2024-05-09T02:23:22.987173+0000","last_undegraded":"2024-05-09T02:23:22.987173+0000","last_fullsized":"2024-05-09T02:23:22.987173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:22.987025+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:22.987025+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.987025+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:48.206571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'2","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.689309+0000","last_change":"2024-05-09T02:23:23.689342+0000","last_active":"2024-05-09T02:23:23.689309+0000","last_peered":"2024-05-09T02:23:23.689309+0000","last_clean":"2024-05-09T02:23:23.689309+0000","last_became_active":"2024-05-09T02:18:13.145613+0000","last_became_peered":"2024-05-09T02:18:13.145613+0000","last_unstale":"2024-05-09T02:23:23.689309+0000","last_undegraded":"2024-05-09T02:23:23.689309+0000","last_fullsized":"2024-05-09T02:23:23.689309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:23.689222+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:23.689222+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.689222+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:51.590114+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.773918+0000","last_change":"2024-05-09T02:23:17.773960+0000","last_active":"2024-05-09T02:23:17.773918+0000","last_peered":"2024-05-09T02:23:17.773918+0000","last_clean":"2024-05-09T02:23:17.773918+0000","last_became_active":"2024-05-09T02:18:22.199888+0000","last_became_peered":"2024-05-09T02:18:22.199888+0000","last_unstale":"2024-05-09T02:23:17.773918+0000","last_undegraded":"2024-05-09T02:23:17.773918+0000","last_fullsized":"2024-05-09T02:23:17.773918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:17.773807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:17.773807+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.773807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:33.459440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"32'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:41.140094+0000","last_change":"2024-05-09T02:23:41.140125+0000","last_active":"2024-05-09T02:23:41.140094+0000","last_peered":"2024-05-09T02:23:41.140094+0000","last_clean":"2024-05-09T02:23:41.140094+0000","last_became_active":"2024-05-09T02:18:23.220408+0000","last_became_peered":"2024-05-09T02:18:23.220408+0000","last_unstale":"2024-05-09T02:23:41.140094+0000","last_undegraded":"2024-05-09T02:23:41.140094+0000","last_fullsized":"2024-05-09T02:23:41.140094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'132","last_scrub_stamp":"2024-05-09T02:23:41.139973+0000","last_deep_scrub":"32'132","last_deep_scrub_stamp":"2024-05-09T02:23:41.139973+0000","last_clean_scrub_stamp":"2024-05-09T02:23:41.139973+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:03.562352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'183","reported_seq":230,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.061173+0000","last_change":"2024-05-09T02:23:27.061201+0000","last_active":"2024-05-09T02:23:27.061173+0000","last_peered":"2024-05-09T02:23:27.061173+0000","last_clean":"2024-05-09T02:23:27.061173+0000","last_became_active":"2024-05-09T02:18:14.153183+0000","last_became_peered":"2024-05-09T02:18:14.153183+0000","last_unstale":"2024-05-09T02:23:27.061173+0000","last_undegraded":"2024-05-09T02:23:27.061173+0000","last_fullsized":"2024-05-09T02:23:27.061173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'183","last_scrub_stamp":"2024-05-09T02:23:27.061064+0000","last_deep_scrub":"31'183","last_deep_scrub_stamp":"2024-05-09T02:23:27.061064+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.061064+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:50.550759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'13","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.246659+0000","last_change":"2024-05-09T02:23:19.246696+0000","last_active":"2024-05-09T02:23:19.246659+0000","last_peered":"2024-05-09T02:23:19.246659+0000","last_clean":"2024-05-09T02:23:19.246659+0000","last_became_active":"2024-05-09T02:18:13.148102+0000","last_became_peered":"2024-05-09T02:18:13.148102+0000","last_unstale":"2024-05-09T02:23:19.246659+0000","last_undegraded":"2024-05-09T02:23:19.246659+0000","last_fullsized":"2024-05-09T02:23:19.246659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-09T02:23:19.246557+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-09T02:23:19.246557+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.246557+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:47.440976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.619072+0000","last_change":"2024-05-09T02:23:28.619100+0000","last_active":"2024-05-09T02:23:28.619072+0000","last_peered":"2024-05-09T02:23:28.619072+0000","last_clean":"2024-05-09T02:23:28.619072+0000","last_became_active":"2024-05-09T02:18:22.193970+0000","last_became_peered":"2024-05-09T02:18:22.193970+0000","last_unstale":"2024-05-09T02:23:28.619072+0000","last_undegraded":"2024-05-09T02:23:28.619072+0000","last_fullsized":"2024-05-09T02:23:28.619072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:28.618963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:28.618963+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.618963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:53.258928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"32'219","reported_seq":257,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:40.556305+0000","last_change":"2024-05-09T02:23:40.556344+0000","last_active":"2024-05-09T02:23:40.556305+0000","last_peered":"2024-05-09T02:23:40.556305+0000","last_clean":"2024-05-09T02:23:40.556305+0000","last_became_active":"2024-05-09T02:18:23.219107+0000","last_became_peered":"2024-05-09T02:18:23.219107+0000","last_unstale":"2024-05-09T02:23:40.556305+0000","last_undegraded":"2024-05-09T02:23:40.556305+0000","last_fullsized":"2024-05-09T02:23:40.556305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'219","last_scrub_stamp":"2024-05-09T02:23:40.556190+0000","last_deep_scrub":"32'219","last_deep_scrub_stamp":"2024-05-09T02:23:40.556190+0000","last_clean_scrub_stamp":"2024-05-09T02:23:40.556190+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:24.835663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'159","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.587657+0000","last_change":"2024-05-09T02:23:27.587712+0000","last_active":"2024-05-09T02:23:27.587657+0000","last_peered":"2024-05-09T02:23:27.587657+0000","last_clean":"2024-05-09T02:23:27.587657+0000","last_became_active":"2024-05-09T02:18:14.153282+0000","last_became_peered":"2024-05-09T02:18:14.153282+0000","last_unstale":"2024-05-09T02:23:27.587657+0000","last_undegraded":"2024-05-09T02:23:27.587657+0000","last_fullsized":"2024-05-09T02:23:27.587657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'159","last_scrub_stamp":"2024-05-09T02:23:27.587524+0000","last_deep_scrub":"31'159","last_deep_scrub_stamp":"2024-05-09T02:23:27.587524+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.587524+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:47.649689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.636559+0000","last_change":"2024-05-09T02:23:22.636616+0000","last_active":"2024-05-09T02:23:22.636559+0000","last_peered":"2024-05-09T02:23:22.636559+0000","last_clean":"2024-05-09T02:23:22.636559+0000","last_became_active":"2024-05-09T02:18:13.144067+0000","last_became_peered":"2024-05-09T02:18:13.144067+0000","last_unstale":"2024-05-09T02:23:22.636559+0000","last_undegraded":"2024-05-09T02:23:22.636559+0000","last_fullsized":"2024-05-09T02:23:22.636559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:22.636406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:22.636406+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.636406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:01.803152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.373584+0000","last_change":"2024-05-09T02:23:22.373614+0000","last_active":"2024-05-09T02:23:22.373584+0000","last_peered":"2024-05-09T02:23:22.373584+0000","last_clean":"2024-05-09T02:23:22.373584+0000","last_became_active":"2024-05-09T02:18:22.200520+0000","last_became_peered":"2024-05-09T02:18:22.200520+0000","last_unstale":"2024-05-09T02:23:22.373584+0000","last_undegraded":"2024-05-09T02:23:22.373584+0000","last_fullsized":"2024-05-09T02:23:22.373584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T02:23:22.373470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T02:23:22.373470+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.373470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:04.217646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:38.550494+0000","last_change":"2024-05-09T02:23:38.550523+0000","last_active":"2024-05-09T02:23:38.550494+0000","last_peered":"2024-05-09T02:23:38.550494+0000","last_clean":"2024-05-09T02:23:38.550494+0000","last_became_active":"2024-05-09T02:18:23.216045+0000","last_became_peered":"2024-05-09T02:18:23.216045+0000","last_unstale":"2024-05-09T02:23:38.550494+0000","last_undegraded":"2024-05-09T02:23:38.550494+0000","last_fullsized":"2024-05-09T02:23:38.550494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:38.550351+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:38.550351+0000","last_clean_scrub_stamp":"2024-05-09T02:23:38.550351+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:12.869623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'156","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.994627+0000","last_change":"2024-05-09T02:23:23.994658+0000","last_active":"2024-05-09T02:23:23.994627+0000","last_peered":"2024-05-09T02:23:23.994627+0000","last_clean":"2024-05-09T02:23:23.994627+0000","last_became_active":"2024-05-09T02:18:14.157375+0000","last_became_peered":"2024-05-09T02:18:14.157375+0000","last_unstale":"2024-05-09T02:23:23.994627+0000","last_undegraded":"2024-05-09T02:23:23.994627+0000","last_fullsized":"2024-05-09T02:23:23.994627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2024-05-09T02:23:23.994520+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2024-05-09T02:23:23.994520+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.994520+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:48.634485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.614316+0000","last_change":"2024-05-09T02:23:31.614343+0000","last_active":"2024-05-09T02:23:31.614316+0000","last_peered":"2024-05-09T02:23:31.614316+0000","last_clean":"2024-05-09T02:23:31.614316+0000","last_became_active":"2024-05-09T02:18:13.149969+0000","last_became_peered":"2024-05-09T02:18:13.149969+0000","last_unstale":"2024-05-09T02:23:31.614316+0000","last_undegraded":"2024-05-09T02:23:31.614316+0000","last_fullsized":"2024-05-09T02:23:31.614316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:31.614214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:31.614214+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.614214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:27.630887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'113","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.356282+0000","last_change":"2024-05-09T02:23:18.356318+0000","last_active":"2024-05-09T02:23:18.356282+0000","last_peered":"2024-05-09T02:23:18.356282+0000","last_clean":"2024-05-09T02:23:18.356282+0000","last_became_active":"2024-05-09T02:18:22.198504+0000","last_became_peered":"2024-05-09T02:18:22.198504+0000","last_unstale":"2024-05-09T02:23:18.356282+0000","last_undegraded":"2024-05-09T02:23:18.356282+0000","last_fullsized":"2024-05-09T02:23:18.356282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'113","last_scrub_stamp":"2024-05-09T02:23:18.356179+0000","last_deep_scrub":"33'113","last_deep_scrub_stamp":"2024-05-09T02:23:18.356179+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.356179+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:42.401921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":214,"num_write":106,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:39.113379+0000","last_change":"2024-05-09T02:23:39.113407+0000","last_active":"2024-05-09T02:23:39.113379+0000","last_peered":"2024-05-09T02:23:39.113379+0000","last_clean":"2024-05-09T02:23:39.113379+0000","last_became_active":"2024-05-09T02:18:23.219134+0000","last_became_peered":"2024-05-09T02:18:23.219134+0000","last_unstale":"2024-05-09T02:23:39.113379+0000","last_undegraded":"2024-05-09T02:23:39.113379+0000","last_fullsized":"2024-05-09T02:23:39.113379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:39.113270+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:39.113270+0000","last_clean_scrub_stamp":"2024-05-09T02:23:39.113270+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:07.087921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'148","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:15.748772+0000","last_change":"2024-05-09T02:23:15.748796+0000","last_active":"2024-05-09T02:23:15.748772+0000","last_peered":"2024-05-09T02:23:15.748772+0000","last_clean":"2024-05-09T02:23:15.748772+0000","last_became_active":"2024-05-09T02:18:14.151123+0000","last_became_peered":"2024-05-09T02:18:14.151123+0000","last_unstale":"2024-05-09T02:23:15.748772+0000","last_undegraded":"2024-05-09T02:23:15.748772+0000","last_fullsized":"2024-05-09T02:23:15.748772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2024-05-09T02:23:15.748682+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2024-05-09T02:23:15.748682+0000","last_clean_scrub_stamp":"2024-05-09T02:23:15.748682+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:05.028873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.689394+0000","last_change":"2024-05-09T02:23:20.689431+0000","last_active":"2024-05-09T02:23:20.689394+0000","last_peered":"2024-05-09T02:23:20.689394+0000","last_clean":"2024-05-09T02:23:20.689394+0000","last_became_active":"2024-05-09T02:18:13.141342+0000","last_became_peered":"2024-05-09T02:18:13.141342+0000","last_unstale":"2024-05-09T02:23:20.689394+0000","last_undegraded":"2024-05-09T02:23:20.689394+0000","last_fullsized":"2024-05-09T02:23:20.689394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:20.689279+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:20.689279+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.689279+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:23.286994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.692640+0000","last_change":"2024-05-09T02:23:21.692681+0000","last_active":"2024-05-09T02:23:21.692640+0000","last_peered":"2024-05-09T02:23:21.692640+0000","last_clean":"2024-05-09T02:23:21.692640+0000","last_became_active":"2024-05-09T02:18:22.199558+0000","last_became_peered":"2024-05-09T02:18:22.199558+0000","last_unstale":"2024-05-09T02:23:21.692640+0000","last_undegraded":"2024-05-09T02:23:21.692640+0000","last_fullsized":"2024-05-09T02:23:21.692640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-05-09T02:23:21.692535+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-05-09T02:23:21.692535+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.692535+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:21.021496+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"32'156","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.214337+0000","last_change":"2024-05-09T02:23:28.214371+0000","last_active":"2024-05-09T02:23:28.214337+0000","last_peered":"2024-05-09T02:23:28.214337+0000","last_clean":"2024-05-09T02:23:28.214337+0000","last_became_active":"2024-05-09T02:18:23.212966+0000","last_became_peered":"2024-05-09T02:18:23.212966+0000","last_unstale":"2024-05-09T02:23:28.214337+0000","last_undegraded":"2024-05-09T02:23:28.214337+0000","last_fullsized":"2024-05-09T02:23:28.214337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'156","last_scrub_stamp":"2024-05-09T02:23:28.214219+0000","last_deep_scrub":"32'156","last_deep_scrub_stamp":"2024-05-09T02:23:28.214219+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.214219+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:34.270151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.905070+0000","last_change":"2024-05-09T02:23:18.905104+0000","last_active":"2024-05-09T02:23:18.905070+0000","last_peered":"2024-05-09T02:23:18.905070+0000","last_clean":"2024-05-09T02:23:18.905070+0000","last_became_active":"2024-05-09T02:18:14.154010+0000","last_became_peered":"2024-05-09T02:18:14.154010+0000","last_unstale":"2024-05-09T02:23:18.905070+0000","last_undegraded":"2024-05-09T02:23:18.905070+0000","last_fullsized":"2024-05-09T02:23:18.905070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:18.904967+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:18.904967+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.904967+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:51.539919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'113","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.649720+0000","last_change":"2024-05-09T02:23:25.649756+0000","last_active":"2024-05-09T02:23:25.649720+0000","last_peered":"2024-05-09T02:23:25.649720+0000","last_clean":"2024-05-09T02:23:25.649720+0000","last_became_active":"2024-05-09T02:18:13.149458+0000","last_became_peered":"2024-05-09T02:18:13.149458+0000","last_unstale":"2024-05-09T02:23:25.649720+0000","last_undegraded":"2024-05-09T02:23:25.649720+0000","last_fullsized":"2024-05-09T02:23:25.649720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'113","last_scrub_stamp":"2024-05-09T02:23:25.649604+0000","last_deep_scrub":"33'113","last_deep_scrub_stamp":"2024-05-09T02:23:25.649604+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.649604+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:47.189710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215345,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":234,"num_write":106,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.719740+0000","last_change":"2024-05-09T02:23:21.719796+0000","last_active":"2024-05-09T02:23:21.719740+0000","last_peered":"2024-05-09T02:23:21.719740+0000","last_clean":"2024-05-09T02:23:21.719740+0000","last_became_active":"2024-05-09T02:18:22.199821+0000","last_became_peered":"2024-05-09T02:18:22.199821+0000","last_unstale":"2024-05-09T02:23:21.719740+0000","last_undegraded":"2024-05-09T02:23:21.719740+0000","last_fullsized":"2024-05-09T02:23:21.719740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:21.719619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:21.719619+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.719619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:02.645075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"32'148","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.662725+0000","last_change":"2024-05-09T02:23:33.662790+0000","last_active":"2024-05-09T02:23:33.662725+0000","last_peered":"2024-05-09T02:23:33.662725+0000","last_clean":"2024-05-09T02:23:33.662725+0000","last_became_active":"2024-05-09T02:18:23.214028+0000","last_became_peered":"2024-05-09T02:18:23.214028+0000","last_unstale":"2024-05-09T02:23:33.662725+0000","last_undegraded":"2024-05-09T02:23:33.662725+0000","last_fullsized":"2024-05-09T02:23:33.662725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'148","last_scrub_stamp":"2024-05-09T02:23:33.662595+0000","last_deep_scrub":"32'148","last_deep_scrub_stamp":"2024-05-09T02:23:33.662595+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.662595+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:10.604723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'138","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.642373+0000","last_change":"2024-05-09T02:23:26.642417+0000","last_active":"2024-05-09T02:23:26.642373+0000","last_peered":"2024-05-09T02:23:26.642373+0000","last_clean":"2024-05-09T02:23:26.642373+0000","last_became_active":"2024-05-09T02:18:14.151790+0000","last_became_peered":"2024-05-09T02:18:14.151790+0000","last_unstale":"2024-05-09T02:23:26.642373+0000","last_undegraded":"2024-05-09T02:23:26.642373+0000","last_fullsized":"2024-05-09T02:23:26.642373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:26.642252+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:26.642252+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.642252+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:25.971213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'11","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.674638+0000","last_change":"2024-05-09T02:23:26.674674+0000","last_active":"2024-05-09T02:23:26.674638+0000","last_peered":"2024-05-09T02:23:26.674638+0000","last_clean":"2024-05-09T02:23:26.674638+0000","last_became_active":"2024-05-09T02:18:13.144469+0000","last_became_peered":"2024-05-09T02:18:13.144469+0000","last_unstale":"2024-05-09T02:23:26.674638+0000","last_undegraded":"2024-05-09T02:23:26.674638+0000","last_fullsized":"2024-05-09T02:23:26.674638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-05-09T02:23:26.674533+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-05-09T02:23:26.674533+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.674533+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:52.833097+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.729931+0000","last_change":"2024-05-09T02:23:18.729975+0000","last_active":"2024-05-09T02:23:18.729931+0000","last_peered":"2024-05-09T02:23:18.729931+0000","last_clean":"2024-05-09T02:23:18.729931+0000","last_became_active":"2024-05-09T02:18:22.197366+0000","last_became_peered":"2024-05-09T02:18:22.197366+0000","last_unstale":"2024-05-09T02:23:18.729931+0000","last_undegraded":"2024-05-09T02:23:18.729931+0000","last_fullsized":"2024-05-09T02:23:18.729931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:18.729805+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:18.729805+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.729805+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:27:39.312619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"32'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.439433+0000","last_change":"2024-05-09T02:23:34.439492+0000","last_active":"2024-05-09T02:23:34.439433+0000","last_peered":"2024-05-09T02:23:34.439433+0000","last_clean":"2024-05-09T02:23:34.439433+0000","last_became_active":"2024-05-09T02:18:23.202802+0000","last_became_peered":"2024-05-09T02:18:23.202802+0000","last_unstale":"2024-05-09T02:23:34.439433+0000","last_undegraded":"2024-05-09T02:23:34.439433+0000","last_fullsized":"2024-05-09T02:23:34.439433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'183","last_scrub_stamp":"2024-05-09T02:23:34.439275+0000","last_deep_scrub":"32'183","last_deep_scrub_stamp":"2024-05-09T02:23:34.439275+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.439275+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:59.435696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'132","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.719627+0000","last_change":"2024-05-09T02:23:16.719680+0000","last_active":"2024-05-09T02:23:16.719627+0000","last_peered":"2024-05-09T02:23:16.719627+0000","last_clean":"2024-05-09T02:23:16.719627+0000","last_became_active":"2024-05-09T02:18:14.149349+0000","last_became_peered":"2024-05-09T02:18:14.149349+0000","last_unstale":"2024-05-09T02:23:16.719627+0000","last_undegraded":"2024-05-09T02:23:16.719627+0000","last_fullsized":"2024-05-09T02:23:16.719627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:16.719483+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:16.719483+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.719483+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:54.274974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.636240+0000","last_change":"2024-05-09T02:23:29.636267+0000","last_active":"2024-05-09T02:23:29.636240+0000","last_peered":"2024-05-09T02:23:29.636240+0000","last_clean":"2024-05-09T02:23:29.636240+0000","last_became_active":"2024-05-09T02:18:13.143462+0000","last_became_peered":"2024-05-09T02:18:13.143462+0000","last_unstale":"2024-05-09T02:23:29.636240+0000","last_undegraded":"2024-05-09T02:23:29.636240+0000","last_fullsized":"2024-05-09T02:23:29.636240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:29.636128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:29.636128+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.636128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:23.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'13","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:16.328837+0000","last_change":"2024-05-09T02:23:16.328894+0000","last_active":"2024-05-09T02:23:16.328837+0000","last_peered":"2024-05-09T02:23:16.328837+0000","last_clean":"2024-05-09T02:23:16.328837+0000","last_became_active":"2024-05-09T02:18:22.198343+0000","last_became_peered":"2024-05-09T02:18:22.198343+0000","last_unstale":"2024-05-09T02:23:16.328837+0000","last_undegraded":"2024-05-09T02:23:16.328837+0000","last_fullsized":"2024-05-09T02:23:16.328837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-09T02:23:16.328709+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-09T02:23:16.328709+0000","last_clean_scrub_stamp":"2024-05-09T02:23:16.328709+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:00.935663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"32'159","reported_seq":198,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:41.017686+0000","last_change":"2024-05-09T02:23:41.017716+0000","last_active":"2024-05-09T02:23:41.017686+0000","last_peered":"2024-05-09T02:23:41.017686+0000","last_clean":"2024-05-09T02:23:41.017686+0000","last_became_active":"2024-05-09T02:18:23.222356+0000","last_became_peered":"2024-05-09T02:18:23.222356+0000","last_unstale":"2024-05-09T02:23:41.017686+0000","last_undegraded":"2024-05-09T02:23:41.017686+0000","last_fullsized":"2024-05-09T02:23:41.017686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'159","last_scrub_stamp":"2024-05-09T02:23:41.017563+0000","last_deep_scrub":"32'159","last_deep_scrub_stamp":"2024-05-09T02:23:41.017563+0000","last_clean_scrub_stamp":"2024-05-09T02:23:41.017563+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:25.297035+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'219","reported_seq":251,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.364360+0000","last_change":"2024-05-09T02:23:32.364360+0000","last_active":"2024-05-09T02:23:32.364360+0000","last_peered":"2024-05-09T02:23:32.364360+0000","last_clean":"2024-05-09T02:23:32.364360+0000","last_became_active":"2024-05-09T02:18:55.680219+0000","last_became_peered":"2024-05-09T02:18:55.680219+0000","last_unstale":"2024-05-09T02:23:32.364360+0000","last_undegraded":"2024-05-09T02:23:32.364360+0000","last_fullsized":"2024-05-09T02:23:32.364360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'219","last_scrub_stamp":"2024-05-09T02:23:32.364147+0000","last_deep_scrub":"31'219","last_deep_scrub_stamp":"2024-05-09T02:23:32.364147+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.364147+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:56.409889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.626856+0000","last_change":"2024-05-09T02:23:23.626935+0000","last_active":"2024-05-09T02:23:23.626856+0000","last_peered":"2024-05-09T02:23:23.626856+0000","last_clean":"2024-05-09T02:23:23.626856+0000","last_became_active":"2024-05-09T02:18:13.144569+0000","last_became_peered":"2024-05-09T02:18:13.144569+0000","last_unstale":"2024-05-09T02:23:23.626856+0000","last_undegraded":"2024-05-09T02:23:23.626856+0000","last_fullsized":"2024-05-09T02:23:23.626856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-05-09T02:23:23.626725+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-05-09T02:23:23.626725+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.626725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:26.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.341665+0000","last_change":"2024-05-09T02:23:19.341696+0000","last_active":"2024-05-09T02:23:19.341665+0000","last_peered":"2024-05-09T02:23:19.341665+0000","last_clean":"2024-05-09T02:23:19.341665+0000","last_became_active":"2024-05-09T02:18:22.194591+0000","last_became_peered":"2024-05-09T02:18:22.194591+0000","last_unstale":"2024-05-09T02:23:19.341665+0000","last_undegraded":"2024-05-09T02:23:19.341665+0000","last_fullsized":"2024-05-09T02:23:19.341665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:19.341558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:19.341558+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.341558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:07.900936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.450835+0000","last_change":"2024-05-09T02:23:36.450865+0000","last_active":"2024-05-09T02:23:36.450835+0000","last_peered":"2024-05-09T02:23:36.450835+0000","last_clean":"2024-05-09T02:23:36.450835+0000","last_became_active":"2024-05-09T02:18:23.206608+0000","last_became_peered":"2024-05-09T02:18:23.206608+0000","last_unstale":"2024-05-09T02:23:36.450835+0000","last_undegraded":"2024-05-09T02:23:36.450835+0000","last_fullsized":"2024-05-09T02:23:36.450835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:36.450713+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:36.450713+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.450713+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:29.597170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.617115+0000","last_change":"2024-05-09T02:23:27.617159+0000","last_active":"2024-05-09T02:23:27.617115+0000","last_peered":"2024-05-09T02:23:27.617115+0000","last_clean":"2024-05-09T02:23:27.617115+0000","last_became_active":"2024-05-09T02:18:22.192161+0000","last_became_peered":"2024-05-09T02:18:22.192161+0000","last_unstale":"2024-05-09T02:23:27.617115+0000","last_undegraded":"2024-05-09T02:23:27.617115+0000","last_fullsized":"2024-05-09T02:23:27.617115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T02:23:27.616991+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T02:23:27.616991+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.616991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:16.176369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'147","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.770043+0000","last_change":"2024-05-09T02:23:22.770072+0000","last_active":"2024-05-09T02:23:22.770043+0000","last_peered":"2024-05-09T02:23:22.770043+0000","last_clean":"2024-05-09T02:23:22.770043+0000","last_became_active":"2024-05-09T02:18:14.144645+0000","last_became_peered":"2024-05-09T02:18:14.144645+0000","last_unstale":"2024-05-09T02:23:22.770043+0000","last_undegraded":"2024-05-09T02:23:22.770043+0000","last_fullsized":"2024-05-09T02:23:22.770043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2024-05-09T02:23:22.769932+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2024-05-09T02:23:22.769932+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.769932+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:16.382091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.613751+0000","last_change":"2024-05-09T02:23:28.613795+0000","last_active":"2024-05-09T02:23:28.613751+0000","last_peered":"2024-05-09T02:23:28.613751+0000","last_clean":"2024-05-09T02:23:28.613751+0000","last_became_active":"2024-05-09T02:18:13.140791+0000","last_became_peered":"2024-05-09T02:18:13.140791+0000","last_unstale":"2024-05-09T02:23:28.613751+0000","last_undegraded":"2024-05-09T02:23:28.613751+0000","last_fullsized":"2024-05-09T02:23:28.613751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:28.613608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:28.613608+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.613608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:06.871240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"32'147","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.592973+0000","last_change":"2024-05-09T02:23:33.593004+0000","last_active":"2024-05-09T02:23:33.592973+0000","last_peered":"2024-05-09T02:23:33.592973+0000","last_clean":"2024-05-09T02:23:33.592973+0000","last_became_active":"2024-05-09T02:18:23.212116+0000","last_became_peered":"2024-05-09T02:18:23.212116+0000","last_unstale":"2024-05-09T02:23:33.592973+0000","last_undegraded":"2024-05-09T02:23:33.592973+0000","last_fullsized":"2024-05-09T02:23:33.592973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'147","last_scrub_stamp":"2024-05-09T02:23:33.592862+0000","last_deep_scrub":"32'147","last_deep_scrub_stamp":"2024-05-09T02:23:33.592862+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.592862+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:26.739318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.517925+0000","last_change":"2024-05-09T02:23:31.517959+0000","last_active":"2024-05-09T02:23:31.517925+0000","last_peered":"2024-05-09T02:23:31.517925+0000","last_clean":"2024-05-09T02:23:31.517925+0000","last_became_active":"2024-05-09T02:18:22.203132+0000","last_became_peered":"2024-05-09T02:18:22.203132+0000","last_unstale":"2024-05-09T02:23:31.517925+0000","last_undegraded":"2024-05-09T02:23:31.517925+0000","last_fullsized":"2024-05-09T02:23:31.517925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-05-09T02:23:31.517816+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-05-09T02:23:31.517816+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.517816+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:56.157781+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'162","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:40.684617+0000","last_change":"2024-05-09T02:23:40.684617+0000","last_active":"2024-05-09T02:23:40.684617+0000","last_peered":"2024-05-09T02:23:40.684617+0000","last_clean":"2024-05-09T02:23:40.684617+0000","last_became_active":"2024-05-09T02:18:55.677782+0000","last_became_peered":"2024-05-09T02:18:55.677782+0000","last_unstale":"2024-05-09T02:23:40.684617+0000","last_undegraded":"2024-05-09T02:23:40.684617+0000","last_fullsized":"2024-05-09T02:23:40.684617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'162","last_scrub_stamp":"2024-05-09T02:23:40.684458+0000","last_deep_scrub":"31'162","last_deep_scrub_stamp":"2024-05-09T02:23:40.684458+0000","last_clean_scrub_stamp":"2024-05-09T02:23:40.684458+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:24.963930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.188981+0000","last_change":"2024-05-09T02:23:30.189011+0000","last_active":"2024-05-09T02:23:30.188981+0000","last_peered":"2024-05-09T02:23:30.188981+0000","last_clean":"2024-05-09T02:23:30.188981+0000","last_became_active":"2024-05-09T02:18:13.146724+0000","last_became_peered":"2024-05-09T02:18:13.146724+0000","last_unstale":"2024-05-09T02:23:30.188981+0000","last_undegraded":"2024-05-09T02:23:30.188981+0000","last_fullsized":"2024-05-09T02:23:30.188981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T02:23:30.188853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T02:23:30.188853+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.188853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:00.743140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'168","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:38.688416+0000","last_change":"2024-05-09T02:23:38.688472+0000","last_active":"2024-05-09T02:23:38.688416+0000","last_peered":"2024-05-09T02:23:38.688416+0000","last_clean":"2024-05-09T02:23:38.688416+0000","last_became_active":"2024-05-09T02:18:23.227626+0000","last_became_peered":"2024-05-09T02:18:23.227626+0000","last_unstale":"2024-05-09T02:23:38.688416+0000","last_undegraded":"2024-05-09T02:23:38.688416+0000","last_fullsized":"2024-05-09T02:23:38.688416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'168","last_scrub_stamp":"2024-05-09T02:23:38.688300+0000","last_deep_scrub":"32'168","last_deep_scrub_stamp":"2024-05-09T02:23:38.688300+0000","last_clean_scrub_stamp":"2024-05-09T02:23:38.688300+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:13.007572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:21.672853+0000","last_change":"2024-05-09T02:23:21.672880+0000","last_active":"2024-05-09T02:23:21.672853+0000","last_peered":"2024-05-09T02:23:21.672853+0000","last_clean":"2024-05-09T02:23:21.672853+0000","last_became_active":"2024-05-09T02:18:13.143065+0000","last_became_peered":"2024-05-09T02:18:13.143065+0000","last_unstale":"2024-05-09T02:23:21.672853+0000","last_undegraded":"2024-05-09T02:23:21.672853+0000","last_fullsized":"2024-05-09T02:23:21.672853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:21.672734+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:21.672734+0000","last_clean_scrub_stamp":"2024-05-09T02:23:21.672734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:29.604157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'129","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.733975+0000","last_change":"2024-05-09T02:23:22.734032+0000","last_active":"2024-05-09T02:23:22.733975+0000","last_peered":"2024-05-09T02:23:22.733975+0000","last_clean":"2024-05-09T02:23:22.733975+0000","last_became_active":"2024-05-09T02:18:14.138737+0000","last_became_peered":"2024-05-09T02:18:14.138737+0000","last_unstale":"2024-05-09T02:23:22.733975+0000","last_undegraded":"2024-05-09T02:23:22.733975+0000","last_fullsized":"2024-05-09T02:23:22.733975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:22.733815+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:22.733815+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.733815+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:44.273921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.257890+0000","last_change":"2024-05-09T02:23:24.257984+0000","last_active":"2024-05-09T02:23:24.257890+0000","last_peered":"2024-05-09T02:23:24.257890+0000","last_clean":"2024-05-09T02:23:24.257890+0000","last_became_active":"2024-05-09T02:18:22.200001+0000","last_became_peered":"2024-05-09T02:18:22.200001+0000","last_unstale":"2024-05-09T02:23:24.257890+0000","last_undegraded":"2024-05-09T02:23:24.257890+0000","last_fullsized":"2024-05-09T02:23:24.257890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-09T02:23:24.257754+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-09T02:23:24.257754+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.257754+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:32.189177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"32'132","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:38.686115+0000","last_change":"2024-05-09T02:23:38.686168+0000","last_active":"2024-05-09T02:23:38.686115+0000","last_peered":"2024-05-09T02:23:38.686115+0000","last_clean":"2024-05-09T02:23:38.686115+0000","last_became_active":"2024-05-09T02:18:23.222324+0000","last_became_peered":"2024-05-09T02:18:23.222324+0000","last_unstale":"2024-05-09T02:23:38.686115+0000","last_undegraded":"2024-05-09T02:23:38.686115+0000","last_fullsized":"2024-05-09T02:23:38.686115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'132","last_scrub_stamp":"2024-05-09T02:23:38.685992+0000","last_deep_scrub":"32'132","last_deep_scrub_stamp":"2024-05-09T02:23:38.685992+0000","last_clean_scrub_stamp":"2024-05-09T02:23:38.685992+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:15.628120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.203716+0000","last_change":"2024-05-09T02:23:31.203748+0000","last_active":"2024-05-09T02:23:31.203716+0000","last_peered":"2024-05-09T02:23:31.203716+0000","last_clean":"2024-05-09T02:23:31.203716+0000","last_became_active":"2024-05-09T02:18:13.150644+0000","last_became_peered":"2024-05-09T02:18:13.150644+0000","last_unstale":"2024-05-09T02:23:31.203716+0000","last_undegraded":"2024-05-09T02:23:31.203716+0000","last_fullsized":"2024-05-09T02:23:31.203716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-09T02:23:31.203613+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-09T02:23:31.203613+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.203613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:36.598591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'123","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.625364+0000","last_change":"2024-05-09T02:23:25.625439+0000","last_active":"2024-05-09T02:23:25.625364+0000","last_peered":"2024-05-09T02:23:25.625364+0000","last_clean":"2024-05-09T02:23:25.625364+0000","last_became_active":"2024-05-09T02:18:14.150172+0000","last_became_peered":"2024-05-09T02:18:14.150172+0000","last_unstale":"2024-05-09T02:23:25.625364+0000","last_undegraded":"2024-05-09T02:23:25.625364+0000","last_fullsized":"2024-05-09T02:23:25.625364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:25.625238+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:25.625238+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.625238+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:45.687403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'5","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.374799+0000","last_change":"2024-05-09T02:23:20.374799+0000","last_active":"2024-05-09T02:23:20.374799+0000","last_peered":"2024-05-09T02:23:20.374799+0000","last_clean":"2024-05-09T02:23:20.374799+0000","last_became_active":"2024-05-09T02:18:22.198603+0000","last_became_peered":"2024-05-09T02:18:22.198603+0000","last_unstale":"2024-05-09T02:23:20.374799+0000","last_undegraded":"2024-05-09T02:23:20.374799+0000","last_fullsized":"2024-05-09T02:23:20.374799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-09T02:23:20.374662+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-09T02:23:20.374662+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.374662+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:45.014627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"32'183","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:40.099760+0000","last_change":"2024-05-09T02:23:40.099793+0000","last_active":"2024-05-09T02:23:40.099760+0000","last_peered":"2024-05-09T02:23:40.099760+0000","last_clean":"2024-05-09T02:23:40.099760+0000","last_became_active":"2024-05-09T02:18:23.219461+0000","last_became_peered":"2024-05-09T02:18:23.219461+0000","last_unstale":"2024-05-09T02:23:40.099760+0000","last_undegraded":"2024-05-09T02:23:40.099760+0000","last_fullsized":"2024-05-09T02:23:40.099760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'183","last_scrub_stamp":"2024-05-09T02:23:40.099649+0000","last_deep_scrub":"32'183","last_deep_scrub_stamp":"2024-05-09T02:23:40.099649+0000","last_clean_scrub_stamp":"2024-05-09T02:23:40.099649+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:46.229341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'141","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.558678+0000","last_change":"2024-05-09T02:23:28.558708+0000","last_active":"2024-05-09T02:23:28.558678+0000","last_peered":"2024-05-09T02:23:28.558678+0000","last_clean":"2024-05-09T02:23:28.558678+0000","last_became_active":"2024-05-09T02:18:14.153784+0000","last_became_peered":"2024-05-09T02:18:14.153784+0000","last_unstale":"2024-05-09T02:23:28.558678+0000","last_undegraded":"2024-05-09T02:23:28.558678+0000","last_fullsized":"2024-05-09T02:23:28.558678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:28.558556+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:28.558556+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.558556+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:35.690234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"32'132","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:37.673717+0000","last_change":"2024-05-09T02:23:37.673790+0000","last_active":"2024-05-09T02:23:37.673717+0000","last_peered":"2024-05-09T02:23:37.673717+0000","last_clean":"2024-05-09T02:23:37.673717+0000","last_became_active":"2024-05-09T02:18:23.221540+0000","last_became_peered":"2024-05-09T02:18:23.221540+0000","last_unstale":"2024-05-09T02:23:37.673717+0000","last_undegraded":"2024-05-09T02:23:37.673717+0000","last_fullsized":"2024-05-09T02:23:37.673717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'132","last_scrub_stamp":"2024-05-09T02:23:37.673584+0000","last_deep_scrub":"32'132","last_deep_scrub_stamp":"2024-05-09T02:23:37.673584+0000","last_clean_scrub_stamp":"2024-05-09T02:23:37.673584+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:53.566770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.207049+0000","last_change":"2024-05-09T02:23:22.207079+0000","last_active":"2024-05-09T02:23:22.207049+0000","last_peered":"2024-05-09T02:23:22.207049+0000","last_clean":"2024-05-09T02:23:22.207049+0000","last_became_active":"2024-05-09T02:18:14.149064+0000","last_became_peered":"2024-05-09T02:18:14.149064+0000","last_unstale":"2024-05-09T02:23:22.207049+0000","last_undegraded":"2024-05-09T02:23:22.207049+0000","last_fullsized":"2024-05-09T02:23:22.207049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:22.206927+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:22.206927+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.206927+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:59.762418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.641053+0000","last_change":"2024-05-09T02:23:36.641098+0000","last_active":"2024-05-09T02:23:36.641053+0000","last_peered":"2024-05-09T02:23:36.641053+0000","last_clean":"2024-05-09T02:23:36.641053+0000","last_became_active":"2024-05-09T02:18:23.210588+0000","last_became_peered":"2024-05-09T02:18:23.210588+0000","last_unstale":"2024-05-09T02:23:36.641053+0000","last_undegraded":"2024-05-09T02:23:36.641053+0000","last_fullsized":"2024-05-09T02:23:36.641053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:36.640928+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:36.640928+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.640928+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.595264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'123","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.710308+0000","last_change":"2024-05-09T02:23:20.710334+0000","last_active":"2024-05-09T02:23:20.710308+0000","last_peered":"2024-05-09T02:23:20.710308+0000","last_clean":"2024-05-09T02:23:20.710308+0000","last_became_active":"2024-05-09T02:18:14.159157+0000","last_became_peered":"2024-05-09T02:18:14.159157+0000","last_unstale":"2024-05-09T02:23:20.710308+0000","last_undegraded":"2024-05-09T02:23:20.710308+0000","last_fullsized":"2024-05-09T02:23:20.710308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'123","last_scrub_stamp":"2024-05-09T02:23:20.710206+0000","last_deep_scrub":"31'123","last_deep_scrub_stamp":"2024-05-09T02:23:20.710206+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.710206+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:48:14.322364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:39.699260+0000","last_change":"2024-05-09T02:23:39.699290+0000","last_active":"2024-05-09T02:23:39.699260+0000","last_peered":"2024-05-09T02:23:39.699260+0000","last_clean":"2024-05-09T02:23:39.699260+0000","last_became_active":"2024-05-09T02:18:23.228133+0000","last_became_peered":"2024-05-09T02:18:23.228133+0000","last_unstale":"2024-05-09T02:23:39.699260+0000","last_undegraded":"2024-05-09T02:23:39.699260+0000","last_fullsized":"2024-05-09T02:23:39.699260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:39.699144+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:39.699144+0000","last_clean_scrub_stamp":"2024-05-09T02:23:39.699144+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:18.432043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"31'111","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.698937+0000","last_change":"2024-05-09T02:23:23.698976+0000","last_active":"2024-05-09T02:23:23.698937+0000","last_peered":"2024-05-09T02:23:23.698937+0000","last_clean":"2024-05-09T02:23:23.698937+0000","last_became_active":"2024-05-09T02:18:14.143606+0000","last_became_peered":"2024-05-09T02:18:14.143606+0000","last_unstale":"2024-05-09T02:23:23.698937+0000","last_undegraded":"2024-05-09T02:23:23.698937+0000","last_fullsized":"2024-05-09T02:23:23.698937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'111","last_scrub_stamp":"2024-05-09T02:23:23.698818+0000","last_deep_scrub":"31'111","last_deep_scrub_stamp":"2024-05-09T02:23:23.698818+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.698818+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:04.624274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"32'123","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:42.002769+0000","last_change":"2024-05-09T02:23:42.002799+0000","last_active":"2024-05-09T02:23:42.002769+0000","last_peered":"2024-05-09T02:23:42.002769+0000","last_clean":"2024-05-09T02:23:42.002769+0000","last_became_active":"2024-05-09T02:18:23.223082+0000","last_became_peered":"2024-05-09T02:18:23.223082+0000","last_unstale":"2024-05-09T02:23:42.002769+0000","last_undegraded":"2024-05-09T02:23:42.002769+0000","last_fullsized":"2024-05-09T02:23:42.002769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:42.002642+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:42.002642+0000","last_clean_scrub_stamp":"2024-05-09T02:23:42.002642+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:55.674149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"31'129","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.108399+0000","last_change":"2024-05-09T02:23:36.108430+0000","last_active":"2024-05-09T02:23:36.108399+0000","last_peered":"2024-05-09T02:23:36.108399+0000","last_clean":"2024-05-09T02:23:36.108399+0000","last_became_active":"2024-05-09T02:18:14.147004+0000","last_became_peered":"2024-05-09T02:18:14.147004+0000","last_unstale":"2024-05-09T02:23:36.108399+0000","last_undegraded":"2024-05-09T02:23:36.108399+0000","last_fullsized":"2024-05-09T02:23:36.108399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:36.108285+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:36.108285+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.108285+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:20.387758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"32'111","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:37.667857+0000","last_change":"2024-05-09T02:23:37.667958+0000","last_active":"2024-05-09T02:23:37.667857+0000","last_peered":"2024-05-09T02:23:37.667857+0000","last_clean":"2024-05-09T02:23:37.667857+0000","last_became_active":"2024-05-09T02:18:23.220827+0000","last_became_peered":"2024-05-09T02:18:23.220827+0000","last_unstale":"2024-05-09T02:23:37.667857+0000","last_undegraded":"2024-05-09T02:23:37.667857+0000","last_fullsized":"2024-05-09T02:23:37.667857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'111","last_scrub_stamp":"2024-05-09T02:23:37.667727+0000","last_deep_scrub":"32'111","last_deep_scrub_stamp":"2024-05-09T02:23:37.667727+0000","last_clean_scrub_stamp":"2024-05-09T02:23:37.667727+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:43.723660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.714465+0000","last_change":"2024-05-09T02:23:24.714494+0000","last_active":"2024-05-09T02:23:24.714465+0000","last_peered":"2024-05-09T02:23:24.714465+0000","last_clean":"2024-05-09T02:23:24.714465+0000","last_became_active":"2024-05-09T02:18:14.141739+0000","last_became_peered":"2024-05-09T02:18:14.141739+0000","last_unstale":"2024-05-09T02:23:24.714465+0000","last_undegraded":"2024-05-09T02:23:24.714465+0000","last_fullsized":"2024-05-09T02:23:24.714465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:24.714361+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:24.714361+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.714361+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:00.040479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"32'141","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:40.028249+0000","last_change":"2024-05-09T02:23:40.028322+0000","last_active":"2024-05-09T02:23:40.028249+0000","last_peered":"2024-05-09T02:23:40.028249+0000","last_clean":"2024-05-09T02:23:40.028249+0000","last_became_active":"2024-05-09T02:18:23.222000+0000","last_became_peered":"2024-05-09T02:18:23.222000+0000","last_unstale":"2024-05-09T02:23:40.028249+0000","last_undegraded":"2024-05-09T02:23:40.028249+0000","last_fullsized":"2024-05-09T02:23:40.028249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:40.028117+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:40.028117+0000","last_clean_scrub_stamp":"2024-05-09T02:23:40.028117+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:18.761016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"31'183","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.651115+0000","last_change":"2024-05-09T02:23:19.651142+0000","last_active":"2024-05-09T02:23:19.651115+0000","last_peered":"2024-05-09T02:23:19.651115+0000","last_clean":"2024-05-09T02:23:19.651115+0000","last_became_active":"2024-05-09T02:18:14.159661+0000","last_became_peered":"2024-05-09T02:18:14.159661+0000","last_unstale":"2024-05-09T02:23:19.651115+0000","last_undegraded":"2024-05-09T02:23:19.651115+0000","last_fullsized":"2024-05-09T02:23:19.651115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'183","last_scrub_stamp":"2024-05-09T02:23:19.651003+0000","last_deep_scrub":"31'183","last_deep_scrub_stamp":"2024-05-09T02:23:19.651003+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.651003+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:57.206494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"32'123","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.508046+0000","last_change":"2024-05-09T02:23:32.508079+0000","last_active":"2024-05-09T02:23:32.508046+0000","last_peered":"2024-05-09T02:23:32.508046+0000","last_clean":"2024-05-09T02:23:32.508046+0000","last_became_active":"2024-05-09T02:18:23.199201+0000","last_became_peered":"2024-05-09T02:18:23.199201+0000","last_unstale":"2024-05-09T02:23:32.508046+0000","last_undegraded":"2024-05-09T02:23:32.508046+0000","last_fullsized":"2024-05-09T02:23:32.508046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'123","last_scrub_stamp":"2024-05-09T02:23:32.507920+0000","last_deep_scrub":"32'123","last_deep_scrub_stamp":"2024-05-09T02:23:32.507920+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.507920+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:34.703396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'132","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.142781+0000","last_change":"2024-05-09T02:23:34.142811+0000","last_active":"2024-05-09T02:23:34.142781+0000","last_peered":"2024-05-09T02:23:34.142781+0000","last_clean":"2024-05-09T02:23:34.142781+0000","last_became_active":"2024-05-09T02:18:14.144751+0000","last_became_peered":"2024-05-09T02:18:14.144751+0000","last_unstale":"2024-05-09T02:23:34.142781+0000","last_undegraded":"2024-05-09T02:23:34.142781+0000","last_fullsized":"2024-05-09T02:23:34.142781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2024-05-09T02:23:34.142651+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2024-05-09T02:23:34.142651+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.142651+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:16.194381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"32'147","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:43.168226+0000","last_change":"2024-05-09T02:23:43.168260+0000","last_active":"2024-05-09T02:23:43.168226+0000","last_peered":"2024-05-09T02:23:43.168226+0000","last_clean":"2024-05-09T02:23:43.168226+0000","last_became_active":"2024-05-09T02:18:23.220554+0000","last_became_peered":"2024-05-09T02:18:23.220554+0000","last_unstale":"2024-05-09T02:23:43.168226+0000","last_undegraded":"2024-05-09T02:23:43.168226+0000","last_fullsized":"2024-05-09T02:23:43.168226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'147","last_scrub_stamp":"2024-05-09T02:23:43.168082+0000","last_deep_scrub":"32'147","last_deep_scrub_stamp":"2024-05-09T02:23:43.168082+0000","last_clean_scrub_stamp":"2024-05-09T02:23:43.168082+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:46.016572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'174","reported_seq":220,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:22.646123+0000","last_change":"2024-05-09T02:23:22.646184+0000","last_active":"2024-05-09T02:23:22.646123+0000","last_peered":"2024-05-09T02:23:22.646123+0000","last_clean":"2024-05-09T02:23:22.646123+0000","last_became_active":"2024-05-09T02:18:14.159315+0000","last_became_peered":"2024-05-09T02:18:14.159315+0000","last_unstale":"2024-05-09T02:23:22.646123+0000","last_undegraded":"2024-05-09T02:23:22.646123+0000","last_fullsized":"2024-05-09T02:23:22.646123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'174","last_scrub_stamp":"2024-05-09T02:23:22.646001+0000","last_deep_scrub":"31'174","last_deep_scrub_stamp":"2024-05-09T02:23:22.646001+0000","last_clean_scrub_stamp":"2024-05-09T02:23:22.646001+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:47.865548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"32'138","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:47.024833+0000","last_change":"2024-05-09T02:23:47.024861+0000","last_active":"2024-05-09T02:23:47.024833+0000","last_peered":"2024-05-09T02:23:47.024833+0000","last_clean":"2024-05-09T02:23:47.024833+0000","last_became_active":"2024-05-09T02:18:23.225365+0000","last_became_peered":"2024-05-09T02:18:23.225365+0000","last_unstale":"2024-05-09T02:23:47.024833+0000","last_undegraded":"2024-05-09T02:23:47.024833+0000","last_fullsized":"2024-05-09T02:23:47.024833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:47.024721+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:47.024721+0000","last_clean_scrub_stamp":"2024-05-09T02:23:47.024721+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:48.600276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"31'126","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.127951+0000","last_change":"2024-05-09T02:23:35.127986+0000","last_active":"2024-05-09T02:23:35.127951+0000","last_peered":"2024-05-09T02:23:35.127951+0000","last_clean":"2024-05-09T02:23:35.127951+0000","last_became_active":"2024-05-09T02:18:14.146310+0000","last_became_peered":"2024-05-09T02:18:14.146310+0000","last_unstale":"2024-05-09T02:23:35.127951+0000","last_undegraded":"2024-05-09T02:23:35.127951+0000","last_fullsized":"2024-05-09T02:23:35.127951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:35.127824+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:35.127824+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.127824+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:13.860723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"32'153","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.291239+0000","last_change":"2024-05-09T02:23:26.291268+0000","last_active":"2024-05-09T02:23:26.291239+0000","last_peered":"2024-05-09T02:23:26.291239+0000","last_clean":"2024-05-09T02:23:26.291239+0000","last_became_active":"2024-05-09T02:18:23.205088+0000","last_became_peered":"2024-05-09T02:18:23.205088+0000","last_unstale":"2024-05-09T02:23:26.291239+0000","last_undegraded":"2024-05-09T02:23:26.291239+0000","last_fullsized":"2024-05-09T02:23:26.291239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'153","last_scrub_stamp":"2024-05-09T02:23:26.291123+0000","last_deep_scrub":"32'153","last_deep_scrub_stamp":"2024-05-09T02:23:26.291123+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.291123+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:28.888838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"31'156","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.712888+0000","last_change":"2024-05-09T02:23:24.712929+0000","last_active":"2024-05-09T02:23:24.712888+0000","last_peered":"2024-05-09T02:23:24.712888+0000","last_clean":"2024-05-09T02:23:24.712888+0000","last_became_active":"2024-05-09T02:18:14.157341+0000","last_became_peered":"2024-05-09T02:18:14.157341+0000","last_unstale":"2024-05-09T02:23:24.712888+0000","last_undegraded":"2024-05-09T02:23:24.712888+0000","last_fullsized":"2024-05-09T02:23:24.712888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2024-05-09T02:23:24.712759+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2024-05-09T02:23:24.712759+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.712759+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:50.871323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"32'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:44.140090+0000","last_change":"2024-05-09T02:23:44.140158+0000","last_active":"2024-05-09T02:23:44.140090+0000","last_peered":"2024-05-09T02:23:44.140090+0000","last_clean":"2024-05-09T02:23:44.140090+0000","last_became_active":"2024-05-09T02:18:23.221471+0000","last_became_peered":"2024-05-09T02:18:23.221471+0000","last_unstale":"2024-05-09T02:23:44.140090+0000","last_undegraded":"2024-05-09T02:23:44.140090+0000","last_fullsized":"2024-05-09T02:23:44.140090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'165","last_scrub_stamp":"2024-05-09T02:23:44.139957+0000","last_deep_scrub":"32'165","last_deep_scrub_stamp":"2024-05-09T02:23:44.139957+0000","last_clean_scrub_stamp":"2024-05-09T02:23:44.139957+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:38:14.058751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"31'126","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.626609+0000","last_change":"2024-05-09T02:23:26.626643+0000","last_active":"2024-05-09T02:23:26.626609+0000","last_peered":"2024-05-09T02:23:26.626609+0000","last_clean":"2024-05-09T02:23:26.626609+0000","last_became_active":"2024-05-09T02:18:14.153203+0000","last_became_peered":"2024-05-09T02:18:14.153203+0000","last_unstale":"2024-05-09T02:23:26.626609+0000","last_undegraded":"2024-05-09T02:23:26.626609+0000","last_fullsized":"2024-05-09T02:23:26.626609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:26.626488+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:26.626488+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.626488+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:50.672230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"32'156","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.622501+0000","last_change":"2024-05-09T02:23:36.622544+0000","last_active":"2024-05-09T02:23:36.622501+0000","last_peered":"2024-05-09T02:23:36.622501+0000","last_clean":"2024-05-09T02:23:36.622501+0000","last_became_active":"2024-05-09T02:18:23.219030+0000","last_became_peered":"2024-05-09T02:18:23.219030+0000","last_unstale":"2024-05-09T02:23:36.622501+0000","last_undegraded":"2024-05-09T02:23:36.622501+0000","last_fullsized":"2024-05-09T02:23:36.622501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'156","last_scrub_stamp":"2024-05-09T02:23:36.622386+0000","last_deep_scrub":"32'156","last_deep_scrub_stamp":"2024-05-09T02:23:36.622386+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.622386+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:49.991326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'153","reported_seq":199,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.616037+0000","last_change":"2024-05-09T02:23:26.616068+0000","last_active":"2024-05-09T02:23:26.616037+0000","last_peered":"2024-05-09T02:23:26.616037+0000","last_clean":"2024-05-09T02:23:26.616037+0000","last_became_active":"2024-05-09T02:18:14.152715+0000","last_became_peered":"2024-05-09T02:18:14.152715+0000","last_unstale":"2024-05-09T02:23:26.616037+0000","last_undegraded":"2024-05-09T02:23:26.616037+0000","last_fullsized":"2024-05-09T02:23:26.616037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2024-05-09T02:23:26.615925+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2024-05-09T02:23:26.615925+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.615925+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:07.541380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"32'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:34.593316+0000","last_change":"2024-05-09T02:23:34.593343+0000","last_active":"2024-05-09T02:23:34.593316+0000","last_peered":"2024-05-09T02:23:34.593316+0000","last_clean":"2024-05-09T02:23:34.593316+0000","last_became_active":"2024-05-09T02:18:23.212103+0000","last_became_peered":"2024-05-09T02:18:23.212103+0000","last_unstale":"2024-05-09T02:23:34.593316+0000","last_undegraded":"2024-05-09T02:23:34.593316+0000","last_fullsized":"2024-05-09T02:23:34.593316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:34.593214+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:34.593214+0000","last_clean_scrub_stamp":"2024-05-09T02:23:34.593214+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:27.739671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"31'165","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.004069+0000","last_change":"2024-05-09T02:23:29.004106+0000","last_active":"2024-05-09T02:23:29.004069+0000","last_peered":"2024-05-09T02:23:29.004069+0000","last_clean":"2024-05-09T02:23:29.004069+0000","last_became_active":"2024-05-09T02:18:14.149341+0000","last_became_peered":"2024-05-09T02:18:14.149341+0000","last_unstale":"2024-05-09T02:23:29.004069+0000","last_undegraded":"2024-05-09T02:23:29.004069+0000","last_fullsized":"2024-05-09T02:23:29.004069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2024-05-09T02:23:29.003969+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2024-05-09T02:23:29.003969+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.003969+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:07.261602+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"32'174","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:42.590919+0000","last_change":"2024-05-09T02:23:42.590968+0000","last_active":"2024-05-09T02:23:42.590919+0000","last_peered":"2024-05-09T02:23:42.590919+0000","last_clean":"2024-05-09T02:23:42.590919+0000","last_became_active":"2024-05-09T02:18:23.220972+0000","last_became_peered":"2024-05-09T02:18:23.220972+0000","last_unstale":"2024-05-09T02:23:42.590919+0000","last_undegraded":"2024-05-09T02:23:42.590919+0000","last_fullsized":"2024-05-09T02:23:42.590919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'174","last_scrub_stamp":"2024-05-09T02:23:42.590799+0000","last_deep_scrub":"32'174","last_deep_scrub_stamp":"2024-05-09T02:23:42.590799+0000","last_clean_scrub_stamp":"2024-05-09T02:23:42.590799+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:50.483266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"31'147","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.216742+0000","last_change":"2024-05-09T02:23:23.216803+0000","last_active":"2024-05-09T02:23:23.216742+0000","last_peered":"2024-05-09T02:23:23.216742+0000","last_clean":"2024-05-09T02:23:23.216742+0000","last_became_active":"2024-05-09T02:18:14.153385+0000","last_became_peered":"2024-05-09T02:18:14.153385+0000","last_unstale":"2024-05-09T02:23:23.216742+0000","last_undegraded":"2024-05-09T02:23:23.216742+0000","last_fullsized":"2024-05-09T02:23:23.216742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2024-05-09T02:23:23.216607+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2024-05-09T02:23:23.216607+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.216607+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:44.510847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"32'126","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.596171+0000","last_change":"2024-05-09T02:23:32.596209+0000","last_active":"2024-05-09T02:23:32.596171+0000","last_peered":"2024-05-09T02:23:32.596171+0000","last_clean":"2024-05-09T02:23:32.596171+0000","last_became_active":"2024-05-09T02:18:23.211301+0000","last_became_peered":"2024-05-09T02:18:23.211301+0000","last_unstale":"2024-05-09T02:23:32.596171+0000","last_undegraded":"2024-05-09T02:23:32.596171+0000","last_fullsized":"2024-05-09T02:23:32.596171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:32.596052+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:32.596052+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.596052+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:23.144814+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"31'138","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.355876+0000","last_change":"2024-05-09T02:23:31.355876+0000","last_active":"2024-05-09T02:23:31.355876+0000","last_peered":"2024-05-09T02:23:31.355876+0000","last_clean":"2024-05-09T02:23:31.355876+0000","last_became_active":"2024-05-09T02:18:55.680014+0000","last_became_peered":"2024-05-09T02:18:55.680014+0000","last_unstale":"2024-05-09T02:23:31.355876+0000","last_undegraded":"2024-05-09T02:23:31.355876+0000","last_fullsized":"2024-05-09T02:23:31.355876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:31.355727+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:31.355727+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.355727+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:38.487405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"32'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:36.688657+0000","last_change":"2024-05-09T02:23:36.688688+0000","last_active":"2024-05-09T02:23:36.688657+0000","last_peered":"2024-05-09T02:23:36.688657+0000","last_clean":"2024-05-09T02:23:36.688657+0000","last_became_active":"2024-05-09T02:18:23.220640+0000","last_became_peered":"2024-05-09T02:18:23.220640+0000","last_unstale":"2024-05-09T02:23:36.688657+0000","last_undegraded":"2024-05-09T02:23:36.688657+0000","last_fullsized":"2024-05-09T02:23:36.688657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:36.688532+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:36.688532+0000","last_clean_scrub_stamp":"2024-05-09T02:23:36.688532+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.642868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"31'138","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.659646+0000","last_change":"2024-05-09T02:23:26.659710+0000","last_active":"2024-05-09T02:23:26.659646+0000","last_peered":"2024-05-09T02:23:26.659646+0000","last_clean":"2024-05-09T02:23:26.659646+0000","last_became_active":"2024-05-09T02:18:14.147274+0000","last_became_peered":"2024-05-09T02:18:14.147274+0000","last_unstale":"2024-05-09T02:23:26.659646+0000","last_undegraded":"2024-05-09T02:23:26.659646+0000","last_fullsized":"2024-05-09T02:23:26.659646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:26.659509+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:26.659509+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.659509+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:50.149204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"32'141","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.564035+0000","last_change":"2024-05-09T02:23:33.564062+0000","last_active":"2024-05-09T02:23:33.564035+0000","last_peered":"2024-05-09T02:23:33.564035+0000","last_clean":"2024-05-09T02:23:33.564035+0000","last_became_active":"2024-05-09T02:18:23.205445+0000","last_became_peered":"2024-05-09T02:18:23.205445+0000","last_unstale":"2024-05-09T02:23:33.564035+0000","last_undegraded":"2024-05-09T02:23:33.564035+0000","last_fullsized":"2024-05-09T02:23:33.564035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:33.563934+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:33.563934+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.563934+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:24.112696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"31'144","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.674278+0000","last_change":"2024-05-09T02:23:31.674306+0000","last_active":"2024-05-09T02:23:31.674278+0000","last_peered":"2024-05-09T02:23:31.674278+0000","last_clean":"2024-05-09T02:23:31.674278+0000","last_became_active":"2024-05-09T02:18:14.138083+0000","last_became_peered":"2024-05-09T02:18:14.138083+0000","last_unstale":"2024-05-09T02:23:31.674278+0000","last_undegraded":"2024-05-09T02:23:31.674278+0000","last_fullsized":"2024-05-09T02:23:31.674278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:31.674160+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:31.674160+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.674160+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:45.043100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"32'135","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:41.571306+0000","last_change":"2024-05-09T02:23:41.571358+0000","last_active":"2024-05-09T02:23:41.571306+0000","last_peered":"2024-05-09T02:23:41.571306+0000","last_clean":"2024-05-09T02:23:41.571306+0000","last_became_active":"2024-05-09T02:18:23.219161+0000","last_became_peered":"2024-05-09T02:18:23.219161+0000","last_unstale":"2024-05-09T02:23:41.571306+0000","last_undegraded":"2024-05-09T02:23:41.571306+0000","last_fullsized":"2024-05-09T02:23:41.571306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'135","last_scrub_stamp":"2024-05-09T02:23:41.571110+0000","last_deep_scrub":"32'135","last_deep_scrub_stamp":"2024-05-09T02:23:41.571110+0000","last_clean_scrub_stamp":"2024-05-09T02:23:41.571110+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:55.242617+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'141","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:24.652898+0000","last_change":"2024-05-09T02:23:24.652932+0000","last_active":"2024-05-09T02:23:24.652898+0000","last_peered":"2024-05-09T02:23:24.652898+0000","last_clean":"2024-05-09T02:23:24.652898+0000","last_became_active":"2024-05-09T02:18:14.145447+0000","last_became_peered":"2024-05-09T02:18:14.145447+0000","last_unstale":"2024-05-09T02:23:24.652898+0000","last_undegraded":"2024-05-09T02:23:24.652898+0000","last_fullsized":"2024-05-09T02:23:24.652898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:24.652791+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:24.652791+0000","last_clean_scrub_stamp":"2024-05-09T02:23:24.652791+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:44.714956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"32'183","reported_seq":222,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:43.037252+0000","last_change":"2024-05-09T02:23:43.037284+0000","last_active":"2024-05-09T02:23:43.037252+0000","last_peered":"2024-05-09T02:23:43.037252+0000","last_clean":"2024-05-09T02:23:43.037252+0000","last_became_active":"2024-05-09T02:18:23.223156+0000","last_became_peered":"2024-05-09T02:18:23.223156+0000","last_unstale":"2024-05-09T02:23:43.037252+0000","last_undegraded":"2024-05-09T02:23:43.037252+0000","last_fullsized":"2024-05-09T02:23:43.037252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'183","last_scrub_stamp":"2024-05-09T02:23:43.037102+0000","last_deep_scrub":"32'183","last_deep_scrub_stamp":"2024-05-09T02:23:43.037102+0000","last_clean_scrub_stamp":"2024-05-09T02:23:43.037102+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:50.929569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"31'141","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.220671+0000","last_change":"2024-05-09T02:23:29.220704+0000","last_active":"2024-05-09T02:23:29.220671+0000","last_peered":"2024-05-09T02:23:29.220671+0000","last_clean":"2024-05-09T02:23:29.220671+0000","last_became_active":"2024-05-09T02:18:14.148111+0000","last_became_peered":"2024-05-09T02:18:14.148111+0000","last_unstale":"2024-05-09T02:23:29.220671+0000","last_undegraded":"2024-05-09T02:23:29.220671+0000","last_fullsized":"2024-05-09T02:23:29.220671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:29.220546+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:29.220546+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.220546+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:06.162674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"32'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:45.153925+0000","last_change":"2024-05-09T02:23:45.153954+0000","last_active":"2024-05-09T02:23:45.153925+0000","last_peered":"2024-05-09T02:23:45.153925+0000","last_clean":"2024-05-09T02:23:45.153925+0000","last_became_active":"2024-05-09T02:18:23.221585+0000","last_became_peered":"2024-05-09T02:18:23.221585+0000","last_unstale":"2024-05-09T02:23:45.153925+0000","last_undegraded":"2024-05-09T02:23:45.153925+0000","last_fullsized":"2024-05-09T02:23:45.153925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:45.153800+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:45.153800+0000","last_clean_scrub_stamp":"2024-05-09T02:23:45.153800+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:09.672601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'135","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.645260+0000","last_change":"2024-05-09T02:23:27.645293+0000","last_active":"2024-05-09T02:23:27.645260+0000","last_peered":"2024-05-09T02:23:27.645260+0000","last_clean":"2024-05-09T02:23:27.645260+0000","last_became_active":"2024-05-09T02:18:14.153139+0000","last_became_peered":"2024-05-09T02:18:14.153139+0000","last_unstale":"2024-05-09T02:23:27.645260+0000","last_undegraded":"2024-05-09T02:23:27.645260+0000","last_fullsized":"2024-05-09T02:23:27.645260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2024-05-09T02:23:27.645149+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2024-05-09T02:23:27.645149+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.645149+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:02.971266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"32'141","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:27.322088+0000","last_change":"2024-05-09T02:23:27.322141+0000","last_active":"2024-05-09T02:23:27.322088+0000","last_peered":"2024-05-09T02:23:27.322088+0000","last_clean":"2024-05-09T02:23:27.322088+0000","last_became_active":"2024-05-09T02:18:23.204539+0000","last_became_peered":"2024-05-09T02:18:23.204539+0000","last_unstale":"2024-05-09T02:23:27.322088+0000","last_undegraded":"2024-05-09T02:23:27.322088+0000","last_fullsized":"2024-05-09T02:23:27.322088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'141","last_scrub_stamp":"2024-05-09T02:23:27.321947+0000","last_deep_scrub":"32'141","last_deep_scrub_stamp":"2024-05-09T02:23:27.321947+0000","last_clean_scrub_stamp":"2024-05-09T02:23:27.321947+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:12.330551+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"31'183","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:20.655735+0000","last_change":"2024-05-09T02:23:20.655788+0000","last_active":"2024-05-09T02:23:20.655735+0000","last_peered":"2024-05-09T02:23:20.655735+0000","last_clean":"2024-05-09T02:23:20.655735+0000","last_became_active":"2024-05-09T02:18:14.154623+0000","last_became_peered":"2024-05-09T02:18:14.154623+0000","last_unstale":"2024-05-09T02:23:20.655735+0000","last_undegraded":"2024-05-09T02:23:20.655735+0000","last_fullsized":"2024-05-09T02:23:20.655735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'183","last_scrub_stamp":"2024-05-09T02:23:20.655585+0000","last_deep_scrub":"31'183","last_deep_scrub_stamp":"2024-05-09T02:23:20.655585+0000","last_clean_scrub_stamp":"2024-05-09T02:23:20.655585+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:36.341218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"32'138","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:45.037013+0000","last_change":"2024-05-09T02:23:45.037088+0000","last_active":"2024-05-09T02:23:45.037013+0000","last_peered":"2024-05-09T02:23:45.037013+0000","last_clean":"2024-05-09T02:23:45.037013+0000","last_became_active":"2024-05-09T02:18:23.224940+0000","last_became_peered":"2024-05-09T02:18:23.224940+0000","last_unstale":"2024-05-09T02:23:45.037013+0000","last_undegraded":"2024-05-09T02:23:45.037013+0000","last_fullsized":"2024-05-09T02:23:45.037013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:45.036882+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:45.036882+0000","last_clean_scrub_stamp":"2024-05-09T02:23:45.036882+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:11.442607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"31'141","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.608152+0000","last_change":"2024-05-09T02:23:17.608190+0000","last_active":"2024-05-09T02:23:17.608152+0000","last_peered":"2024-05-09T02:23:17.608152+0000","last_clean":"2024-05-09T02:23:17.608152+0000","last_became_active":"2024-05-09T02:18:14.154536+0000","last_became_peered":"2024-05-09T02:18:14.154536+0000","last_unstale":"2024-05-09T02:23:17.608152+0000","last_undegraded":"2024-05-09T02:23:17.608152+0000","last_fullsized":"2024-05-09T02:23:17.608152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:17.607976+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:17.607976+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.607976+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:18.781780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.672271+0000","last_change":"2024-05-09T02:23:23.672363+0000","last_active":"2024-05-09T02:23:23.672271+0000","last_peered":"2024-05-09T02:23:23.672271+0000","last_clean":"2024-05-09T02:23:23.672271+0000","last_became_active":"2024-05-09T02:18:23.204357+0000","last_became_peered":"2024-05-09T02:18:23.204357+0000","last_unstale":"2024-05-09T02:23:23.672271+0000","last_undegraded":"2024-05-09T02:23:23.672271+0000","last_fullsized":"2024-05-09T02:23:23.672271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:23.672154+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:23.672154+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.672154+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:48.312119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"31'141","reported_seq":188,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:25.040764+0000","last_change":"2024-05-09T02:23:25.040790+0000","last_active":"2024-05-09T02:23:25.040764+0000","last_peered":"2024-05-09T02:23:25.040764+0000","last_clean":"2024-05-09T02:23:25.040764+0000","last_became_active":"2024-05-09T02:18:14.153571+0000","last_became_peered":"2024-05-09T02:18:14.153571+0000","last_unstale":"2024-05-09T02:23:25.040764+0000","last_undegraded":"2024-05-09T02:23:25.040764+0000","last_fullsized":"2024-05-09T02:23:25.040764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2024-05-09T02:23:25.040669+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2024-05-09T02:23:25.040669+0000","last_clean_scrub_stamp":"2024-05-09T02:23:25.040669+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:51.199233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"32'126","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:26.277818+0000","last_change":"2024-05-09T02:23:26.277857+0000","last_active":"2024-05-09T02:23:26.277818+0000","last_peered":"2024-05-09T02:23:26.277818+0000","last_clean":"2024-05-09T02:23:26.277818+0000","last_became_active":"2024-05-09T02:18:23.211372+0000","last_became_peered":"2024-05-09T02:18:23.211372+0000","last_unstale":"2024-05-09T02:23:26.277818+0000","last_undegraded":"2024-05-09T02:23:26.277818+0000","last_fullsized":"2024-05-09T02:23:26.277818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'126","last_scrub_stamp":"2024-05-09T02:23:26.277341+0000","last_deep_scrub":"32'126","last_deep_scrub_stamp":"2024-05-09T02:23:26.277341+0000","last_clean_scrub_stamp":"2024-05-09T02:23:26.277341+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:00.753928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":223,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:23.332756+0000","last_change":"2024-05-09T02:23:23.332788+0000","last_active":"2024-05-09T02:23:23.332756+0000","last_peered":"2024-05-09T02:23:23.332756+0000","last_clean":"2024-05-09T02:23:23.332756+0000","last_became_active":"2024-05-09T02:18:14.157879+0000","last_became_peered":"2024-05-09T02:18:14.157879+0000","last_unstale":"2024-05-09T02:23:23.332756+0000","last_undegraded":"2024-05-09T02:23:23.332756+0000","last_fullsized":"2024-05-09T02:23:23.332756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'177","last_scrub_stamp":"2024-05-09T02:23:23.332648+0000","last_deep_scrub":"31'177","last_deep_scrub_stamp":"2024-05-09T02:23:23.332648+0000","last_clean_scrub_stamp":"2024-05-09T02:23:23.332648+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:48.329069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"32'138","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.489019+0000","last_change":"2024-05-09T02:23:35.489051+0000","last_active":"2024-05-09T02:23:35.489019+0000","last_peered":"2024-05-09T02:23:35.489019+0000","last_clean":"2024-05-09T02:23:35.489019+0000","last_became_active":"2024-05-09T02:18:23.205915+0000","last_became_peered":"2024-05-09T02:18:23.205915+0000","last_unstale":"2024-05-09T02:23:35.489019+0000","last_undegraded":"2024-05-09T02:23:35.489019+0000","last_fullsized":"2024-05-09T02:23:35.489019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'138","last_scrub_stamp":"2024-05-09T02:23:35.488862+0000","last_deep_scrub":"32'138","last_deep_scrub_stamp":"2024-05-09T02:23:35.488862+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.488862+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:26.037624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"31'159","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:39.062127+0000","last_change":"2024-05-09T02:23:39.062175+0000","last_active":"2024-05-09T02:23:39.062127+0000","last_peered":"2024-05-09T02:23:39.062127+0000","last_clean":"2024-05-09T02:23:39.062127+0000","last_became_active":"2024-05-09T02:18:14.147521+0000","last_became_peered":"2024-05-09T02:18:14.147521+0000","last_unstale":"2024-05-09T02:23:39.062127+0000","last_undegraded":"2024-05-09T02:23:39.062127+0000","last_fullsized":"2024-05-09T02:23:39.062127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'159","last_scrub_stamp":"2024-05-09T02:23:39.061989+0000","last_deep_scrub":"31'159","last_deep_scrub_stamp":"2024-05-09T02:23:39.061989+0000","last_clean_scrub_stamp":"2024-05-09T02:23:39.061989+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:13.381260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"32'165","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:35.729260+0000","last_change":"2024-05-09T02:23:35.729339+0000","last_active":"2024-05-09T02:23:35.729260+0000","last_peered":"2024-05-09T02:23:35.729260+0000","last_clean":"2024-05-09T02:23:35.729260+0000","last_became_active":"2024-05-09T02:18:23.215006+0000","last_became_peered":"2024-05-09T02:18:23.215006+0000","last_unstale":"2024-05-09T02:23:35.729260+0000","last_undegraded":"2024-05-09T02:23:35.729260+0000","last_fullsized":"2024-05-09T02:23:35.729260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'165","last_scrub_stamp":"2024-05-09T02:23:35.729099+0000","last_deep_scrub":"32'165","last_deep_scrub_stamp":"2024-05-09T02:23:35.729099+0000","last_clean_scrub_stamp":"2024-05-09T02:23:35.729099+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:30.329128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'129","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:33.628571+0000","last_change":"2024-05-09T02:23:33.628645+0000","last_active":"2024-05-09T02:23:33.628571+0000","last_peered":"2024-05-09T02:23:33.628571+0000","last_clean":"2024-05-09T02:23:33.628571+0000","last_became_active":"2024-05-09T02:18:14.147500+0000","last_became_peered":"2024-05-09T02:18:14.147500+0000","last_unstale":"2024-05-09T02:23:33.628571+0000","last_undegraded":"2024-05-09T02:23:33.628571+0000","last_fullsized":"2024-05-09T02:23:33.628571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2024-05-09T02:23:33.628455+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2024-05-09T02:23:33.628455+0000","last_clean_scrub_stamp":"2024-05-09T02:23:33.628455+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:24.291341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:39.511806+0000","last_change":"2024-05-09T02:23:39.511838+0000","last_active":"2024-05-09T02:23:39.511806+0000","last_peered":"2024-05-09T02:23:39.511806+0000","last_clean":"2024-05-09T02:23:39.511806+0000","last_became_active":"2024-05-09T02:18:23.216025+0000","last_became_peered":"2024-05-09T02:18:23.216025+0000","last_unstale":"2024-05-09T02:23:39.511806+0000","last_undegraded":"2024-05-09T02:23:39.511806+0000","last_fullsized":"2024-05-09T02:23:39.511806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:39.511694+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:39.511694+0000","last_clean_scrub_stamp":"2024-05-09T02:23:39.511694+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:18.244594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:31.017257+0000","last_change":"2024-05-09T02:23:31.017287+0000","last_active":"2024-05-09T02:23:31.017257+0000","last_peered":"2024-05-09T02:23:31.017257+0000","last_clean":"2024-05-09T02:23:31.017257+0000","last_became_active":"2024-05-09T02:18:14.147486+0000","last_became_peered":"2024-05-09T02:18:14.147486+0000","last_unstale":"2024-05-09T02:23:31.017257+0000","last_undegraded":"2024-05-09T02:23:31.017257+0000","last_fullsized":"2024-05-09T02:23:31.017257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:31.017154+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:31.017154+0000","last_clean_scrub_stamp":"2024-05-09T02:23:31.017154+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:09.172215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"32'129","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:38.154980+0000","last_change":"2024-05-09T02:23:38.155048+0000","last_active":"2024-05-09T02:23:38.154980+0000","last_peered":"2024-05-09T02:23:38.154980+0000","last_clean":"2024-05-09T02:23:38.154980+0000","last_became_active":"2024-05-09T02:18:23.218958+0000","last_became_peered":"2024-05-09T02:18:23.218958+0000","last_unstale":"2024-05-09T02:23:38.154980+0000","last_undegraded":"2024-05-09T02:23:38.154980+0000","last_fullsized":"2024-05-09T02:23:38.154980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'129","last_scrub_stamp":"2024-05-09T02:23:38.154810+0000","last_deep_scrub":"32'129","last_deep_scrub_stamp":"2024-05-09T02:23:38.154810+0000","last_clean_scrub_stamp":"2024-05-09T02:23:38.154810+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:46.047277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'165","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:17.656371+0000","last_change":"2024-05-09T02:23:17.656402+0000","last_active":"2024-05-09T02:23:17.656371+0000","last_peered":"2024-05-09T02:23:17.656371+0000","last_clean":"2024-05-09T02:23:17.656371+0000","last_became_active":"2024-05-09T02:18:14.160859+0000","last_became_peered":"2024-05-09T02:18:14.160859+0000","last_unstale":"2024-05-09T02:23:17.656371+0000","last_undegraded":"2024-05-09T02:23:17.656371+0000","last_fullsized":"2024-05-09T02:23:17.656371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2024-05-09T02:23:17.656260+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2024-05-09T02:23:17.656260+0000","last_clean_scrub_stamp":"2024-05-09T02:23:17.656260+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:36.714946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"32'144","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:29.351059+0000","last_change":"2024-05-09T02:23:29.351088+0000","last_active":"2024-05-09T02:23:29.351059+0000","last_peered":"2024-05-09T02:23:29.351059+0000","last_clean":"2024-05-09T02:23:29.351059+0000","last_became_active":"2024-05-09T02:18:23.210182+0000","last_became_peered":"2024-05-09T02:18:23.210182+0000","last_unstale":"2024-05-09T02:23:29.351059+0000","last_undegraded":"2024-05-09T02:23:29.351059+0000","last_fullsized":"2024-05-09T02:23:29.351059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'144","last_scrub_stamp":"2024-05-09T02:23:29.350945+0000","last_deep_scrub":"32'144","last_deep_scrub_stamp":"2024-05-09T02:23:29.350945+0000","last_clean_scrub_stamp":"2024-05-09T02:23:29.350945+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:10.276401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'144","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:18.750665+0000","last_change":"2024-05-09T02:23:18.750695+0000","last_active":"2024-05-09T02:23:18.750665+0000","last_peered":"2024-05-09T02:23:18.750665+0000","last_clean":"2024-05-09T02:23:18.750665+0000","last_became_active":"2024-05-09T02:18:14.147977+0000","last_became_peered":"2024-05-09T02:18:14.147977+0000","last_unstale":"2024-05-09T02:23:18.750665+0000","last_undegraded":"2024-05-09T02:23:18.750665+0000","last_fullsized":"2024-05-09T02:23:18.750665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2024-05-09T02:23:18.750553+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2024-05-09T02:23:18.750553+0000","last_clean_scrub_stamp":"2024-05-09T02:23:18.750553+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:26.681975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"32'177","reported_seq":216,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:28.031965+0000","last_change":"2024-05-09T02:23:28.031996+0000","last_active":"2024-05-09T02:23:28.031965+0000","last_peered":"2024-05-09T02:23:28.031965+0000","last_clean":"2024-05-09T02:23:28.031965+0000","last_became_active":"2024-05-09T02:18:23.221136+0000","last_became_peered":"2024-05-09T02:18:23.221136+0000","last_unstale":"2024-05-09T02:23:28.031965+0000","last_undegraded":"2024-05-09T02:23:28.031965+0000","last_fullsized":"2024-05-09T02:23:28.031965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'177","last_scrub_stamp":"2024-05-09T02:23:28.031847+0000","last_deep_scrub":"32'177","last_deep_scrub_stamp":"2024-05-09T02:23:28.031847+0000","last_clean_scrub_stamp":"2024-05-09T02:23:28.031847+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:17.807446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"31'126","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:32.710091+0000","last_change":"2024-05-09T02:23:32.710127+0000","last_active":"2024-05-09T02:23:32.710091+0000","last_peered":"2024-05-09T02:23:32.710091+0000","last_clean":"2024-05-09T02:23:32.710091+0000","last_became_active":"2024-05-09T02:18:14.138155+0000","last_became_peered":"2024-05-09T02:18:14.138155+0000","last_unstale":"2024-05-09T02:23:32.710091+0000","last_undegraded":"2024-05-09T02:23:32.710091+0000","last_fullsized":"2024-05-09T02:23:32.710091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'126","last_scrub_stamp":"2024-05-09T02:23:32.709972+0000","last_deep_scrub":"31'126","last_deep_scrub_stamp":"2024-05-09T02:23:32.709972+0000","last_clean_scrub_stamp":"2024-05-09T02:23:32.709972+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:38.765905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"32'159","reported_seq":198,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:30.010580+0000","last_change":"2024-05-09T02:23:30.010609+0000","last_active":"2024-05-09T02:23:30.010580+0000","last_peered":"2024-05-09T02:23:30.010580+0000","last_clean":"2024-05-09T02:23:30.010580+0000","last_became_active":"2024-05-09T02:18:23.222300+0000","last_became_peered":"2024-05-09T02:18:23.222300+0000","last_unstale":"2024-05-09T02:23:30.010580+0000","last_undegraded":"2024-05-09T02:23:30.010580+0000","last_fullsized":"2024-05-09T02:23:30.010580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'159","last_scrub_stamp":"2024-05-09T02:23:30.010475+0000","last_deep_scrub":"32'159","last_deep_scrub_stamp":"2024-05-09T02:23:30.010475+0000","last_clean_scrub_stamp":"2024-05-09T02:23:30.010475+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:24.320750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"31'138","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-09T02:23:19.942511+0000","last_change":"2024-05-09T02:23:19.942561+0000","last_active":"2024-05-09T02:23:19.942511+0000","last_peered":"2024-05-09T02:23:19.942511+0000","last_clean":"2024-05-09T02:23:19.942511+0000","last_became_active":"2024-05-09T02:18:14.156024+0000","last_became_peered":"2024-05-09T02:18:14.156024+0000","last_unstale":"2024-05-09T02:23:19.942511+0000","last_undegraded":"2024-05-09T02:23:19.942511+0000","last_fullsized":"2024-05-09T02:23:19.942511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2024-05-09T02:23:19.942369+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2024-05-09T02:23:19.942369+0000","last_clean_scrub_stamp":"2024-05-09T02:23:19.942369+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:04.549323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":211620,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":435,"num_write":199,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":423240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":216648,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":240,"num_read_kb":455,"num_write":196,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":433296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":966656,"data_stored":752122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58128,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313712,"statfs":{"total":96636764160,"available":96577241088,"internally_reserved":0,"allocated":598016,"data_stored":377043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":380928,"data_stored":162349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45444,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326396,"statfs":{"total":96636764160,"available":96590229504,"internally_reserved":0,"allocated":389120,"data_stored":161817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54184,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317656,"statfs":{"total":96636764160,"available":96581279744,"internally_reserved":0,"allocated":819200,"data_stored":587271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":372736,"data_stored":161657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49808,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":598016,"data_stored":371581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50172,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321668,"statfs":{"total":96636764160,"available":96585388032,"internally_reserved":0,"allocated":970752,"data_stored":752088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":215850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":215345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":210339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T02:23:59.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T02:23:59.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.296+0000 7fca434b8640 1 Processor -- start 2024-05-09T02:23:59.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.296+0000 7fca434b8640 1 -- start start 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca434b8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c0c4df0 0x7fca3c154df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca434b8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca3c071b90 0x7fca3c071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca434b8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c158500 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca434b8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fca3c0c86b0 con 0x7fca3c071b90 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca434b8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c072640 con 0x7fca3c0c4df0 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca3c071b90 0x7fca3c071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca3c071b90 0x7fca3c071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40688/0 (socket says 172.21.15.46:40688) 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca41a55640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fca3c0c8fd0 0x7fca3c0c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48808/0 (socket says 172.21.15.46:48808) 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 -- 172.21.15.46:0/2804834808 learned_addr learned my addr 172.21.15.46:0/2804834808 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca41254640 1 --2- 172.21.15.46:0/2804834808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c0c4df0 0x7fca3c154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 -- 172.21.15.46:0/2804834808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c0c4df0 msgr2=0x7fca3c154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 --2- 172.21.15.46:0/2804834808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c0c4df0 0x7fca3c154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 -- 172.21.15.46:0/2804834808 >> v1:172.21.15.46:6789/0 conn(0x7fca3c0c8fd0 legacy=0x7fca3c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca33fff640 1 -- 172.21.15.46:0/2804834808 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277693542 0 0) 0x7fca3c158500 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.298+0000 7fca40a53640 1 -- 172.21.15.46:0/2804834808 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1587a0 con 0x7fca3c071b90 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.299+0000 7fca40a53640 1 --2- 172.21.15.46:0/2804834808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c071b90 0x7fca3c071fa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009870 tx=0x7fca2c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b008889b40f7d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.299+0000 7fca33fff640 1 -- 172.21.15.46:0/2804834808 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c037070 con 0x7fca3c071b90 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.299+0000 7fca33fff640 1 -- 172.21.15.46:0/2804834808 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c032440 con 0x7fca3c071b90 2024-05-09T02:23:59.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.299+0000 7fca33fff640 1 -- 172.21.15.46:0/2804834808 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c032810 con 0x7fca3c071b90 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 -- 172.21.15.46:0/2804834808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c071b90 msgr2=0x7fca3c071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 --2- 172.21.15.46:0/2804834808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c071b90 0x7fca3c071fa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009870 tx=0x7fca2c02a130 comp rx=0 tx=0).stop 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 -- 172.21.15.46:0/2804834808 shutdown_connections 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 --2- 172.21.15.46:0/2804834808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c071b90 0x7fca3c071fa0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 --2- 172.21.15.46:0/2804834808 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c0c4df0 0x7fca3c154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 -- 172.21.15.46:0/2804834808 >> 172.21.15.46:0/2804834808 conn(0x7fca3c0ac9c0 msgr2=0x7fca3c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 -- 172.21.15.46:0/2804834808 shutdown_connections 2024-05-09T02:23:59.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.300+0000 7fca434b8640 1 -- 172.21.15.46:0/2804834808 wait complete. 2024-05-09T02:23:59.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.302+0000 7fca434b8640 1 Processor -- start 2024-05-09T02:23:59.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.302+0000 7fca434b8640 1 -- start start 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca434b8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c071b90 0x7fca3c1e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca434b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca3c0c4df0 0x7fca3c1edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca434b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 0x7fca3c14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca434b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0ad4e0 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca434b8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c155330 con 0x7fca3c0c4df0 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca434b8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c0c44a0 con 0x7fca3c071b90 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 0x7fca3c14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 0x7fca3c14b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40696/0 (socket says 172.21.15.46:40696) 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 -- 172.21.15.46:0/3153803783 learned_addr learned my addr 172.21.15.46:0/3153803783 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca40a53640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca3c0c4df0 0x7fca3c1edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41254640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c071b90 0x7fca3c1e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 -- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c071b90 msgr2=0x7fca3c1e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c071b90 0x7fca3c1e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 -- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca3c0c4df0 msgr2=0x7fca3c1edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca3c0c4df0 0x7fca3c1edba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.303+0000 7fca41a55640 1 -- 172.21.15.46:0/3153803783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1f1960 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.304+0000 7fca41a55640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 0x7fca3c14b830 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c760 tx=0x7fca3400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.304+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ce10 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.304+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3400a640 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.304+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c1f1c00 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.304+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400aa70 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.304+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c155850 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.305+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3c06a330 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.306+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca3400ac10 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.306+0000 7fca31ffb640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca200762d0 0x7fca200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.306+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fca340979a0 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.306+0000 7fca41254640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca200762d0 0x7fca200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.307+0000 7fca41254640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca200762d0 0x7fca200787e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0c4bb0 tx=0x7fca38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.311+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca34060d50 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.506+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fca3c0c4040 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.510+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fca34060650 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.511+0000 7fca31ffb640 1 -- 172.21.15.46:0/3153803783 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fca34060160 con 0x7fca3c0c8fd0 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca200762d0 msgr2=0x7fca200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca200762d0 0x7fca200787e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0c4bb0 tx=0x7fca38008040 comp rx=0 tx=0).stop 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 msgr2=0x7fca3c14b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 0x7fca3c14b830 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c760 tx=0x7fca3400cc20 comp rx=0 tx=0).stop 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 shutdown_connections 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fca200762d0 0x7fca200787e0 secure :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0c4bb0 tx=0x7fca38008040 comp rx=0 tx=0).stop 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca3c0c8fd0 0x7fca3c14b830 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca3c0c4df0 0x7fca3c1edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 --2- 172.21.15.46:0/3153803783 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fca3c071b90 0x7fca3c1e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 >> 172.21.15.46:0/3153803783 conn(0x7fca3c0ac9c0 msgr2=0x7fca3c1e1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:59.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 shutdown_connections 2024-05-09T02:23:59.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.513+0000 7fca434b8640 1 -- 172.21.15.46:0/3153803783 wait complete. 2024-05-09T02:23:59.526 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-05-09T02:23:59.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:23:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.639+0000 7fde8adce640 1 Processor -- start 2024-05-09T02:23:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.640+0000 7fde8adce640 1 -- start start 2024-05-09T02:23:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde8adce640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde84156310 0x7fde840c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde8adce640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde84159d60 con 0x7fde840ca500 2024-05-09T02:23:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde8adce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde84158fa0 con 0x7fde840c5f70 2024-05-09T02:23:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde8adce640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fde840cb940 con 0x7fde84156310 2024-05-09T02:23:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde83fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde84156310 0x7fde840c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde8936b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fde840ca500 0x7fde840b0090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48822/0 (socket says 172.21.15.46:48822) 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde83fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde84156310 0x7fde840c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40710/0 (socket says 172.21.15.46:40710) 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde8936b640 1 -- 172.21.15.46:0/1810702643 learned_addr learned my addr 172.21.15.46:0/1810702643 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde83fff640 1 -- 172.21.15.46:0/1810702643 >> v1:172.21.15.107:6789/0 conn(0x7fde840c5f70 legacy=0x7fde840c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde83fff640 1 -- 172.21.15.46:0/1810702643 >> v1:172.21.15.46:6789/0 conn(0x7fde840ca500 legacy=0x7fde840b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde837fe640 1 -- 172.21.15.46:0/1810702643 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568984510 0 0) 0x7fde84159d60 con 0x7fde840ca500 2024-05-09T02:23:59.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.641+0000 7fde83fff640 1 -- 172.21.15.46:0/1810702643 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde84159280 con 0x7fde84156310 2024-05-09T02:23:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.642+0000 7fde83fff640 1 --2- 172.21.15.46:0/1810702643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84156310 0x7fde840c9fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0097a0 tx=0x7fde6c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7552afe6b9ebce5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.642+0000 7fde837fe640 1 -- 172.21.15.46:0/1810702643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c037070 con 0x7fde84156310 2024-05-09T02:23:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.642+0000 7fde837fe640 1 -- 172.21.15.46:0/1810702643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fde6c032440 con 0x7fde84156310 2024-05-09T02:23:59.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.642+0000 7fde837fe640 1 -- 172.21.15.46:0/1810702643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c032830 con 0x7fde84156310 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 -- 172.21.15.46:0/1810702643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84156310 msgr2=0x7fde840c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 --2- 172.21.15.46:0/1810702643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84156310 0x7fde840c9fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0097a0 tx=0x7fde6c02a1a0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 -- 172.21.15.46:0/1810702643 shutdown_connections 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 --2- 172.21.15.46:0/1810702643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84156310 0x7fde840c9fc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 -- 172.21.15.46:0/1810702643 >> 172.21.15.46:0/1810702643 conn(0x7fde840aca30 msgr2=0x7fde840ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 -- 172.21.15.46:0/1810702643 shutdown_connections 2024-05-09T02:23:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.643+0000 7fde8adce640 1 -- 172.21.15.46:0/1810702643 wait complete. 2024-05-09T02:23:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.645+0000 7fde8adce640 1 Processor -- start 2024-05-09T02:23:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.645+0000 7fde8adce640 1 -- start start 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8adce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 0x7fde840affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8adce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde840ca500 0x7fde841ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8adce640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde84156310 0x7fde8414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8adce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde840c9cb0 con 0x7fde840c5f70 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8adce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde841598d0 con 0x7fde840ca500 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8adce640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde840c96f0 con 0x7fde84156310 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde88b6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 0x7fde840affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde88b6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 0x7fde840affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40712/0 (socket says 172.21.15.46:40712) 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde88b6a640 1 -- 172.21.15.46:0/3643414878 learned_addr learned my addr 172.21.15.46:0/3643414878 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde8936b640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde84156310 0x7fde8414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.646+0000 7fde83fff640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde840ca500 0x7fde841ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde88b6a640 1 -- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde84156310 msgr2=0x7fde8414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde88b6a640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde84156310 0x7fde8414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde88b6a640 1 -- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde840ca500 msgr2=0x7fde841ec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde88b6a640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde840ca500 0x7fde841ec1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde88b6a640 1 -- 172.21.15.46:0/3643414878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde840ae150 con 0x7fde840c5f70 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde8936b640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde84156310 0x7fde8414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde88b6a640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 0x7fde840affa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c780 tx=0x7fde7400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74003b70 con 0x7fde840c5f70 2024-05-09T02:23:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fde74003d10 con 0x7fde840c5f70 2024-05-09T02:23:59.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7400aa70 con 0x7fde840c5f70 2024-05-09T02:23:59.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde841efa10 con 0x7fde840c5f70 2024-05-09T02:23:59.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.647+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde841ebcc0 con 0x7fde840c5f70 2024-05-09T02:23:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.648+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8406a330 con 0x7fde840c5f70 2024-05-09T02:23:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.649+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde7400ac10 con 0x7fde840c5f70 2024-05-09T02:23:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.649+0000 7fde817fa640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde64076300 0x7fde64078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:23:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.649+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fde74097a70 con 0x7fde840c5f70 2024-05-09T02:23:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.649+0000 7fde83fff640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde64076300 0x7fde64078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:23:59.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.650+0000 7fde83fff640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde64076300 0x7fde64078810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde6c034000 tx=0x7fde6c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:23:59.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.654+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde74060e20 con 0x7fde840c5f70 2024-05-09T02:23:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.886+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde840aa680 con 0x7fde840c5f70 2024-05-09T02:23:59.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.887+0000 7fde817fa640 1 -- 172.21.15.46:0/3643414878 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6490 (secure 0 0 0) 0x7fde74060720 con 0x7fde840c5f70 2024-05-09T02:23:59.889 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:23:59.889 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3313737822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3313737822},{"type":"v1","addr":"172.21.15.107:6836","nonce":3313737822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:56.976941+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5292,"qdb_cluster":[5292]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:23:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 42 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde64076300 msgr2=0x7fde64078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde64076300 0x7fde64078810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde6c034000 tx=0x7fde6c02e000 comp rx=0 tx=0).stop 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 msgr2=0x7fde840affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 0x7fde840affa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c780 tx=0x7fde7400cc40 comp rx=0 tx=0).stop 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 shutdown_connections 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fde64076300 0x7fde64078810 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde84156310 0x7fde8414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde840ca500 0x7fde841ec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 --2- 172.21.15.46:0/3643414878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c5f70 0x7fde840affa0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:23:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 >> 172.21.15.46:0/3643414878 conn(0x7fde840aca30 msgr2=0x7fde84075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:23:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 shutdown_connections 2024-05-09T02:23:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:23:59.889+0000 7fde8adce640 1 -- 172.21.15.46:0/3643414878 wait complete. 2024-05-09T02:23:59.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:24:00.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.016+0000 7f9c1e33f640 1 Processor -- start 2024-05-09T02:24:00.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.016+0000 7f9c1e33f640 1 -- start start 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1e33f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c18157940 0x7f9c18154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1e33f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 0x7f9c180c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1e33f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c180ad710 con 0x7f9c180c5fc0 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1e33f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9c18155400 con 0x7f9c18157940 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1e33f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1815af30 con 0x7f9c180c91d0 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1c8dc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 0x7f9c180c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c177fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c18157940 0x7f9c18154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c17fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9c180c5fc0 0x7f9c180c7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.46:34564/0 (socket says 172.21.15.46:34564) 2024-05-09T02:24:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c1c8dc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 0x7f9c180c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56666/0 (socket says 172.21.15.46:56666) 2024-05-09T02:24:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.017+0000 7f9c17fff640 1 -- 172.21.15.46:0/4183903595 learned_addr learned my addr 172.21.15.46:0/4183903595 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c16ffd640 1 -- 172.21.15.46:0/4183903595 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695534503 0 0) 0x7f9c180ad710 con 0x7f9c180c5fc0 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c16ffd640 1 -- 172.21.15.46:0/4183903595 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c00003520 con 0x7f9c180c5fc0 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/4183903595 >> v2:172.21.15.107:3300/0 conn(0x7f9c18157940 msgr2=0x7f9c18154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c1c8dc640 1 --2- 172.21.15.46:0/4183903595 >> v2:172.21.15.107:3300/0 conn(0x7f9c18157940 0x7f9c18154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/4183903595 >> v1:172.21.15.107:6789/0 conn(0x7f9c180c5fc0 legacy=0x7f9c180c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/4183903595 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1815b180 con 0x7f9c180c91d0 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.018+0000 7f9c177fe640 1 --2- 172.21.15.46:0/4183903595 >> v2:172.21.15.107:3300/0 conn(0x7f9c18157940 0x7f9c18154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c1c8dc640 1 --2- 172.21.15.46:0/4183903595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 0x7f9c180c95e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009d90 tx=0x7f9c1002a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d4eeee4fd11f590 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c16ffd640 1 -- 172.21.15.46:0/4183903595 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10007740 con 0x7f9c180c91d0 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c16ffd640 1 -- 172.21.15.46:0/4183903595 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c100078e0 con 0x7f9c180c91d0 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c16ffd640 1 -- 172.21.15.46:0/4183903595 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10007c90 con 0x7f9c180c91d0 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c1e33f640 1 -- 172.21.15.46:0/4183903595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 msgr2=0x7f9c180c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/4183903595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 0x7f9c180c95e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009d90 tx=0x7f9c1002a530 comp rx=0 tx=0).stop 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c1e33f640 1 -- 172.21.15.46:0/4183903595 shutdown_connections 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/4183903595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c91d0 0x7f9c180c95e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.019+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/4183903595 >> v2:172.21.15.107:3300/0 conn(0x7f9c18157940 0x7f9c18154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.020+0000 7f9c1e33f640 1 -- 172.21.15.46:0/4183903595 >> 172.21.15.46:0/4183903595 conn(0x7f9c18069040 msgr2=0x7f9c180ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.020+0000 7f9c1e33f640 1 -- 172.21.15.46:0/4183903595 shutdown_connections 2024-05-09T02:24:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.020+0000 7f9c1e33f640 1 -- 172.21.15.46:0/4183903595 wait complete. 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.021+0000 7f9c1e33f640 1 Processor -- start 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.021+0000 7f9c1e33f640 1 -- start start 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.022+0000 7f9c1e33f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c5fc0 0x7f9c180c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.022+0000 7f9c1e33f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c180c91d0 0x7f9c181edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1e33f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 0x7f9c1814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1e33f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1815ba20 con 0x7f9c18157940 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1e33f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1815b740 con 0x7f9c180c91d0 2024-05-09T02:24:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1e33f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1815bd00 con 0x7f9c180c5fc0 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 0x7f9c1814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 0x7f9c1814f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40718/0 (socket says 172.21.15.46:40718) 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/1382325681 learned_addr learned my addr 172.21.15.46:0/1382325681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c177fe640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c180c91d0 0x7f9c181edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c17fff640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c5fc0 0x7f9c180c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c5fc0 msgr2=0x7f9c180c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c5fc0 0x7f9c180c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c180c91d0 msgr2=0x7f9c181edec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c180c91d0 0x7f9c181edec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 -- 172.21.15.46:0/1382325681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c181503c0 con 0x7f9c18157940 2024-05-09T02:24:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c1c8dc640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 0x7f9c1814f7b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9c1002a570 tx=0x7f9c10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.023+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1003f070 con 0x7f9c18157940 2024-05-09T02:24:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.024+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c10031c40 con 0x7f9c18157940 2024-05-09T02:24:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.024+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c18154a90 con 0x7f9c18157940 2024-05-09T02:24:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.024+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10009450 con 0x7f9c18157940 2024-05-09T02:24:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.024+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c18152ad0 con 0x7f9c18157940 2024-05-09T02:24:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.024+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c181525e0 con 0x7f9c18157940 2024-05-09T02:24:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.025+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c10003b90 con 0x7f9c18157940 2024-05-09T02:24:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.026+0000 7f9c14ff9640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c04076300 0x7f9c04078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.026+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f9c100b8e80 con 0x7f9c18157940 2024-05-09T02:24:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.026+0000 7f9c17fff640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c04076300 0x7f9c04078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.027+0000 7f9c17fff640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c04076300 0x7f9c04078810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c08005880 tx=0x7f9c08006aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.031+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c10081a30 con 0x7f9c18157940 2024-05-09T02:24:00.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.260+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c1806a330 con 0x7f9c18157940 2024-05-09T02:24:00.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.261+0000 7f9c14ff9640 1 -- 172.21.15.46:0/1382325681 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+6490 (secure 0 0 0) 0x7f9c1008a100 con 0x7f9c18157940 2024-05-09T02:24:00.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:24:00.263 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3313737822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3313737822},{"type":"v1","addr":"172.21.15.107:6836","nonce":3313737822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:13.523096+0000","modified":"2024-05-09T02:22:56.976941+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5292},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5292":{"gid":5292,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6833/3541939604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3541939604},{"type":"v1","addr":"172.21.15.46:6833","nonce":3541939604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5292,"qdb_cluster":[5292]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:24:00.263 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 42 2024-05-09T02:24:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c04076300 msgr2=0x7f9c04078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c04076300 0x7f9c04078810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c08005880 tx=0x7f9c08006aa0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 msgr2=0x7f9c1814f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 0x7f9c1814f7b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9c1002a570 tx=0x7f9c10004a40 comp rx=0 tx=0).stop 2024-05-09T02:24:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 shutdown_connections 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c04076300 0x7f9c04078810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c18157940 0x7f9c1814f7b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c180c91d0 0x7f9c181edec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 --2- 172.21.15.46:0/1382325681 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c180c5fc0 0x7f9c180c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 >> 172.21.15.46:0/1382325681 conn(0x7f9c18069040 msgr2=0x7f9c18153880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 shutdown_connections 2024-05-09T02:24:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.263+0000 7f9c1e33f640 1 -- 172.21.15.46:0/1382325681 wait complete. 2024-05-09T02:24:00.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:24:00.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.390+0000 7f2e08e7e640 1 Processor -- start 2024-05-09T02:24:00.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.390+0000 7f2e08e7e640 1 -- start start 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.391+0000 7f2e08e7e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2e040c8410 0x7f2e041584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.391+0000 7f2e08e7e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e040c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.391+0000 7f2e08e7e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0406ed30 con 0x7f2e04140d40 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.391+0000 7f2e08e7e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2e040c8820 con 0x7f2e040c8410 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.391+0000 7f2e08e7e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0406f010 con 0x7f2e040c1e20 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e040c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e040c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.46:56680/0 (socket says 172.21.15.46:56680) 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 -- 172.21.15.46:0/2764738142 learned_addr learned my addr 172.21.15.46:0/2764738142 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2dfbfff640 1 --2- 172.21.15.46:0/2764738142 >> v2:172.21.15.107:3300/0 conn(0x7f2e040c8410 0x7f2e041584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 -- 172.21.15.46:0/2764738142 >> v2:172.21.15.107:3300/0 conn(0x7f2e040c8410 msgr2=0x7f2e041584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 --2- 172.21.15.46:0/2764738142 >> v2:172.21.15.107:3300/0 conn(0x7f2e040c8410 0x7f2e041584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 -- 172.21.15.46:0/2764738142 >> v1:172.21.15.107:6789/0 conn(0x7f2e04140d40 legacy=0x7f2e0406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2e02d9d640 1 -- 172.21.15.46:0/2764738142 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040c7930 con 0x7f2e040c1e20 2024-05-09T02:24:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.392+0000 7f2dfbfff640 1 --2- 172.21.15.46:0/2764738142 >> v2:172.21.15.107:3300/0 conn(0x7f2e040c8410 0x7f2e041584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T02:24:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.393+0000 7f2e02d9d640 1 --2- 172.21.15.46:0/2764738142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e040c8be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009e50 tx=0x7f2dfc02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb691d95f6891cc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.393+0000 7f2e01d9b640 1 -- 172.21.15.46:0/2764738142 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc036070 con 0x7f2e040c1e20 2024-05-09T02:24:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.393+0000 7f2e01d9b640 1 -- 172.21.15.46:0/2764738142 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2dfc031600 con 0x7f2e040c1e20 2024-05-09T02:24:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.393+0000 7f2e01d9b640 1 -- 172.21.15.46:0/2764738142 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0319f0 con 0x7f2e040c1e20 2024-05-09T02:24:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 -- 172.21.15.46:0/2764738142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 msgr2=0x7f2e040c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/2764738142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e040c8be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009e50 tx=0x7f2dfc02a680 comp rx=0 tx=0).stop 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 -- 172.21.15.46:0/2764738142 shutdown_connections 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/2764738142 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e040c8be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/2764738142 >> v2:172.21.15.107:3300/0 conn(0x7f2e040c8410 0x7f2e041584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 -- 172.21.15.46:0/2764738142 >> 172.21.15.46:0/2764738142 conn(0x7f2e04068e00 msgr2=0x7f2e040c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 -- 172.21.15.46:0/2764738142 shutdown_connections 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.394+0000 7f2e08e7e640 1 -- 172.21.15.46:0/2764738142 wait complete. 2024-05-09T02:24:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.396+0000 7f2e08e7e640 1 Processor -- start 2024-05-09T02:24:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.396+0000 7f2e08e7e640 1 -- start start 2024-05-09T02:24:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e08e7e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e0413edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e08e7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e040c8410 0x7f2e040c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e08e7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 0x7f2e041e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e08e7e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040c9120 con 0x7f2e04140d40 2024-05-09T02:24:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e08e7e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040c7ef0 con 0x7f2e040c8410 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e08e7e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e040c92a0 con 0x7f2e040c1e20 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e02d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 0x7f2e041e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e02d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 0x7f2e041e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40728/0 (socket says 172.21.15.46:40728) 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e02d9d640 1 -- 172.21.15.46:0/474495120 learned_addr learned my addr 172.21.15.46:0/474495120 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2e0259c640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e0413edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.397+0000 7f2dfbfff640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e040c8410 0x7f2e040c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e02d9d640 1 -- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 msgr2=0x7f2e0413edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e02d9d640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e0413edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e02d9d640 1 -- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e040c8410 msgr2=0x7f2e040c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e02d9d640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e040c8410 0x7f2e040c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e02d9d640 1 -- 172.21.15.46:0/474495120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e041404e0 con 0x7f2e04140d40 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e02d9d640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 0x7f2e041e3480 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc034040 tx=0x7f2dfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc036050 con 0x7f2e04140d40 2024-05-09T02:24:00.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0413f310 con 0x7f2e04140d40 2024-05-09T02:24:00.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2dfc042070 con 0x7f2e04140d40 2024-05-09T02:24:00.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc009510 con 0x7f2e04140d40 2024-05-09T02:24:00.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.398+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0413e920 con 0x7f2e04140d40 2024-05-09T02:24:00.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.399+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0413eb60 con 0x7f2e04140d40 2024-05-09T02:24:00.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.400+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2dfc007c10 con 0x7f2e04140d40 2024-05-09T02:24:00.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.401+0000 7f2dfaffd640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2de40762d0 0x7f2de40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.401+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f2dfc0b94a0 con 0x7f2e04140d40 2024-05-09T02:24:00.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.401+0000 7f2e0259c640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2de40762d0 0x7f2de40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.402+0000 7f2e0259c640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2de40762d0 0x7f2de40787e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2df4000f60 tx=0x7f2df4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.405+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e0413eb60 con 0x7f2e04140d40 2024-05-09T02:24:00.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.597+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e0406a330 con 0x7f2e04140d40 2024-05-09T02:24:00.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.598+0000 7f2dfaffd640 1 -- 172.21.15.46:0/474495120 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+21333 (secure 0 0 0) 0x7f2dfc082170 con 0x7f2e04140d40 2024-05-09T02:24:00.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:24:00.600 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:22:53.964778+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-09T02:18:11.443101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-09T02:18:12.479871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6834/1968918469":"2024-05-10T02:22:53.964723+0000","172.21.15.46:6832/3794663718":"2024-05-10T02:22:39.920164+0000","172.21.15.46:6833/3794663718":"2024-05-10T02:22:39.920164+0000","172.21.15.46:6835/687229870":"2024-05-10T02:20:29.906793+0000","172.21.15.46:6834/687229870":"2024-05-10T02:20:29.906793+0000","172.21.15.107:6837/3709209674":"2024-05-10T02:20:29.900468+0000","172.21.15.46:6833/268323982":"2024-05-10T02:19:54.895024+0000","172.21.15.46:6832/268323982":"2024-05-10T02:19:54.895024+0000","172.21.15.107:6836/1968918469":"2024-05-10T02:22:53.964723+0000","172.21.15.107:6835/3709209674":"2024-05-10T02:20:29.900468+0000","172.21.15.107:6837/16654146":"2024-05-10T02:19:04.887047+0000","172.21.15.107:6835/16654146":"2024-05-10T02:19:04.887047+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:24:00.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2de40762d0 msgr2=0x7f2de40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2de40762d0 0x7f2de40787e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2df4000f60 tx=0x7f2df4009040 comp rx=0 tx=0).stop 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 msgr2=0x7f2e041e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 0x7f2e041e3480 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc034040 tx=0x7f2dfc004a40 comp rx=0 tx=0).stop 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 shutdown_connections 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f2de40762d0 0x7f2de40787e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e04140d40 0x7f2e041e3480 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e040c8410 0x7f2e040c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 --2- 172.21.15.46:0/474495120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e040c1e20 0x7f2e0413edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 >> 172.21.15.46:0/474495120 conn(0x7f2e04068e00 msgr2=0x7f2e040c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 shutdown_connections 2024-05-09T02:24:00.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.600+0000 7f2e08e7e640 1 -- 172.21.15.46:0/474495120 wait complete. 2024-05-09T02:24:00.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-05-09T02:24:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.728+0000 7f56005f3640 1 Processor -- start 2024-05-09T02:24:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.728+0000 7f56005f3640 1 -- start start 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f56005f3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f55f806d210 0x7f55f80c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f56005f3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f80c5660 0x7f55f80c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f56005f3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f806f880 0x7f55f806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f56005f3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f55f8156780 con 0x7f55f806f880 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f56005f3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f55f80ad1a0 con 0x7f55f806d210 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f56005f3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55f81559c0 con 0x7f55f80c5660 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f806f880 0x7f55f806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55f806f880 0x7f55f806fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40734/0 (socket says 172.21.15.46:40734) 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 -- 172.21.15.46:0/2218453855 learned_addr learned my addr 172.21.15.46:0/2218453855 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55fe38f640 1 --2- 172.21.15.46:0/2218453855 >> v2:172.21.15.107:3300/0 conn(0x7f55f806d210 0x7f55f80c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55fdb8e640 1 --2- 172.21.15.46:0/2218453855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f80c5660 0x7f55f80c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 -- 172.21.15.46:0/2218453855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f80c5660 msgr2=0x7f55f80c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 --2- 172.21.15.46:0/2218453855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f80c5660 0x7f55f80c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 -- 172.21.15.46:0/2218453855 >> v2:172.21.15.107:3300/0 conn(0x7f55f806d210 msgr2=0x7f55f80c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 --2- 172.21.15.46:0/2218453855 >> v2:172.21.15.107:3300/0 conn(0x7f55f806d210 0x7f55f80c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.730+0000 7f55feb90640 1 -- 172.21.15.46:0/2218453855 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f8155ca0 con 0x7f55f806f880 2024-05-09T02:24:00.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.731+0000 7f55feb90640 1 --2- 172.21.15.46:0/2218453855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f806fc90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f55f8072170 tx=0x7f55f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895eabbca7417270 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.731+0000 7f55fd38d640 1 -- 172.21.15.46:0/2218453855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0037070 con 0x7f55f806f880 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.731+0000 7f55fd38d640 1 -- 172.21.15.46:0/2218453855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f55f0032440 con 0x7f55f806f880 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.731+0000 7f55fd38d640 1 -- 172.21.15.46:0/2218453855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0032830 con 0x7f55f806f880 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 -- 172.21.15.46:0/2218453855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 msgr2=0x7f55f806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 --2- 172.21.15.46:0/2218453855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f806fc90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f55f8072170 tx=0x7f55f002a1e0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 -- 172.21.15.46:0/2218453855 shutdown_connections 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 --2- 172.21.15.46:0/2218453855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f806fc90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 --2- 172.21.15.46:0/2218453855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f80c5660 0x7f55f80c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 --2- 172.21.15.46:0/2218453855 >> v2:172.21.15.107:3300/0 conn(0x7f55f806d210 0x7f55f80c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 -- 172.21.15.46:0/2218453855 >> 172.21.15.46:0/2218453855 conn(0x7f55f80c9200 msgr2=0x7f55f806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 -- 172.21.15.46:0/2218453855 shutdown_connections 2024-05-09T02:24:00.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.732+0000 7f56005f3640 1 -- 172.21.15.46:0/2218453855 wait complete. 2024-05-09T02:24:00.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.734+0000 7f56005f3640 1 Processor -- start 2024-05-09T02:24:00.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.734+0000 7f56005f3640 1 -- start start 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f56005f3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f806d210 0x7f55f814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f56005f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f56005f3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55f80c5660 0x7f55f8153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f56005f3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f55f80ac060 con 0x7f55f806f880 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f56005f3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8156260 con 0x7f55f80c5660 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f56005f3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80ae020 con 0x7f55f806d210 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f814a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40738/0 (socket says 172.21.15.46:40738) 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 -- 172.21.15.46:0/3420622064 learned_addr learned my addr 172.21.15.46:0/3420622064 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55feb90640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55f80c5660 0x7f55f8153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fe38f640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f806d210 0x7f55f814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 -- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f806d210 msgr2=0x7f55f814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f806d210 0x7f55f814dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 -- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55f80c5660 msgr2=0x7f55f8153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55f80c5660 0x7f55f8153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 -- 172.21.15.46:0/3420622064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f81ebda0 con 0x7f55f806f880 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.735+0000 7f55fdb8e640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f814a950 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00d5a0 tx=0x7f55ec00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.736+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec019070 con 0x7f55f806f880 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.736+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f55ec004240 con 0x7f55f806f880 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.736+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec003610 con 0x7f55f806f880 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.736+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f81ec080 con 0x7f55f806f880 2024-05-09T02:24:00.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.736+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f81ec640 con 0x7f55f806f880 2024-05-09T02:24:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.737+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f806a330 con 0x7f55f806f880 2024-05-09T02:24:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.737+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55ec01c070 con 0x7f55f806f880 2024-05-09T02:24:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.738+0000 7f55f6ffd640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55e40762d0 0x7f55e40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.738+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f55ec097510 con 0x7f55f806f880 2024-05-09T02:24:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.738+0000 7f55fe38f640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55e40762d0 0x7f55e40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.739+0000 7f55fe38f640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55e40762d0 0x7f55e40787e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f55f80c3420 tx=0x7f55e8009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.742+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55ec0601e0 con 0x7f55f806f880 2024-05-09T02:24:00.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.971+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7f55f81ec810 con 0x7f55f806f880 2024-05-09T02:24:00.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.973+0000 7f55f6ffd640 1 -- 172.21.15.46:0/3420622064 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) ==== 151+0+0 (secure 0 0 0) 0x7f55ec0644e0 con 0x7f55f806f880 2024-05-09T02:24:00.975 INFO:teuthology.orchestra.run.smithi046.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55e40762d0 msgr2=0x7f55e40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55e40762d0 0x7f55e40787e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f55f80c3420 tx=0x7f55e8009830 comp rx=0 tx=0).stop 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 msgr2=0x7f55f814a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f814a950 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00d5a0 tx=0x7f55ec00da60 comp rx=0 tx=0).stop 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 shutdown_connections 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f55e40762d0 0x7f55e40787e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55f80c5660 0x7f55f8153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f806f880 0x7f55f814a950 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 --2- 172.21.15.46:0/3420622064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55f806d210 0x7f55f814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 >> 172.21.15.46:0/3420622064 conn(0x7f55f80c9200 msgr2=0x7f55f80c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 shutdown_connections 2024-05-09T02:24:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:00.977+0000 7f56005f3640 1 -- 172.21.15.46:0/3420622064 wait complete. 2024-05-09T02:24:00.989 INFO:tasks.ceph.mds.c.smithi046.stderr: -2089> 2024-05-09T02:22:58.973+0000 7f9fe1540640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:24:00.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-05-09T02:24:01.046 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-05-09T02:24:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.113+0000 7f804cb3f640 1 Processor -- start 2024-05-09T02:24:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.113+0000 7f804cb3f640 1 -- start start 2024-05-09T02:24:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804cb3f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8048155170 0x7f80480c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804cb3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80480cc230 0x7f80480cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804cb3f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80480cb6a0 con 0x7f8048157fd0 2024-05-09T02:24:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804cb3f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f804815c000 con 0x7f8048155170 2024-05-09T02:24:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804cb3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80480c94d0 con 0x7f80480cc230 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8048155170 0x7f80480c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f8046d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8048157fd0 0x7f80481583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48836/0 (socket says 172.21.15.46:48836) 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f8046d9d640 1 -- 172.21.15.46:0/2076518794 learned_addr learned my addr 172.21.15.46:0/2076518794 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f8045d9b640 1 --2- 172.21.15.46:0/2076518794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80480cc230 0x7f80480cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804659c640 1 -- 172.21.15.46:0/2076518794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80480cc230 msgr2=0x7f80480cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804659c640 1 --2- 172.21.15.46:0/2076518794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80480cc230 0x7f80480cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804659c640 1 -- 172.21.15.46:0/2076518794 >> v1:172.21.15.46:6789/0 conn(0x7f8048157fd0 legacy=0x7f80481583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804659c640 1 -- 172.21.15.46:0/2076518794 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80480cb980 con 0x7f8048155170 2024-05-09T02:24:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.115+0000 7f804559a640 1 -- 172.21.15.46:0/2076518794 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854986253 0 0) 0x7f80480cb6a0 con 0x7f8048157fd0 2024-05-09T02:24:01.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.116+0000 7f804659c640 1 --2- 172.21.15.46:0/2076518794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8048155170 0x7f80480c82b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80380097a0 tx=0x7f803802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff6c833a5c9f47a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:01.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.116+0000 7f804559a640 1 -- 172.21.15.46:0/2076518794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038037070 con 0x7f8048155170 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.116+0000 7f804559a640 1 -- 172.21.15.46:0/2076518794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f803802ae50 con 0x7f8048155170 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.116+0000 7f804559a640 1 -- 172.21.15.46:0/2076518794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038032680 con 0x7f8048155170 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 -- 172.21.15.46:0/2076518794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8048155170 msgr2=0x7f80480c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 --2- 172.21.15.46:0/2076518794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8048155170 0x7f80480c82b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80380097a0 tx=0x7f803802a100 comp rx=0 tx=0).stop 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 -- 172.21.15.46:0/2076518794 shutdown_connections 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 --2- 172.21.15.46:0/2076518794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80480cc230 0x7f80480cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 --2- 172.21.15.46:0/2076518794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8048155170 0x7f80480c82b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 -- 172.21.15.46:0/2076518794 >> 172.21.15.46:0/2076518794 conn(0x7f80480aea70 msgr2=0x7f80480aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 -- 172.21.15.46:0/2076518794 shutdown_connections 2024-05-09T02:24:01.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.117+0000 7f804cb3f640 1 -- 172.21.15.46:0/2076518794 wait complete. 2024-05-09T02:24:01.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.119+0000 7f804cb3f640 1 Processor -- start 2024-05-09T02:24:01.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.119+0000 7f804cb3f640 1 -- start start 2024-05-09T02:24:01.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804cb3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 0x7f80481528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:01.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804cb3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8048155170 0x7f8048159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:01.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804cb3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8048157fd0 0x7f804814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:01.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804cb3f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f804815b030 con 0x7f80480cc230 2024-05-09T02:24:01.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804cb3f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80480cbf40 con 0x7f8048157fd0 2024-05-09T02:24:01.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804cb3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8048157a40 con 0x7f8048155170 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 0x7f80481528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 0x7f80481528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40784/0 (socket says 172.21.15.46:40784) 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f804659c640 1 -- 172.21.15.46:0/1730737220 learned_addr learned my addr 172.21.15.46:0/1730737220 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f8046d9d640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8048157fd0 0x7f804814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.120+0000 7f8045d9b640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8048155170 0x7f8048159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804659c640 1 -- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8048155170 msgr2=0x7f8048159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804659c640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8048155170 0x7f8048159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804659c640 1 -- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8048157fd0 msgr2=0x7f804814e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804659c640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8048157fd0 0x7f804814e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804659c640 1 -- 172.21.15.46:0/1730737220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8048154700 con 0x7f80480cc230 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804659c640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 0x7f80481528d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c00 tx=0x7f80380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038037040 con 0x7f80480cc230 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8038004030 con 0x7f80480cc230 2024-05-09T02:24:01.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038004440 con 0x7f80480cc230 2024-05-09T02:24:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80481ee960 con 0x7f80480cc230 2024-05-09T02:24:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.121+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8048153f00 con 0x7f80480cc230 2024-05-09T02:24:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.122+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f804806a330 con 0x7f80480cc230 2024-05-09T02:24:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.123+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8038003610 con 0x7f80480cc230 2024-05-09T02:24:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.123+0000 7f8036ffd640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8028076300 0x7f8028078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.123+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f80380b8f50 con 0x7f80480cc230 2024-05-09T02:24:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.124+0000 7f8045d9b640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8028076300 0x7f8028078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.124+0000 7f8045d9b640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8028076300 0x7f8028078810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80480ca410 tx=0x7f803c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:01.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.127+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8038081d60 con 0x7f80480cc230 2024-05-09T02:24:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.356+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7f8048158910 con 0x7f80480cc230 2024-05-09T02:24:01.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.975+0000 7f8036ffd640 1 -- 172.21.15.46:0/1730737220 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v44) ==== 99+0+0 (secure 0 0 0) 0x7f803808a3a0 con 0x7f80480cc230 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8028076300 msgr2=0x7f8028078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8028076300 0x7f8028078810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80480ca410 tx=0x7f803c009190 comp rx=0 tx=0).stop 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 msgr2=0x7f80481528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 0x7f80481528d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c00 tx=0x7f80380046c0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 shutdown_connections 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f8028076300 0x7f8028078810 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8048157fd0 0x7f804814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8048155170 0x7f8048159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 --2- 172.21.15.46:0/1730737220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80480cc230 0x7f80481528d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:01.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 >> 172.21.15.46:0/1730737220 conn(0x7f80480aea70 msgr2=0x7f8048155610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:01.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 shutdown_connections 2024-05-09T02:24:01.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:01.978+0000 7f804cb3f640 1 -- 172.21.15.46:0/1730737220 wait complete. 2024-05-09T02:24:01.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-05-09T02:24:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.121+0000 7fb8fb0ee640 1 Processor -- start 2024-05-09T02:24:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.122+0000 7fb8fb0ee640 1 -- start start 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8fb0ee640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8f40c9290 0x7fb8f41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8fb0ee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c5b50 0x7fb8f40c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8fb0ee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f4157cc0 con 0x7fb8f40c9710 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8fb0ee640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f415b1a0 con 0x7fb8f40c9290 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8fb0ee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f4158310 con 0x7fb8f40c5b50 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8f40c9290 0x7fb8f41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8f40c9290 0x7fb8f41587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40794/0 (socket says 172.21.15.46:40794) 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/1701989881 learned_addr learned my addr 172.21.15.46:0/1701989881 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f3fff640 1 --1- 172.21.15.46:0/1701989881 >> v1:172.21.15.46:6789/0 conn(0x7fb8f40c9710 0x7fb8f4155210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48838/0 (socket says 172.21.15.46:48838) 2024-05-09T02:24:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f968b640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c5b50 0x7fb8f40c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/1701989881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c5b50 msgr2=0x7fb8f40c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c5b50 0x7fb8f40c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/1701989881 >> v1:172.21.15.46:6789/0 conn(0x7fb8f40c9710 legacy=0x7fb8f4155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/1701989881 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f4157fa0 con 0x7fb8f40c9290 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f37fe640 1 -- 172.21.15.46:0/1701989881 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365428493 0 0) 0x7fb8f4157cc0 con 0x7fb8f40c9710 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.123+0000 7fb8f968b640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c5b50 0x7fb8f40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.124+0000 7fb8f8e8a640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c9290 0x7fb8f41587a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009870 tx=0x7fb8e402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1a9252649048d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.124+0000 7fb8f37fe640 1 -- 172.21.15.46:0/1701989881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4037070 con 0x7fb8f40c9290 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.124+0000 7fb8f37fe640 1 -- 172.21.15.46:0/1701989881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb8e4032440 con 0x7fb8f40c9290 2024-05-09T02:24:02.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.124+0000 7fb8f37fe640 1 -- 172.21.15.46:0/1701989881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4032830 con 0x7fb8f40c9290 2024-05-09T02:24:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/1701989881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c9290 msgr2=0x7fb8f41587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c9290 0x7fb8f41587a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009870 tx=0x7fb8e402a1c0 comp rx=0 tx=0).stop 2024-05-09T02:24:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/1701989881 shutdown_connections 2024-05-09T02:24:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c5b50 0x7fb8f40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/1701989881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c9290 0x7fb8f41587a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/1701989881 >> 172.21.15.46:0/1701989881 conn(0x7fb8f406dad0 msgr2=0x7fb8f406dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:02.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/1701989881 shutdown_connections 2024-05-09T02:24:02.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.125+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/1701989881 wait complete. 2024-05-09T02:24:02.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.127+0000 7fb8fb0ee640 1 Processor -- start 2024-05-09T02:24:02.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.127+0000 7fb8fb0ee640 1 -- start start 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8fb0ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 0x7fb8f41f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8fb0ee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c9290 0x7fb8f41f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8fb0ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8f40c9710 0x7fb8f4145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8fb0ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f40c4440 con 0x7fb8f40c5b50 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8fb0ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f40c42c0 con 0x7fb8f40c9710 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8fb0ee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f40ca140 con 0x7fb8f40c9290 2024-05-09T02:24:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8f8e8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 0x7fb8f41f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8f8e8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 0x7fb8f41f1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40802/0 (socket says 172.21.15.46:40802) 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/298232433 learned_addr learned my addr 172.21.15.46:0/298232433 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8f3fff640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c9290 0x7fb8f41f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.128+0000 7fb8f968b640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8f40c9710 0x7fb8f4145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c9290 msgr2=0x7fb8f41f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f8e8a640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c9290 0x7fb8f41f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8f40c9710 msgr2=0x7fb8f4145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f8e8a640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8f40c9710 0x7fb8f4145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f8e8a640 1 -- 172.21.15.46:0/298232433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f40cbc00 con 0x7fb8f40c5b50 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f968b640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8f40c9710 0x7fb8f4145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f8e8a640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 0x7fb8f41f1740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009870 tx=0x7fb8e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4041020 con 0x7fb8f40c5b50 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb8e4030970 con 0x7fb8f40c5b50 2024-05-09T02:24:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f4149e80 con 0x7fb8f40c5b50 2024-05-09T02:24:02.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4037040 con 0x7fb8f40c5b50 2024-05-09T02:24:02.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.129+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f40cb920 con 0x7fb8f40c5b50 2024-05-09T02:24:02.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.130+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f40c4750 con 0x7fb8f40c5b50 2024-05-09T02:24:02.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.131+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8e4044020 con 0x7fb8f40c5b50 2024-05-09T02:24:02.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.131+0000 7fb8f17fa640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb8e0076300 0x7fb8e0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:02.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.131+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7fb8e40b8740 con 0x7fb8f40c5b50 2024-05-09T02:24:02.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.132+0000 7fb8f3fff640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb8e0076300 0x7fb8e0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:02.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.132+0000 7fb8f3fff640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb8e0076300 0x7fb8e0078810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4157b50 tx=0x7fb8e8007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:02.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.136+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb8f40c4750 con 0x7fb8f40c5b50 2024-05-09T02:24:02.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:02.330+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb8f406a3a0 con 0x7fb8f40c5b50 2024-05-09T02:24:03.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.172+0000 7fb8f17fa640 1 -- 172.21.15.46:0/298232433 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v35) ==== 166+0+0 (secure 0 0 0) 0x7fb8e404b030 con 0x7fb8f40c5b50 2024-05-09T02:24:03.174 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'a_metadata' removed 2024-05-09T02:24:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.175+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb8e0076300 msgr2=0x7fb8e0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.175+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb8e0076300 0x7fb8e0078810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4157b50 tx=0x7fb8e8007de0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.175+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 msgr2=0x7fb8f41f1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.175+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 0x7fb8f41f1740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009870 tx=0x7fb8e40046c0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.176+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 shutdown_connections 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.176+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fb8e0076300 0x7fb8e0078810 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.176+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8f40c9710 0x7fb8f4145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.176+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb8f40c9290 0x7fb8f41f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.176+0000 7fb8fb0ee640 1 --2- 172.21.15.46:0/298232433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8f40c5b50 0x7fb8f41f1740 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.176+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 >> 172.21.15.46:0/298232433 conn(0x7fb8f406dad0 msgr2=0x7fb8f40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.177+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 shutdown_connections 2024-05-09T02:24:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.177+0000 7fb8fb0ee640 1 -- 172.21.15.46:0/298232433 wait complete. 2024-05-09T02:24:03.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-05-09T02:24:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.317+0000 7fd1ca419640 1 Processor -- start 2024-05-09T02:24:03.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.317+0000 7fd1ca419640 1 -- start start 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1ca419640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1c40c6e00 0x7fd1c40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1ca419640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1ca419640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c4158570 con 0x7fd1c40c9930 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1ca419640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c4158850 con 0x7fd1c40c6e00 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1ca419640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c40c20f0 con 0x7fd1c40c9d40 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1c40c6e00 0x7fd1c40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1c40c6e00 0x7fd1c40c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40812/0 (socket says 172.21.15.46:40812) 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 -- 172.21.15.46:0/968058162 learned_addr learned my addr 172.21.15.46:0/968058162 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c89b6640 1 --2- 172.21.15.46:0/968058162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 -- 172.21.15.46:0/968058162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 msgr2=0x7fd1c40c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:03.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 --2- 172.21.15.46:0/968058162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c40c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 -- 172.21.15.46:0/968058162 >> v1:172.21.15.107:6789/0 conn(0x7fd1c40c9930 legacy=0x7fd1c40c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:03.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.319+0000 7fd1c3fff640 1 -- 172.21.15.46:0/968058162 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c40c23d0 con 0x7fd1c40c6e00 2024-05-09T02:24:03.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.320+0000 7fd1c3fff640 1 --2- 172.21.15.46:0/968058162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c6e00 0x7fd1c40c93f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009870 tx=0x7fd1b402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44da748330c60417 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:03.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.320+0000 7fd1c2ffd640 1 -- 172.21.15.46:0/968058162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4037070 con 0x7fd1c40c6e00 2024-05-09T02:24:03.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.320+0000 7fd1c2ffd640 1 -- 172.21.15.46:0/968058162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd1b4032440 con 0x7fd1c40c6e00 2024-05-09T02:24:03.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.320+0000 7fd1c2ffd640 1 -- 172.21.15.46:0/968058162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4032830 con 0x7fd1c40c6e00 2024-05-09T02:24:03.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 -- 172.21.15.46:0/968058162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c6e00 msgr2=0x7fd1c40c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:03.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 --2- 172.21.15.46:0/968058162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c6e00 0x7fd1c40c93f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009870 tx=0x7fd1b402a130 comp rx=0 tx=0).stop 2024-05-09T02:24:03.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 -- 172.21.15.46:0/968058162 shutdown_connections 2024-05-09T02:24:03.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 --2- 172.21.15.46:0/968058162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c40c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 --2- 172.21.15.46:0/968058162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c6e00 0x7fd1c40c93f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 -- 172.21.15.46:0/968058162 >> 172.21.15.46:0/968058162 conn(0x7fd1c406e9b0 msgr2=0x7fd1c406edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:03.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 -- 172.21.15.46:0/968058162 shutdown_connections 2024-05-09T02:24:03.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.321+0000 7fd1ca419640 1 -- 172.21.15.46:0/968058162 wait complete. 2024-05-09T02:24:03.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.322+0000 7fd1ca419640 1 Processor -- start 2024-05-09T02:24:03.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.323+0000 7fd1ca419640 1 -- start start 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1ca419640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c40c6e00 0x7fd1c4159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1ca419640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 0x7fd1c4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1ca419640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c41f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1ca419640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40c8510 con 0x7fd1c40c9930 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1ca419640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4155450 con 0x7fd1c40c6e00 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1ca419640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c40c8690 con 0x7fd1c40c9d40 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 0x7fd1c4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 0x7fd1c4152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40818/0 (socket says 172.21.15.46:40818) 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 -- 172.21.15.46:0/1911971328 learned_addr learned my addr 172.21.15.46:0/1911971328 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c89b6640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c41f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:03.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c3fff640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c40c6e00 0x7fd1c4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 -- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 msgr2=0x7fd1c41f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c41f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 -- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c40c6e00 msgr2=0x7fd1c4159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c40c6e00 0x7fd1c4159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.324+0000 7fd1c37fe640 1 -- 172.21.15.46:0/1911971328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c414f830 con 0x7fd1c40c9930 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.325+0000 7fd1c37fe640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 0x7fd1c4152640 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c3d0 tx=0x7fd1b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.325+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8017070 con 0x7fd1c40c9930 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.325+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd1b80052d0 con 0x7fd1c40c9930 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.325+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c41f1b60 con 0x7fd1c40c9930 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.325+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003850 con 0x7fd1c40c9930 2024-05-09T02:24:03.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.325+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c4158d70 con 0x7fd1c40c9930 2024-05-09T02:24:03.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.326+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c406a3a0 con 0x7fd1c40c9930 2024-05-09T02:24:03.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.327+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd1b801a070 con 0x7fd1c40c9930 2024-05-09T02:24:03.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.327+0000 7fd1c0ff9640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1b00762d0 0x7fd1b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:03.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.327+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6811+0+0 (secure 0 0 0) 0x7fd1b8096d70 con 0x7fd1c40c9930 2024-05-09T02:24:03.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.327+0000 7fd1c3fff640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1b00762d0 0x7fd1b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:03.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.328+0000 7fd1c3fff640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1b00762d0 0x7fd1b00787e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4034000 tx=0x7fd1b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:03.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.332+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd1b8060280 con 0x7fd1c40c9930 2024-05-09T02:24:03.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:03.521+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1c40c1ed0 con 0x7fd1c40c9930 2024-05-09T02:24:04.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.173+0000 7fd1c0ff9640 1 -- 172.21.15.46:0/1911971328 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v36) ==== 154+0+0 (secure 0 0 0) 0x7fd1b8068270 con 0x7fd1c40c9930 2024-05-09T02:24:04.175 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'a_data' removed 2024-05-09T02:24:04.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1b00762d0 msgr2=0x7fd1b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1b00762d0 0x7fd1b00787e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4034000 tx=0x7fd1b402e000 comp rx=0 tx=0).stop 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 msgr2=0x7fd1c4152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 0x7fd1c4152640 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c3d0 tx=0x7fd1b800c890 comp rx=0 tx=0).stop 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 shutdown_connections 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fd1b00762d0 0x7fd1b00787e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1c40c9d40 0x7fd1c41f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c40c9930 0x7fd1c4152640 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.177+0000 7fd1ca419640 1 --2- 172.21.15.46:0/1911971328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c40c6e00 0x7fd1c4159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.178+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 >> 172.21.15.46:0/1911971328 conn(0x7fd1c406e9b0 msgr2=0x7fd1c40cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:04.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.178+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 shutdown_connections 2024-05-09T02:24:04.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.178+0000 7fd1ca419640 1 -- 172.21.15.46:0/1911971328 wait complete. 2024-05-09T02:24:04.201 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-05-09T02:24:04.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:24:04.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.320+0000 7f64f00a7640 1 Processor -- start 2024-05-09T02:24:04.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.320+0000 7f64f00a7640 1 -- start start 2024-05-09T02:24:04.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.321+0000 7f64f00a7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.321+0000 7f64f00a7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64e80c92f0 0x7f64e80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.321+0000 7f64f00a7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e8158580 con 0x7f64e80c9c40 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.321+0000 7f64f00a7640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f64e80c2690 con 0x7f64e80c92f0 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.321+0000 7f64f00a7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f64e8158860 con 0x7f64e80c6d70 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64e80c92f0 0x7f64e80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64e80c92f0 0x7f64e80c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40834/0 (socket says 172.21.15.46:40834) 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 -- 172.21.15.46:0/1336490416 learned_addr learned my addr 172.21.15.46:0/1336490416 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ede43640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 -- 172.21.15.46:0/1336490416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 msgr2=0x7f64e8154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 -- 172.21.15.46:0/1336490416 >> v1:172.21.15.107:6789/0 conn(0x7f64e80c9c40 legacy=0x7f64e80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ed642640 1 -- 172.21.15.46:0/1336490416 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e80c2040 con 0x7f64e80c92f0 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.322+0000 7f64ede43640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.323+0000 7f64ed642640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e80c9700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22ae4b2f37078b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.323+0000 7f64ece41640 1 -- 172.21.15.46:0/1336490416 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc037070 con 0x7f64e80c92f0 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.323+0000 7f64ece41640 1 -- 172.21.15.46:0/1336490416 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f64dc02adf0 con 0x7f64e80c92f0 2024-05-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.323+0000 7f64ece41640 1 -- 172.21.15.46:0/1336490416 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc032680 con 0x7f64e80c92f0 2024-05-09T02:24:04.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 -- 172.21.15.46:0/1336490416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 msgr2=0x7f64e80c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e80c9700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc02a0a0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 -- 172.21.15.46:0/1336490416 shutdown_connections 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e80c9700 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1336490416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 -- 172.21.15.46:0/1336490416 >> 172.21.15.46:0/1336490416 conn(0x7f64e806e8f0 msgr2=0x7f64e806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 -- 172.21.15.46:0/1336490416 shutdown_connections 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.324+0000 7f64f00a7640 1 -- 172.21.15.46:0/1336490416 wait complete. 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.325+0000 7f64f00a7640 1 Processor -- start 2024-05-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.325+0000 7f64f00a7640 1 -- start start 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64f00a7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64f00a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64f00a7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64e80c9c40 0x7f64e81f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64f00a7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f64e80c80a0 con 0x7f64e80c92f0 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64f00a7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f64e80c7f20 con 0x7f64e80c9c40 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64f00a7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f64e80c8220 con 0x7f64e80c6d70 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e814d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40844/0 (socket says 172.21.15.46:40844) 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 -- 172.21.15.46:0/1747578133 learned_addr learned my addr 172.21.15.46:0/1747578133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ede43640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ee644640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64e80c9c40 0x7f64e81f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 -- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 msgr2=0x7f64e8152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 -- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64e80c9c40 msgr2=0x7f64e81f1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64e80c9c40 0x7f64e81f1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.327+0000 7f64ed642640 1 -- 172.21.15.46:0/1747578133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8149cd0 con 0x7f64e80c92f0 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.328+0000 7f64ed642640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e814d8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.328+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc041020 con 0x7f64e80c92f0 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.328+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f64dc03b610 con 0x7f64e80c92f0 2024-05-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.328+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc037040 con 0x7f64e80c92f0 2024-05-09T02:24:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.328+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e8149fb0 con 0x7f64e80c92f0 2024-05-09T02:24:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.328+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e80cab90 con 0x7f64e80c92f0 2024-05-09T02:24:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.329+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e806a330 con 0x7f64e80c92f0 2024-05-09T02:24:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.330+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64dc044020 con 0x7f64e80c92f0 2024-05-09T02:24:04.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.331+0000 7f64e67fc640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64d4076350 0x7f64d4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.331+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6291+0+0 (secure 0 0 0) 0x7f64dc0b7b40 con 0x7f64e80c92f0 2024-05-09T02:24:04.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.332+0000 7f64ede43640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64d4076350 0x7f64d4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.332+0000 7f64ede43640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64d4076350 0x7f64d4078860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f64e80c5520 tx=0x7f64e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:04.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.340+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64dc04b030 con 0x7f64e80c92f0 2024-05-09T02:24:04.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.581+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64e8069e80 con 0x7f64e80c92f0 2024-05-09T02:24:04.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.582+0000 7f64e67fc640 1 -- 172.21.15.46:0/1747578133 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f64dc081220 con 0x7f64e80c92f0 2024-05-09T02:24:04.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:24:04.584 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3313737822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3313737822},{"type":"v1","addr":"172.21.15.107:6836","nonce":3313737822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/1696143452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1696143452},{"type":"v1","addr":"172.21.15.46:6833","nonce":1696143452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:24:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 44 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64d4076350 msgr2=0x7f64d4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64d4076350 0x7f64d4078860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f64e80c5520 tx=0x7f64e0008040 comp rx=0 tx=0).stop 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 msgr2=0x7f64e814d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e814d8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc0046c0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 shutdown_connections 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f64d4076350 0x7f64d4078860 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64e80c9c40 0x7f64e81f1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64e80c92f0 0x7f64e814d8f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 --2- 172.21.15.46:0/1747578133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64e80c6d70 0x7f64e8152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 >> 172.21.15.46:0/1747578133 conn(0x7f64e806e8f0 msgr2=0x7f64e806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 shutdown_connections 2024-05-09T02:24:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.584+0000 7f64f00a7640 1 -- 172.21.15.46:0/1747578133 wait complete. 2024-05-09T02:24:04.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:24:04.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.711+0000 7fa4e1613640 1 Processor -- start 2024-05-09T02:24:04.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.711+0000 7fa4e1613640 1 -- start start 2024-05-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4e1613640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa4dc140d40 0x7fa4dc0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4e1613640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4dc1584a0 0x7fa4dc06e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4e1613640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc06eab0 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4e1613640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fa4dc06f010 con 0x7fa4dc140d40 2024-05-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4e1613640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa4dc1588b0 con 0x7fa4dc1584a0 2024-05-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4daffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa4dc140d40 0x7fa4dc0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4daffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa4dc140d40 0x7fa4dc0c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40852/0 (socket says 172.21.15.46:40852) 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.712+0000 7fa4daffd640 1 -- 172.21.15.46:0/3974070536 learned_addr learned my addr 172.21.15.46:0/3974070536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4d3fff640 1 --2- 172.21.15.46:0/3974070536 >> v2:172.21.15.107:3300/0 conn(0x7fa4dc1584a0 0x7fa4dc06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4daffd640 1 -- 172.21.15.46:0/3974070536 >> v2:172.21.15.107:3300/0 conn(0x7fa4dc1584a0 msgr2=0x7fa4dc06e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4daffd640 1 --2- 172.21.15.46:0/3974070536 >> v2:172.21.15.107:3300/0 conn(0x7fa4dc1584a0 0x7fa4dc06e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4daffd640 1 -- 172.21.15.46:0/3974070536 >> v1:172.21.15.107:6789/0 conn(0x7fa4dc0c1e20 legacy=0x7fa4dc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4daffd640 1 -- 172.21.15.46:0/3974070536 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc06ed30 con 0x7fa4dc140d40 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4d3fff640 1 --2- 172.21.15.46:0/3974070536 >> v2:172.21.15.107:3300/0 conn(0x7fa4dc1584a0 0x7fa4dc06e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.713+0000 7fa4daffd640 1 --2- 172.21.15.46:0/3974070536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc140d40 0x7fa4dc0c8410 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0c71b0 tx=0x7fa4cc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f65a4b576bc3e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4da7fc640 1 -- 172.21.15.46:0/3974070536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc037070 con 0x7fa4dc140d40 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4da7fc640 1 -- 172.21.15.46:0/3974070536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4cc032440 con 0x7fa4dc140d40 2024-05-09T02:24:04.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4da7fc640 1 -- 172.21.15.46:0/3974070536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc032830 con 0x7fa4dc140d40 2024-05-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 -- 172.21.15.46:0/3974070536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc140d40 msgr2=0x7fa4dc0c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3974070536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc140d40 0x7fa4dc0c8410 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0c71b0 tx=0x7fa4cc02a200 comp rx=0 tx=0).stop 2024-05-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 -- 172.21.15.46:0/3974070536 shutdown_connections 2024-05-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3974070536 >> v2:172.21.15.107:3300/0 conn(0x7fa4dc1584a0 0x7fa4dc06e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3974070536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc140d40 0x7fa4dc0c8410 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 -- 172.21.15.46:0/3974070536 >> 172.21.15.46:0/3974070536 conn(0x7fa4dc068e00 msgr2=0x7fa4dc0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:04.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.714+0000 7fa4e1613640 1 -- 172.21.15.46:0/3974070536 shutdown_connections 2024-05-09T02:24:04.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.715+0000 7fa4e1613640 1 -- 172.21.15.46:0/3974070536 wait complete. 2024-05-09T02:24:04.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.716+0000 7fa4e1613640 1 Processor -- start 2024-05-09T02:24:04.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.716+0000 7fa4e1613640 1 -- start start 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4e1613640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 0x7fa4dc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4e1613640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4dc140d40 0x7fa4dc15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4e1613640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4dc1584a0 0x7fa4dc1ee150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4e1613640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc0c7ef0 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4e1613640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc0c7c10 con 0x7fa4dc1584a0 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4e1613640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc0c92f0 con 0x7fa4dc140d40 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.717+0000 7fa4daffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 0x7fa4dc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 0x7fa4dc158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40862/0 (socket says 172.21.15.46:40862) 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 -- 172.21.15.46:0/3678219717 learned_addr learned my addr 172.21.15.46:0/3678219717 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4d3fff640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4dc140d40 0x7fa4dc15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4db7fe640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4dc1584a0 0x7fa4dc1ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 -- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4dc140d40 msgr2=0x7fa4dc15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4dc140d40 0x7fa4dc15b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 -- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4dc1584a0 msgr2=0x7fa4dc1ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4dc1584a0 0x7fa4dc1ee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 -- 172.21.15.46:0/3678219717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc159860 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4db7fe640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4dc1584a0 0x7fa4dc1ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4daffd640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 0x7fa4dc158ee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc02a240 tx=0x7fa4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc037040 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4cc042070 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc159b40 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc030bf0 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.718+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1e4c80 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.719+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc1e4790 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.720+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa4cc047460 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.720+0000 7fa4d37fe640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa4bc0762d0 0x7fa4bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:04.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.720+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6291+0+0 (secure 0 0 0) 0x7fa4cc0b8540 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.721+0000 7fa4d3fff640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa4bc0762d0 0x7fa4bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:04.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.721+0000 7fa4d3fff640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa4bc0762d0 0x7fa4bc0787e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc15c010 tx=0x7fa4c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:04.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.725+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4cc032e20 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.954+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4dc06a330 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.955+0000 7fa4d37fe640 1 -- 172.21.15.46:0/3678219717 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7fa4cc081bc0 con 0x7fa4dc0c1e20 2024-05-09T02:24:04.957 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:24:04.957 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/648578566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":648578566},{"type":"v1","addr":"172.21.15.107:6837","nonce":648578566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3313737822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3313737822},{"type":"v1","addr":"172.21.15.107:6836","nonce":3313737822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/1696143452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1696143452},{"type":"v1","addr":"172.21.15.46:6833","nonce":1696143452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T02:18:22.572836+0000","modified":"2024-05-09T02:22:43.934984+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":34,"addr":"172.21.15.46:6835/236663003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":236663003},{"type":"v1","addr":"172.21.15.46:6835","nonce":236663003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-09T02:24:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 44 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa4bc0762d0 msgr2=0x7fa4bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa4bc0762d0 0x7fa4bc0787e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc15c010 tx=0x7fa4c4008040 comp rx=0 tx=0).stop 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 msgr2=0x7fa4dc158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 0x7fa4dc158ee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc02a240 tx=0x7fa4cc0046c0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 shutdown_connections 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fa4bc0762d0 0x7fa4bc0787e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4dc1584a0 0x7fa4dc1ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4dc140d40 0x7fa4dc15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 --2- 172.21.15.46:0/3678219717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4dc0c1e20 0x7fa4dc158ee0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 >> 172.21.15.46:0/3678219717 conn(0x7fa4dc068e00 msgr2=0x7fa4dc1579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 shutdown_connections 2024-05-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:04.957+0000 7fa4e1613640 1 -- 172.21.15.46:0/3678219717 wait complete. 2024-05-09T02:24:04.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T02:24:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.083+0000 7fccd8534640 1 Processor -- start 2024-05-09T02:24:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.083+0000 7fccd8534640 1 -- start start 2024-05-09T02:24:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd8534640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fccd0155160 0x7fccd00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd8534640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fccd015b3a0 0x7fccd015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd8534640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd0158ae0 con 0x7fccd00c84a0 2024-05-09T02:24:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd8534640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fccd0155570 con 0x7fccd015b3a0 2024-05-09T02:24:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd8534640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fccd0157ed0 con 0x7fccd0155160 2024-05-09T02:24:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd6ad1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fccd015b3a0 0x7fccd015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd5acf640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fccd00c84a0 0x7fccd00c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48844/0 (socket says 172.21.15.46:48844) 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd5acf640 1 -- 172.21.15.46:0/2844901140 learned_addr learned my addr 172.21.15.46:0/2844901140 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd62d0640 1 --2- 172.21.15.46:0/2844901140 >> v2:172.21.15.107:3300/0 conn(0x7fccd0155160 0x7fccd00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd6ad1640 1 -- 172.21.15.46:0/2844901140 >> v2:172.21.15.107:3300/0 conn(0x7fccd0155160 msgr2=0x7fccd00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd6ad1640 1 --2- 172.21.15.46:0/2844901140 >> v2:172.21.15.107:3300/0 conn(0x7fccd0155160 0x7fccd00c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd6ad1640 1 -- 172.21.15.46:0/2844901140 >> v1:172.21.15.46:6789/0 conn(0x7fccd00c84a0 legacy=0x7fccd00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd52ce640 1 -- 172.21.15.46:0/2844901140 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172389085 0 0) 0x7fccd0158ae0 con 0x7fccd00c84a0 2024-05-09T02:24:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.085+0000 7fccd6ad1640 1 -- 172.21.15.46:0/2844901140 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd01581b0 con 0x7fccd015b3a0 2024-05-09T02:24:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.086+0000 7fccd6ad1640 1 --2- 172.21.15.46:0/2844901140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd015b7b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fccd008e810 tx=0x7fccc002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f05a45b5d2eaf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.086+0000 7fccd52ce640 1 -- 172.21.15.46:0/2844901140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0007740 con 0x7fccd015b3a0 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.086+0000 7fccd52ce640 1 -- 172.21.15.46:0/2844901140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fccc00078e0 con 0x7fccd015b3a0 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.086+0000 7fccd52ce640 1 -- 172.21.15.46:0/2844901140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0007cd0 con 0x7fccd015b3a0 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 -- 172.21.15.46:0/2844901140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 msgr2=0x7fccd015b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 --2- 172.21.15.46:0/2844901140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd015b7b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fccd008e810 tx=0x7fccc002a560 comp rx=0 tx=0).stop 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 -- 172.21.15.46:0/2844901140 shutdown_connections 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 --2- 172.21.15.46:0/2844901140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd015b7b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 --2- 172.21.15.46:0/2844901140 >> v2:172.21.15.107:3300/0 conn(0x7fccd0155160 0x7fccd00c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 -- 172.21.15.46:0/2844901140 >> 172.21.15.46:0/2844901140 conn(0x7fccd00aebe0 msgr2=0x7fccd00aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 -- 172.21.15.46:0/2844901140 shutdown_connections 2024-05-09T02:24:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.087+0000 7fccd8534640 1 -- 172.21.15.46:0/2844901140 wait complete. 2024-05-09T02:24:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.089+0000 7fccd8534640 1 Processor -- start 2024-05-09T02:24:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.089+0000 7fccd8534640 1 -- start start 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd8534640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd00c84a0 0x7fccd00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd8534640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd0155160 0x7fccd01edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd8534640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd0151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd8534640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fccd0157b30 con 0x7fccd015b3a0 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd8534640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fccd0158770 con 0x7fccd00c84a0 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd8534640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fccd0157cb0 con 0x7fccd0155160 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd0151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd0151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40884/0 (socket says 172.21.15.46:40884) 2024-05-09T02:24:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 -- 172.21.15.46:0/410295620 learned_addr learned my addr 172.21.15.46:0/410295620 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd62d0640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd00c84a0 0x7fccd00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd5acf640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd0155160 0x7fccd01edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 -- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd0155160 msgr2=0x7fccd01edaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd0155160 0x7fccd01edaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 -- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd00c84a0 msgr2=0x7fccd00c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd00c84a0 0x7fccd00c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.090+0000 7fccd6ad1640 1 -- 172.21.15.46:0/410295620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd01520b0 con 0x7fccd015b3a0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.091+0000 7fccd6ad1640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd0151b70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fccc002a5a0 tx=0x7fccc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.091+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc003f070 con 0x7fccd015b3a0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.091+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fccc0031c40 con 0x7fccd015b3a0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.091+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd01ee340 con 0x7fccd015b3a0 2024-05-09T02:24:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.091+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0003bd0 con 0x7fccd015b3a0 2024-05-09T02:24:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.091+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd01ee900 con 0x7fccd015b3a0 2024-05-09T02:24:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.092+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd006a330 con 0x7fccd015b3a0 2024-05-09T02:24:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.093+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccc0004030 con 0x7fccd015b3a0 2024-05-09T02:24:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.093+0000 7fccceffd640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fccbc0762d0 0x7fccbc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.093+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6291+0+0 (secure 0 0 0) 0x7fccc00b8a30 con 0x7fccd015b3a0 2024-05-09T02:24:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.094+0000 7fccd62d0640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fccbc0762d0 0x7fccbc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.094+0000 7fccd62d0640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fccbc0762d0 0x7fccbc0787e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccc8006fd0 tx=0x7fccc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.098+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fccc0082170 con 0x7fccd015b3a0 2024-05-09T02:24:05.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.292+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccd01578f0 con 0x7fccd015b3a0 2024-05-09T02:24:05.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.294+0000 7fccceffd640 1 -- 172.21.15.46:0/410295620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+17520 (secure 0 0 0) 0x7fccc0081a70 con 0x7fccd015b3a0 2024-05-09T02:24:05.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T02:24:05.296 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"fsid":"fbf7bc7e-7778-49a9-881a-45aca90d45c0","created":"2024-05-09T02:17:50.093086+0000","modified":"2024-05-09T02:24:04.172134+0000","last_up_change":"2024-05-09T02:18:01.014376+0000","last_in_change":"2024-05-09T02:17:52.394989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T02:18:02.515951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-09T02:18:20.332161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-09T02:18:21.534409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb7ba6a7-0aee-4a92-a7dc-bcb80b461d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6801","nonce":738364260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6803","nonce":738364260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6807","nonce":738364260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":738364260},{"type":"v1","addr":"172.21.15.46:6805","nonce":738364260}]},"public_addr":"172.21.15.46:6801/738364260","cluster_addr":"172.21.15.46:6803/738364260","heartbeat_back_addr":"172.21.15.46:6807/738364260","heartbeat_front_addr":"172.21.15.46:6805/738364260","state":["exists","up"]},{"osd":1,"uuid":"a48a2414-1d40-4e17-b1e2-9c4a6f20d896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6811","nonce":960382158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6815","nonce":960382158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6824","nonce":960382158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":960382158},{"type":"v1","addr":"172.21.15.46:6819","nonce":960382158}]},"public_addr":"172.21.15.46:6811/960382158","cluster_addr":"172.21.15.46:6815/960382158","heartbeat_back_addr":"172.21.15.46:6824/960382158","heartbeat_front_addr":"172.21.15.46:6819/960382158","state":["exists","up"]},{"osd":2,"uuid":"8cf9110d-8da1-4d1f-a8b2-7e889235fc01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6821","nonce":2243748117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6827","nonce":2243748117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6831","nonce":2243748117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2243748117},{"type":"v1","addr":"172.21.15.46:6829","nonce":2243748117}]},"public_addr":"172.21.15.46:6821/2243748117","cluster_addr":"172.21.15.46:6827/2243748117","heartbeat_back_addr":"172.21.15.46:6831/2243748117","heartbeat_front_addr":"172.21.15.46:6829/2243748117","state":["exists","up"]},{"osd":3,"uuid":"8064c03c-129e-4631-a956-d4243b3de52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6810","nonce":2010129310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6814","nonce":2010129310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6826","nonce":2010129310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2010129310},{"type":"v1","addr":"172.21.15.46:6820","nonce":2010129310}]},"public_addr":"172.21.15.46:6810/2010129310","cluster_addr":"172.21.15.46:6814/2010129310","heartbeat_back_addr":"172.21.15.46:6826/2010129310","heartbeat_front_addr":"172.21.15.46:6820/2010129310","state":["exists","up"]},{"osd":4,"uuid":"b5c97e89-a607-4c89-b5c0-5c00e600d00a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6825","nonce":2823066883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6827","nonce":2823066883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6831","nonce":2823066883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2823066883},{"type":"v1","addr":"172.21.15.107:6829","nonce":2823066883}]},"public_addr":"172.21.15.107:6825/2823066883","cluster_addr":"172.21.15.107:6827/2823066883","heartbeat_back_addr":"172.21.15.107:6831/2823066883","heartbeat_front_addr":"172.21.15.107:6829/2823066883","state":["exists","up"]},{"osd":5,"uuid":"8630b698-09f3-4bbf-ab11-bacfa6d25a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6817","nonce":278179118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6819","nonce":278179118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6823","nonce":278179118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":278179118},{"type":"v1","addr":"172.21.15.107:6821","nonce":278179118}]},"public_addr":"172.21.15.107:6817/278179118","cluster_addr":"172.21.15.107:6819/278179118","heartbeat_back_addr":"172.21.15.107:6823/278179118","heartbeat_front_addr":"172.21.15.107:6821/278179118","state":["exists","up"]},{"osd":6,"uuid":"f3693cfb-a968-4cf1-a914-c95e51e7eca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6809","nonce":425658714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6811","nonce":425658714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6815","nonce":425658714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":425658714},{"type":"v1","addr":"172.21.15.107:6813","nonce":425658714}]},"public_addr":"172.21.15.107:6809/425658714","cluster_addr":"172.21.15.107:6811/425658714","heartbeat_back_addr":"172.21.15.107:6815/425658714","heartbeat_front_addr":"172.21.15.107:6813/425658714","state":["exists","up"]},{"osd":7,"uuid":"a4088852-f89d-4b4e-bd35-2bae9d95a537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6801","nonce":3874977895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6803","nonce":3874977895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6807","nonce":3874977895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3874977895},{"type":"v1","addr":"172.21.15.107:6805","nonce":3874977895}]},"public_addr":"172.21.15.107:6801/3874977895","cluster_addr":"172.21.15.107:6803/3874977895","heartbeat_back_addr":"172.21.15.107:6807/3874977895","heartbeat_front_addr":"172.21.15.107:6805/3874977895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.532767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.615883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.528297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.587064+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.566430+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.533260+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.603769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T02:17:57.594657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6833/3541939604":"2024-05-10T02:24:00.972164+0000","172.21.15.107:6835/16654146":"2024-05-10T02:19:04.887047+0000","172.21.15.107:6837/16654146":"2024-05-10T02:19:04.887047+0000","172.21.15.107:6836/1968918469":"2024-05-10T02:22:53.964723+0000","172.21.15.46:6833/268323982":"2024-05-10T02:19:54.895024+0000","172.21.15.107:6837/3709209674":"2024-05-10T02:20:29.900468+0000","172.21.15.46:6832/3541939604":"2024-05-10T02:24:00.972164+0000","172.21.15.46:6834/687229870":"2024-05-10T02:20:29.906793+0000","172.21.15.46:6835/687229870":"2024-05-10T02:20:29.906793+0000","172.21.15.107:6835/3709209674":"2024-05-10T02:20:29.900468+0000","172.21.15.46:6833/3794663718":"2024-05-10T02:22:39.920164+0000","172.21.15.46:6832/268323982":"2024-05-10T02:19:54.895024+0000","172.21.15.46:6832/3794663718":"2024-05-10T02:22:39.920164+0000","172.21.15.107:6834/1968918469":"2024-05-10T02:22:53.964723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T02:24:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fccbc0762d0 msgr2=0x7fccbc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fccbc0762d0 0x7fccbc0787e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccc8006fd0 tx=0x7fccc8008040 comp rx=0 tx=0).stop 2024-05-09T02:24:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 msgr2=0x7fccd0151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd0151b70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fccc002a5a0 tx=0x7fccc0004a40 comp rx=0 tx=0).stop 2024-05-09T02:24:05.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 shutdown_connections 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7fccbc0762d0 0x7fccbc0787e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccd015b3a0 0x7fccd0151b70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd0155160 0x7fccd01edaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 --2- 172.21.15.46:0/410295620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd00c84a0 0x7fccd00c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 >> 172.21.15.46:0/410295620 conn(0x7fccd00aebe0 msgr2=0x7fccd015b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 shutdown_connections 2024-05-09T02:24:05.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.296+0000 7fccd8534640 1 -- 172.21.15.46:0/410295620 wait complete. 2024-05-09T02:24:05.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-05-09T02:24:05.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.423+0000 7f14740a8640 1 Processor -- start 2024-05-09T02:24:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.423+0000 7f14740a8640 1 -- start start 2024-05-09T02:24:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.424+0000 7f14740a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 0x7f146c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.424+0000 7f14740a8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c06ecc0 con 0x7f146c06e8b0 2024-05-09T02:24:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.424+0000 7f14740a8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c158820 con 0x7f146c06e4a0 2024-05-09T02:24:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.424+0000 7f14740a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f146c0c1e30 con 0x7f146c0b1890 2024-05-09T02:24:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1472645640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f146c06e8b0 0x7f146c0c3270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48860/0 (socket says 172.21.15.46:48860) 2024-05-09T02:24:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1472645640 1 -- 172.21.15.46:0/3549067990 learned_addr learned my addr 172.21.15.46:0/3549067990 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1471e44640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 0x7f146c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356132564 0 0) 0x7f146c06ecc0 con 0x7f146c06e8b0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1458003520 con 0x7f146c06e8b0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664599346 0 0) 0x7f146c158820 con 0x7f146c06e4a0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f146c06ecc0 con 0x7f146c06e4a0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3095215945 0 0) 0x7f1458003520 con 0x7f146c06e8b0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 msgr2=0x7f146c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 0x7f146c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 >> v1:172.21.15.107:6789/0 conn(0x7f146c06e4a0 legacy=0x7f146c0c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c0c2080 con 0x7f146c06e8b0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1442982082 0 0) 0x7f1464001a70 con 0x7f146c06e8b0 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 >> v1:172.21.15.46:6789/0 conn(0x7f146c06e8b0 legacy=0x7f146c0c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 0x7f1458003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14580041c0 0x7f1458004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1458004e00 0x7f14580052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0c1e30 con 0x7f1458004e00 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f145800bd60 con 0x7f14580041c0 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f145800bf60 con 0x7f146c0b1890 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1472645640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1458004e00 0x7f14580052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1471e44640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 0x7f1458003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.425+0000 7f1471643640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14580041c0 0x7f1458004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.426+0000 7f1472645640 1 -- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 msgr2=0x7f1458003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.426+0000 7f1472645640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f146c0b1890 0x7f1458003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.426+0000 7f1472645640 1 -- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14580041c0 msgr2=0x7f1458004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.426+0000 7f1472645640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14580041c0 0x7f1458004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.426+0000 7f1472645640 1 -- 172.21.15.46:0/3549067990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1458003520 con 0x7f1458004e00 2024-05-09T02:24:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.426+0000 7f1472645640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1458004e00 0x7f14580052d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f146400a7c0 tx=0x7f1458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1d8253043a91b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146400a410 con 0x7f1458004e00 2024-05-09T02:24:05.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f146402f070 con 0x7f1458004e00 2024-05-09T02:24:05.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f1470e42640 1 -- 172.21.15.46:0/3549067990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146402bb50 con 0x7f1458004e00 2024-05-09T02:24:05.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f14740a8640 1 -- 172.21.15.46:0/3549067990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1458004e00 msgr2=0x7f14580052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f14740a8640 1 --2- 172.21.15.46:0/3549067990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1458004e00 0x7f14580052d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f146400a7c0 tx=0x7f1458005830 comp rx=0 tx=0).stop 2024-05-09T02:24:05.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f1472645640 1 -- 172.21.15.46:0/3549067990 reap_dead start 2024-05-09T02:24:05.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f14740a8640 1 -- 172.21.15.46:0/3549067990 shutdown_connections 2024-05-09T02:24:05.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f14740a8640 1 -- 172.21.15.46:0/3549067990 >> 172.21.15.46:0/3549067990 conn(0x7f146c068e90 msgr2=0x7f146c0cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f14740a8640 1 -- 172.21.15.46:0/3549067990 shutdown_connections 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.427+0000 7f14740a8640 1 -- 172.21.15.46:0/3549067990 wait complete. 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.429+0000 7f14740a8640 1 Processor -- start 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.429+0000 7f14740a8640 1 -- start start 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.430+0000 7f14740a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1458004e00 0x7f146c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.430+0000 7f14740a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f146c0caba0 0x7f146c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.430+0000 7f14740a8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 0x7f146c1e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.430+0000 7f14740a8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0b1ca0 con 0x7f146c0cbba0 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.430+0000 7f14740a8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0c2640 con 0x7f146c0caba0 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.430+0000 7f14740a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f146c0b2190 con 0x7f1458004e00 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 0x7f146c1e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 0x7f146c1e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40900/0 (socket says 172.21.15.46:40900) 2024-05-09T02:24:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 -- 172.21.15.46:0/3264123051 learned_addr learned my addr 172.21.15.46:0/3264123051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1471e44640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1458004e00 0x7f146c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1471643640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f146c0caba0 0x7f146c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 -- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1458004e00 msgr2=0x7f146c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1458004e00 0x7f146c0cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 -- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f146c0caba0 msgr2=0x7f146c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f146c0caba0 0x7f146c0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 -- 172.21.15.46:0/3264123051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c1e17f0 con 0x7f146c0cbba0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1471e44640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1458004e00 0x7f146c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f1472645640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 0x7f146c1e32e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f146400a7c0 tx=0x7f146c0c2250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146400a410 con 0x7f146c0cbba0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f146402b920 con 0x7f146c0cbba0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146402bcd0 con 0x7f146c0cbba0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c1ee370 con 0x7f146c0cbba0 2024-05-09T02:24:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.431+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c1e0dd0 con 0x7f146c0cbba0 2024-05-09T02:24:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.432+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146c06a330 con 0x7f146c0cbba0 2024-05-09T02:24:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.433+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1464034470 con 0x7f146c0cbba0 2024-05-09T02:24:05.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.434+0000 7f14627fc640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14500762d0 0x7f14500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.434+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6291+0+0 (secure 0 0 0) 0x7f14640b74b0 con 0x7f146c0cbba0 2024-05-09T02:24:05.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.434+0000 7f1471e44640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14500762d0 0x7f14500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.434+0000 7f1471e44640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14500762d0 0x7f14500787e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f146c0c4c80 tx=0x7f1468008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.438+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1464080bc0 con 0x7f146c0cbba0 2024-05-09T02:24:05.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.673+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f146c0c8250 con 0x7f146c0cbba0 2024-05-09T02:24:05.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.675+0000 7f14627fc640 1 -- 172.21.15.46:0/3264123051 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 151+0+0 (secure 0 0 0) 0x7f14640804c0 con 0x7f146c0cbba0 2024-05-09T02:24:05.677 INFO:teuthology.orchestra.run.smithi046.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T02:24:05.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.678+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14500762d0 msgr2=0x7f14500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.678+0000 7f14740a8640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14500762d0 0x7f14500787e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f146c0c4c80 tx=0x7f1468008040 comp rx=0 tx=0).stop 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.678+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 msgr2=0x7f146c1e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.678+0000 7f14740a8640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 0x7f146c1e32e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f146400a7c0 tx=0x7f146c0c2250 comp rx=0 tx=0).stop 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 shutdown_connections 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f14500762d0 0x7f14500787e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f146c0cbba0 0x7f146c1e32e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f146c0caba0 0x7f146c0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 --2- 172.21.15.46:0/3264123051 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1458004e00 0x7f146c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 >> 172.21.15.46:0/3264123051 conn(0x7f146c068e90 msgr2=0x7f146c150170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 shutdown_connections 2024-05-09T02:24:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.679+0000 7f14740a8640 1 -- 172.21.15.46:0/3264123051 wait complete. 2024-05-09T02:24:05.689 INFO:tasks.ceph.mds.a.smithi046.stderr: -4115> 2024-05-09T02:22:45.957+0000 7f6e2e339640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T02:24:05.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-05-09T02:24:05.746 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-05-09T02:24:05.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.811+0000 7f9c79269640 1 Processor -- start 2024-05-09T02:24:05.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.811+0000 7f9c79269640 1 -- start start 2024-05-09T02:24:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c79269640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740c3ef0 0x7f9c74158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c79269640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c741521e0 con 0x7f9c74151dd0 2024-05-09T02:24:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c79269640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c74074c60 con 0x7f9c740aef30 2024-05-09T02:24:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c79269640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c74074730 con 0x7f9c740c3ef0 2024-05-09T02:24:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c737fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9c74151dd0 0x7f9c7406d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48878/0 (socket says 172.21.15.46:48878) 2024-05-09T02:24:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c737fe640 1 -- 172.21.15.46:0/2067328838 learned_addr learned my addr 172.21.15.46:0/2067328838 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c727fc640 1 --2- 172.21.15.46:0/2067328838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740c3ef0 0x7f9c74158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267294142 0 0) 0x7f9c741521e0 con 0x7f9c74151dd0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.812+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c5c003520 con 0x7f9c74151dd0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298183081 0 0) 0x7f9c74074c60 con 0x7f9c740aef30 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c741521e0 con 0x7f9c740aef30 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c727fc640 1 -- 172.21.15.46:0/2067328838 >> v1:172.21.15.107:6789/0 conn(0x7f9c740aef30 legacy=0x7f9c74154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c727fc640 1 -- 172.21.15.46:0/2067328838 >> v1:172.21.15.46:6789/0 conn(0x7f9c74151dd0 legacy=0x7f9c7406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3005504511 0 0) 0x7f9c5c003520 con 0x7f9c74151dd0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c727fc640 1 -- 172.21.15.46:0/2067328838 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c74074980 con 0x7f9c740c3ef0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.813+0000 7f9c727fc640 1 --2- 172.21.15.46:0/2067328838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740c3ef0 0x7f9c74158900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009dc0 tx=0x7f9c6802a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b5818ce7c35426 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0016f0 con 0x7f9c740c3ef0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c68007540 con 0x7f9c740c3ef0 2024-05-09T02:24:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c71ffb640 1 -- 172.21.15.46:0/2067328838 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c680078f0 con 0x7f9c740c3ef0 2024-05-09T02:24:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 -- 172.21.15.46:0/2067328838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740c3ef0 msgr2=0x7f9c74158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 --2- 172.21.15.46:0/2067328838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740c3ef0 0x7f9c74158900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009dc0 tx=0x7f9c6802a540 comp rx=0 tx=0).stop 2024-05-09T02:24:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 -- 172.21.15.46:0/2067328838 shutdown_connections 2024-05-09T02:24:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 --2- 172.21.15.46:0/2067328838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740c3ef0 0x7f9c74158900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 -- 172.21.15.46:0/2067328838 >> 172.21.15.46:0/2067328838 conn(0x7f9c740c9e50 msgr2=0x7f9c740ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:05.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 -- 172.21.15.46:0/2067328838 shutdown_connections 2024-05-09T02:24:05.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.814+0000 7f9c79269640 1 -- 172.21.15.46:0/2067328838 wait complete. 2024-05-09T02:24:05.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.816+0000 7f9c79269640 1 Processor -- start 2024-05-09T02:24:05.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.816+0000 7f9c79269640 1 -- start start 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.817+0000 7f9c79269640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740aef30 0x7f9c7414e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.817+0000 7f9c79269640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 0x7f9c741eb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.817+0000 7f9c79269640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c74151dd0 0x7f9c741483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.817+0000 7f9c79269640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9c74158100 con 0x7f9c740c3ef0 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.817+0000 7f9c79269640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740acef0 con 0x7f9c74151dd0 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.817+0000 7f9c79269640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c741583e0 con 0x7f9c740aef30 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 0x7f9c741eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 0x7f9c741eb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40912/0 (socket says 172.21.15.46:40912) 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 -- 172.21.15.46:0/2023030627 learned_addr learned my addr 172.21.15.46:0/2023030627 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c737fe640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c74151dd0 0x7f9c741483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c72ffd640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740aef30 0x7f9c7414e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 -- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740aef30 msgr2=0x7f9c7414e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740aef30 0x7f9c7414e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 -- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c74151dd0 msgr2=0x7f9c741483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c74151dd0 0x7f9c741483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 -- 172.21.15.46:0/2023030627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c741ef9f0 con 0x7f9c740c3ef0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c727fc640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 0x7f9c741eb990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009ee0 tx=0x7f9c68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6803f070 con 0x7f9c740c3ef0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c68031c40 con 0x7f9c740c3ef0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c74154a10 con 0x7f9c740c3ef0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68009450 con 0x7f9c740c3ef0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.818+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c741ec3f0 con 0x7f9c740c3ef0 2024-05-09T02:24:05.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.819+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c7406e8b0 con 0x7f9c740c3ef0 2024-05-09T02:24:05.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.820+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c6803b410 con 0x7f9c740c3ef0 2024-05-09T02:24:05.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.821+0000 7f9c5b7fe640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c600762d0 0x7f9c600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:05.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.821+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6377+0+0 (secure 0 0 0) 0x7f9c680b8c10 con 0x7f9c740c3ef0 2024-05-09T02:24:05.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.821+0000 7f9c72ffd640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c600762d0 0x7f9c600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:05.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.821+0000 7f9c72ffd640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c600762d0 0x7f9c600787e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9c64001120 tx=0x7f9c64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:05.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:05.825+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c68081c80 con 0x7f9c740c3ef0 2024-05-09T02:24:06.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.054+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7f9c7406a330 con 0x7f9c740c3ef0 2024-05-09T02:24:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.677+0000 7f9c5b7fe640 1 -- 172.21.15.46:0/2023030627 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v46) ==== 99+0+0 (secure 0 0 0) 0x7f9c68085f80 con 0x7f9c740c3ef0 2024-05-09T02:24:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c600762d0 msgr2=0x7f9c600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c600762d0 0x7f9c600787e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9c64001120 tx=0x7f9c64009040 comp rx=0 tx=0).stop 2024-05-09T02:24:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 msgr2=0x7f9c741eb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 0x7f9c741eb990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009ee0 tx=0x7f9c68004a40 comp rx=0 tx=0).stop 2024-05-09T02:24:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 shutdown_connections 2024-05-09T02:24:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f9c600762d0 0x7f9c600787e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c74151dd0 0x7f9c741483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c740c3ef0 0x7f9c741eb990 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 --2- 172.21.15.46:0/2023030627 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c740aef30 0x7f9c7414e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 >> 172.21.15.46:0/2023030627 conn(0x7f9c740c9e50 msgr2=0x7f9c74075db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 shutdown_connections 2024-05-09T02:24:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.680+0000 7f9c79269640 1 -- 172.21.15.46:0/2023030627 wait complete. 2024-05-09T02:24:06.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-05-09T02:24:06.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.819+0000 7f07ccd9f640 1 Processor -- start 2024-05-09T02:24:06.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.819+0000 7f07ccd9f640 1 -- start start 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07ccd9f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07c8155040 0x7f07c80cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07ccd9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07ccd9f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c8157bb0 con 0x7f07c80c76e0 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07ccd9f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f07c80cbec0 con 0x7f07c8155040 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07ccd9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f07c8157e50 con 0x7f07c806ddb0 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c6ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07c8155040 0x7f07c80cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c77fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f07c80c76e0 0x7f07c80cb270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59816/0 (socket says 172.21.15.46:59816) 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c77fe640 1 -- 172.21.15.46:0/1669811620 learned_addr learned my addr 172.21.15.46:0/1669811620 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c7fff640 1 --2- 172.21.15.46:0/1669811620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c6ffd640 1 -- 172.21.15.46:0/1669811620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 msgr2=0x7f07c806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c6ffd640 1 --2- 172.21.15.46:0/1669811620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c6ffd640 1 -- 172.21.15.46:0/1669811620 >> v1:172.21.15.46:6789/0 conn(0x7f07c80c76e0 legacy=0x7f07c80cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c6ffd640 1 -- 172.21.15.46:0/1669811620 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c8158130 con 0x7f07c8155040 2024-05-09T02:24:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.821+0000 7f07c67fc640 1 -- 172.21.15.46:0/1669811620 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454668520 0 0) 0x7f07c8157bb0 con 0x7f07c80c76e0 2024-05-09T02:24:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.822+0000 7f07c6ffd640 1 --2- 172.21.15.46:0/1669811620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c80cb980 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0097a0 tx=0x7f07bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55699086b57a3a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.822+0000 7f07c67fc640 1 -- 172.21.15.46:0/1669811620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc037070 con 0x7f07c8155040 2024-05-09T02:24:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.822+0000 7f07c67fc640 1 -- 172.21.15.46:0/1669811620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f07bc032440 con 0x7f07c8155040 2024-05-09T02:24:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.822+0000 7f07c67fc640 1 -- 172.21.15.46:0/1669811620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc032830 con 0x7f07c8155040 2024-05-09T02:24:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 -- 172.21.15.46:0/1669811620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 msgr2=0x7f07c80cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/1669811620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c80cb980 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0097a0 tx=0x7f07bc02a180 comp rx=0 tx=0).stop 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 -- 172.21.15.46:0/1669811620 shutdown_connections 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/1669811620 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/1669811620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c80cb980 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 -- 172.21.15.46:0/1669811620 >> 172.21.15.46:0/1669811620 conn(0x7f07c80ccd60 msgr2=0x7f07c80cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 -- 172.21.15.46:0/1669811620 shutdown_connections 2024-05-09T02:24:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.823+0000 7f07ccd9f640 1 -- 172.21.15.46:0/1669811620 wait complete. 2024-05-09T02:24:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.825+0000 7f07ccd9f640 1 Processor -- start 2024-05-09T02:24:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.825+0000 7f07ccd9f640 1 -- start start 2024-05-09T02:24:06.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07ccd9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:06.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07ccd9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c80c76e0 0x7f07c81f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:06.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07ccd9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c8148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07ccd9f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f07c808e130 con 0x7f07c8155040 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07ccd9f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8155450 con 0x7f07c80c76e0 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07ccd9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f07c808e2b0 con 0x7f07c806ddb0 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c8148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c8148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59176/0 (socket says 172.21.15.46:59176) 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 -- 172.21.15.46:0/814980931 learned_addr learned my addr 172.21.15.46:0/814980931 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c77fe640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c6ffd640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c80c76e0 0x7f07c81f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 -- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 msgr2=0x7f07c814dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c814dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 -- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c80c76e0 msgr2=0x7f07c81f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c80c76e0 0x7f07c81f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c7fff640 1 -- 172.21.15.46:0/814980931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c81f18e0 con 0x7f07c8155040 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.826+0000 7f07c6ffd640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c80c76e0 0x7f07c81f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.827+0000 7f07c7fff640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c8148140 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f07c0007e60 tx=0x7f07c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.827+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0014420 con 0x7f07c8155040 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.827+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f07c0019070 con 0x7f07c8155040 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.827+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0014840 con 0x7f07c8155040 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.827+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c815a8f0 con 0x7f07c8155040 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.827+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c815aeb0 con 0x7f07c8155040 2024-05-09T02:24:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.828+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c80ad000 con 0x7f07c8155040 2024-05-09T02:24:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.829+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07c00149e0 con 0x7f07c8155040 2024-05-09T02:24:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.829+0000 7f07affff640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f07b40762d0 0x7f07b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.829+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6377+0+0 (secure 0 0 0) 0x7f07c00981e0 con 0x7f07c8155040 2024-05-09T02:24:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.830+0000 7f07c77fe640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f07b40762d0 0x7f07b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.830+0000 7f07c77fe640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f07b40762d0 0x7f07b40787e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000f60 tx=0x7f07b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:06.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:06.834+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f07c80ad000 con 0x7f07c8155040 2024-05-09T02:24:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.029+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f07c806a330 con 0x7f07c8155040 2024-05-09T02:24:07.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.678+0000 7f07affff640 1 -- 172.21.15.46:0/814980931 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v38) ==== 166+0+0 (secure 0 0 0) 0x7f07c0061810 con 0x7f07c8155040 2024-05-09T02:24:07.681 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'b_metadata' removed 2024-05-09T02:24:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.681+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f07b40762d0 msgr2=0x7f07b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.681+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f07b40762d0 0x7f07b40787e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000f60 tx=0x7f07b8009040 comp rx=0 tx=0).stop 2024-05-09T02:24:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.681+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 msgr2=0x7f07c8148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.681+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c8148140 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f07c0007e60 tx=0x7f07c000e4b0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 shutdown_connections 2024-05-09T02:24:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f07b40762d0 0x7f07b40787e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07c8155040 0x7f07c8148140 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07c80c76e0 0x7f07c81f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 --2- 172.21.15.46:0/814980931 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f07c806ddb0 0x7f07c814dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 >> 172.21.15.46:0/814980931 conn(0x7f07c80ccd60 msgr2=0x7f07c8154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:07.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 shutdown_connections 2024-05-09T02:24:07.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.682+0000 7f07ccd9f640 1 -- 172.21.15.46:0/814980931 wait complete. 2024-05-09T02:24:07.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-05-09T02:24:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.826+0000 7f455d043640 1 Processor -- start 2024-05-09T02:24:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.826+0000 7f455d043640 1 -- start start 2024-05-09T02:24:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.827+0000 7f455d043640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45580c5fc0 0x7f45580b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.827+0000 7f455d043640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f45581590c0 0x7f45581594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.827+0000 7f455d043640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580c92b0 con 0x7f45581565b0 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.827+0000 7f455d043640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f45580c9590 con 0x7f45580c5fc0 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.827+0000 7f455d043640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f45580c9870 con 0x7f45581590c0 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f4556d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45580c5fc0 0x7f45580b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f455659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f45581565b0 0x7f45580ace20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59824/0 (socket says 172.21.15.46:59824) 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f455659c640 1 -- 172.21.15.46:0/1927021149 learned_addr learned my addr 172.21.15.46:0/1927021149 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f455759e640 1 --2- 172.21.15.46:0/1927021149 >> v2:172.21.15.107:3300/0 conn(0x7f45581590c0 0x7f45581594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f4556d9d640 1 -- 172.21.15.46:0/1927021149 >> v2:172.21.15.107:3300/0 conn(0x7f45581590c0 msgr2=0x7f45581594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f4556d9d640 1 --2- 172.21.15.46:0/1927021149 >> v2:172.21.15.107:3300/0 conn(0x7f45581590c0 0x7f45581594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f4556d9d640 1 -- 172.21.15.46:0/1927021149 >> v1:172.21.15.46:6789/0 conn(0x7f45581565b0 legacy=0x7f45580ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:07.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f4556d9d640 1 -- 172.21.15.46:0/1927021149 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580c9b50 con 0x7f45580c5fc0 2024-05-09T02:24:07.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.828+0000 7f4555d9b640 1 -- 172.21.15.46:0/1927021149 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190166152 0 0) 0x7f45580c92b0 con 0x7f45581565b0 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.829+0000 7f4556d9d640 1 --2- 172.21.15.46:0/1927021149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45580c5fc0 0x7f45580b0620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45580adec0 tx=0x7f454802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a89cd0b8fcaa91 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.829+0000 7f4555d9b640 1 -- 172.21.15.46:0/1927021149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548007740 con 0x7f45580c5fc0 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.829+0000 7f4555d9b640 1 -- 172.21.15.46:0/1927021149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45480078e0 con 0x7f45580c5fc0 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.829+0000 7f4555d9b640 1 -- 172.21.15.46:0/1927021149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548007cd0 con 0x7f45580c5fc0 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 -- 172.21.15.46:0/1927021149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45580c5fc0 msgr2=0x7f45580b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 --2- 172.21.15.46:0/1927021149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45580c5fc0 0x7f45580b0620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45580adec0 tx=0x7f454802a560 comp rx=0 tx=0).stop 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 -- 172.21.15.46:0/1927021149 shutdown_connections 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 --2- 172.21.15.46:0/1927021149 >> v2:172.21.15.107:3300/0 conn(0x7f45581590c0 0x7f45581594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 --2- 172.21.15.46:0/1927021149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45580c5fc0 0x7f45580b0620 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 -- 172.21.15.46:0/1927021149 >> 172.21.15.46:0/1927021149 conn(0x7f45580caf30 msgr2=0x7f45580cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:07.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 -- 172.21.15.46:0/1927021149 shutdown_connections 2024-05-09T02:24:07.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.830+0000 7f455d043640 1 -- 172.21.15.46:0/1927021149 wait complete. 2024-05-09T02:24:07.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.832+0000 7f455d043640 1 Processor -- start 2024-05-09T02:24:07.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.832+0000 7f455d043640 1 -- start start 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455d043640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45580c5fc0 0x7f45580bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455d043640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 0x7f45580b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455d043640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45581590c0 0x7f4558151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455d043640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f45581569c0 con 0x7f45581565b0 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455d043640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f45580c7470 con 0x7f45580c5fc0 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455d043640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f45580ad530 con 0x7f45581590c0 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 0x7f45580b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 0x7f45580b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59192/0 (socket says 172.21.15.46:59192) 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 -- 172.21.15.46:0/1407841935 learned_addr learned my addr 172.21.15.46:0/1407841935 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T02:24:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f4556d9d640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45580c5fc0 0x7f45580bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455759e640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45581590c0 0x7f4558151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 -- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45581590c0 msgr2=0x7f4558151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45581590c0 0x7f4558151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 -- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45580c5fc0 msgr2=0x7f45580bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45580c5fc0 0x7f45580bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.833+0000 7f455659c640 1 -- 172.21.15.46:0/1407841935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45581e0200 con 0x7f45581565b0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.834+0000 7f455659c640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 0x7f45580b00d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f454000c3f0 tx=0x7f454000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.834+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45400074e0 con 0x7f45581565b0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.834+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45400047e0 con 0x7f45581565b0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.834+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4558151fe0 con 0x7f45581565b0 2024-05-09T02:24:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.834+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4540004bf0 con 0x7f45581565b0 2024-05-09T02:24:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.834+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45581e11a0 con 0x7f45581565b0 2024-05-09T02:24:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.835+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455806a3a0 con 0x7f45581565b0 2024-05-09T02:24:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.836+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4540011070 con 0x7f45581565b0 2024-05-09T02:24:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.836+0000 7f454f7fe640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4538076300 0x7f4538078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T02:24:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.836+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5949+0+0 (secure 0 0 0) 0x7f45400972f0 con 0x7f45581565b0 2024-05-09T02:24:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.836+0000 7f4556d9d640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4538076300 0x7f4538078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T02:24:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.837+0000 7f4556d9d640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4538076300 0x7f4538078810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T02:24:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:07.841+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45581e0200 con 0x7f45581565b0 2024-05-09T02:24:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.032+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45580c8f60 con 0x7f45581565b0 2024-05-09T02:24:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.696+0000 7f454f7fe640 1 -- 172.21.15.46:0/1407841935 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v39) ==== 154+0+0 (secure 0 0 0) 0x7f4540060360 con 0x7f45581565b0 2024-05-09T02:24:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'b_data' removed 2024-05-09T02:24:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.701+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4538076300 msgr2=0x7f4538078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.701+0000 7f455d043640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4538076300 0x7f4538078810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802f000 comp rx=0 tx=0).stop 2024-05-09T02:24:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.701+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 msgr2=0x7f45580b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T02:24:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.701+0000 7f455d043640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 0x7f45580b00d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f454000c3f0 tx=0x7f454000c8b0 comp rx=0 tx=0).stop 2024-05-09T02:24:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.702+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 shutdown_connections 2024-05-09T02:24:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.702+0000 7f455d043640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:6832/2302910508,v1:172.21.15.107:6833/2302910508] conn(0x7f4538076300 0x7f4538078810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.702+0000 7f455d043640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45581590c0 0x7f4558151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.702+0000 7f455d043640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45581565b0 0x7f45580b00d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.702+0000 7f455d043640 1 --2- 172.21.15.46:0/1407841935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45580c5fc0 0x7f45580bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T02:24:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.702+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 >> 172.21.15.46:0/1407841935 conn(0x7f45580caf30 msgr2=0x7f4558153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T02:24:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.705+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 shutdown_connections 2024-05-09T02:24:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T02:24:08.706+0000 7f455d043640 1 -- 172.21.15.46:0/1407841935 wait complete. 2024-05-09T02:24:08.728 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T02:24:08.728 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T02:24:08.728 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:08.743 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T02:24:08.743 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T02:24:08.743 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:08.798 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T02:24:08.798 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T02:24:08.798 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:08.809 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T02:24:08.809 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T02:24:08.809 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:08.861 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T02:24:08.861 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T02:24:08.861 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T02:24:08.861 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:08.900 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T02:24:08.901 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T02:24:08.901 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:08.974 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T02:24:08.975 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T02:24:08.975 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.049 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T02:24:09.049 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T02:24:09.049 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.122 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T02:24:09.123 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T02:24:09.123 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.166 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T02:24:09.167 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T02:24:09.167 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.210 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T02:24:09.210 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T02:24:09.210 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.250 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T02:24:09.250 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T02:24:09.250 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.325 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T02:24:09.325 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T02:24:09.325 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T02:24:09.325 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.355 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T02:24:09.355 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T02:24:09.355 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.394 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T02:24:09.394 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T02:24:09.395 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T02:24:09.395 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.410 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T02:24:09.410 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T02:24:09.410 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.446 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T02:24:09.446 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T02:24:09.446 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-09T02:24:09.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-09T02:24:09.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-09T02:24:09.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-09T02:24:09.499 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T02:24:09.499 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T02:24:09.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | head -n 1 2024-05-09T02:24:09.566 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:24:09.566 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T02:24:09.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:24:09.874 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T02:24:10.004 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:24:10.004 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T02:24:10.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:24:10.070 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T02:24:10.128 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:24:10.129 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T02:24:10.393 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:24:10.393 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T02:24:10.490 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:24:10.490 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T02:24:10.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:24:10.554 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T02:24:10.614 INFO:tasks.ceph:Archiving mon data... 2024-05-09T02:24:10.615 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/data/mon.a.tgz 2024-05-09T02:24:10.615 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-05-09T02:24:10.635 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.JmfNBfoUPw 2024-05-09T02:24:10.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JmfNBfoUPw 2024-05-09T02:24:10.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.JmfNBfoUPw 2024-05-09T02:24:10.880 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.JmfNBfoUPw is 399KB 2024-05-09T02:24:10.976 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.JmfNBfoUPw 2024-05-09T02:24:10.992 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/data/mon.b.tgz 2024-05-09T02:24:10.992 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-09T02:24:11.009 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.xJUZe0oKk1 2024-05-09T02:24:11.009 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xJUZe0oKk1 2024-05-09T02:24:11.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.xJUZe0oKk1 2024-05-09T02:24:11.278 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.xJUZe0oKk1 is 531KB 2024-05-09T02:24:11.378 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.xJUZe0oKk1 2024-05-09T02:24:11.396 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/data/mon.c.tgz 2024-05-09T02:24:11.396 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-09T02:24:11.450 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.zRipxT8ATI 2024-05-09T02:24:11.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zRipxT8ATI 2024-05-09T02:24:11.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.zRipxT8ATI 2024-05-09T02:24:11.701 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.zRipxT8ATI is 531KB 2024-05-09T02:24:11.799 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.zRipxT8ATI 2024-05-09T02:24:11.814 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T02:24:11.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T02:24:11.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T02:24:11.905 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T02:24:11.933 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T02:24:11.934 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T02:24:11.935 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/remote/smithi046/crash 2024-05-09T02:24:11.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T02:24:11.976 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/remote/smithi107/crash 2024-05-09T02:24:11.976 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T02:24:12.000 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T02:24:12.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:24:12.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T02:24:12.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T02:24:12.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T02:24:12.147 INFO:tasks.ceph:Compressing logs... 2024-05-09T02:24:12.147 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T02:24:12.154 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T02:24:12.179 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2024-05-09T02:24:12.179 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36040.log 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36040.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36040.log.gz 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36120.log 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.36120.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36120.log.gz 2024-05-09T02:24:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36080.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36080.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.4.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36080.log.gz 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35869.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.35869.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35869.log.gz 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35909.log 2024-05-09T02:24:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41829.log 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35909.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35909.log.gz 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.41829.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36160.log 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35949.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36160.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36160.log.gz 2024-05-09T02:24:12.240 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T02:24:12.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51115.log 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47342.log 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46964.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51115.log.gz 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47612.log 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47612.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47342.log.gz 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50096.log 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47612.log.gz 2024-05-09T02:24:12.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50348.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50096.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48875.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43601.log: /var/log/ceph/ceph-client.admin.50348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49928.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50348.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48875.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50844.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43842.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49928.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2024-05-09T02:24:12.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49387.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50844.log.gz 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48403.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48814.log: /var/log/ceph/ceph-client.admin.49387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45164.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48403.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49387.log.gz 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48601.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48403.log.gz 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47214.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48601.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45164.log.gz 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48601.log.gz 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48989.log 2024-05-09T02:24:12.247 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47214.log.gz 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48989.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48989.log.gz 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46566.log 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz/var/log/ceph/ceph-client.admin.46566.log: 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46566.log.gz 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2024-05-09T02:24:12.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48529.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48529.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48529.log.gz/var/log/ceph/ceph-client.admin.50474.log: 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49676.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2024-05-09T02:24:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49676.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48156.log 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49326.log: /var/log/ceph/ceph-client.admin.49268.log 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42925.log 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49268.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48156.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41707.log 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49268.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47298.log 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41707.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42925.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50264.log 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41707.log.gz 2024-05-09T02:24:12.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51218.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50264.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47298.log.gz 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50264.log.gz 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49634.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51218.log: /var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51218.log.gz 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49148.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43800.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49634.log.gz 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42284.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49148.log.gz 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44816.log 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42284.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43800.log.gz 2024-05-09T02:24:12.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50534.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42284.log.gz 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.44816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50534.log.gz 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50594.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46734.log: /var/log/ceph/ceph-client.admin.45798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42923.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T02:24:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42750.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50594.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42923.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42923.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.50054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51157.log 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44920.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45248.log 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49050.log 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51157.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45248.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45248.log.gz 2024-05-09T02:24:12.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49050.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46608.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50180.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41893.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46608.log: /var/log/ceph/ceph-client.admin.50180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46608.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50180.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47919.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44996.log 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41893.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45756.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2024-05-09T02:24:12.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41577.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44996.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47919.log.gz 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44388.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44996.log.gz 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42921.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41577.log: /var/log/ceph/ceph-client.admin.43598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41577.log.gz 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45840.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50306.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42921.log: /var/log/ceph/ceph-client.admin.45840.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42921.log.gz 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48730.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T02:24:12.255 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45840.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50306.log: /var/log/ceph/ceph-client.admin.48730.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50306.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48730.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.46862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45383.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49190.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45714.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50138.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49190.log.gz 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46063.log 2024-05-09T02:24:12.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50138.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz -- 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.41665.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50138.log.gz 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46063.log.gz 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50947.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44286.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41665.log.gz 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50634.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42582.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50947.log.gz 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50634.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50634.log.gz 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41851.log 2024-05-09T02:24:12.257 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42582.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50802.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41535.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41851.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.50802.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45122.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41535.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50802.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41535.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41749.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45122.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29343.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5%/var/log/ceph/ceph-client.admin.41749.log: -- replaced with /var/log/ceph/ceph-client.admin.45122.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49886.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41749.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.29343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51073.log 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29343.log.gz 2024-05-09T02:24:12.258 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50989.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49886.log: /var/log/ceph/ceph-client.admin.51073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46337.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49886.log.gz 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51073.log.gz 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49802.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50989.log.gz 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46650.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46337.log.gz 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49802.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46650.log: -- replaced with /var/log/ceph/ceph-client.admin.49802.log.gz 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46650.log.gz 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47090.log: -- /var/log/ceph/ceph-client.admin.47632.log 2024-05-09T02:24:12.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46235.log 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50432.log 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46235.log: /var/log/ceph/ceph-client.admin.47632.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47632.log.gz 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46235.log.gz 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45924.log 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50432.log: /var/log/ceph/ceph-osd.0.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50432.log.gz 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49970.log 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45924.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45924.log.gz 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41621.log 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49970.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49970.log.gz 2024-05-09T02:24:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41621.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41621.log.gz 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz/var/log/ceph/ceph-client.admin.45550.log: 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42930.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45080.log: /var/log/ceph/ceph-client.admin.43265.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42930.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42930.log.gz 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46150.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47982.log 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47542.log: /var/log/ceph/ceph-client.admin.46150.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-05-09T02:24:12.261 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46150.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46379.log 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47982.log: /var/log/ceph/ceph-client.admin.46379.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47982.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48485.log 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42103.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45882.log 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42624.log 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48485.log: /var/log/ceph/ceph-client.admin.45882.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48485.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45882.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42624.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42624.log.gz 2024-05-09T02:24:12.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46021.log 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48199.log: /var/log/ceph/ceph-client.admin.43594.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46021.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46021.log.gz 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-05-09T02:24:12.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.43266.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-05-09T02:24:12.265 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36000.log 2024-05-09T02:24:12.265 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36000.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36000.log.gz 2024-05-09T02:24:12.298 INFO:teuthology.orchestra.run.smithi107.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42368.log 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48602.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gz 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41493.log 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42368.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45206.log 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41493.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41493.log.gz 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45206.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45206.log.gz 2024-05-09T02:24:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48241.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41234.log 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44010.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41234.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41234.log.gz 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44244.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49488.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42926.log 2024-05-09T02:24:12.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43264.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42926.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42926.log.gz 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43464.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44052.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35541.log 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47258.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2024-05-09T02:24:12.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35541.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35541.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45966.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42666.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45966.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45966.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46795.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42414.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46795.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46795.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42414.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42414.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45549.log 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46193.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2024-05-09T02:24:12.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45549.log.gz 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43602.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41935.log 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41935.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41935.log.gz 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49530.log 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46295.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43267.log 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49530.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49530.log.gz 2024-05-09T02:24:12.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47382.log 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43267.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43267.log.gz 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50222.log 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47382.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47382.log.gz 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47130.log 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50222.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50222.log.gz 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42189.log 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47130.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47130.log.gz 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45488.log 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42189.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42189.log.gz 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45488.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45488.log.gz 2024-05-09T02:24:12.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41791.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41315.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51260.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41791.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41791.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47858.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51260.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51260.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49844.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47858.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47858.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42498.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49844.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49844.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45038.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42498.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45038.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45038.log.gz 2024-05-09T02:24:12.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45634.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43884.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43260.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45634.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45634.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49718.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43260.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43260.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35644.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49718.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49718.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42456.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35644.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35644.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42456.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42456.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43259.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2024-05-09T02:24:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2024-05-09T02:24:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45290.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2024-05-09T02:24:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2024-05-09T02:24:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45333.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2024-05-09T02:24:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47174.log 2024-05-09T02:24:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2024-05-09T02:24:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48361.log 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47174.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47174.log.gz 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48361.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48361.log.gz 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50012.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42708.log 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51031.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47004.log 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42708.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42708.log.gz 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-05-09T02:24:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47004.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48666.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44160.log 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48445.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49429.log 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44160.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44160.log.gz 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49429.log.gz 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47522.log 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz/var/log/ceph/ceph-client.admin.45427.log: 2024-05-09T02:24:12.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50718.log 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5%/var/log/ceph/ceph-client.admin.47522.log: -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.47522.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.46523.log 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46523.log: /var/log/ceph/ceph-client.admin.50718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50718.log.gz 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46523.log.gz 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42019.log 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46421.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50676.log 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42019.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42019.log.gz 2024-05-09T02:24:12.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48319.log 2024-05-09T02:24:12.337 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50676.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50676.log.gz 2024-05-09T02:24:12.337 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41411.log 2024-05-09T02:24:12.337 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48319.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48319.log.gz 2024-05-09T02:24:12.337 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50390.log 2024-05-09T02:24:12.338 INFO:teuthology.orchestra.run.smithi107.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41411.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41411.log.gz 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50390.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50390.log.gz 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42931.log 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43595.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48772.log 2024-05-09T02:24:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42931.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42931.log.gz 2024-05-09T02:24:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50760.log 2024-05-09T02:24:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48772.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48772.log.gz 2024-05-09T02:24:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2024-05-09T02:24:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50760.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50760.log.gz 2024-05-09T02:24:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2024-05-09T02:24:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43604.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2024-05-09T02:24:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49760.log 2024-05-09T02:24:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42932.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2024-05-09T02:24:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42145.log 2024-05-09T02:24:12.343 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49760.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49760.log.gz 2024-05-09T02:24:12.343 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45633.log 2024-05-09T02:24:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42145.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42145.log.gz 2024-05-09T02:24:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2024-05-09T02:24:12.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45633.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45633.log.gz 2024-05-09T02:24:12.345 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46481.log 2024-05-09T02:24:12.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48114.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2024-05-09T02:24:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2024-05-09T02:24:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46481.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46481.log.gz 2024-05-09T02:24:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2024-05-09T02:24:12.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44094.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2024-05-09T02:24:12.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35277.log 2024-05-09T02:24:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43268.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2024-05-09T02:24:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35277.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35277.log.gz 2024-05-09T02:24:12.404 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T02:24:12.418 INFO:teuthology.orchestra.run.smithi107.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T02:24:12.440 INFO:teuthology.orchestra.run.smithi107.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T02:24:12.666 INFO:teuthology.orchestra.run.smithi046.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T02:24:13.026 INFO:teuthology.orchestra.run.smithi107.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T02:24:13.122 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T02:24:13.148 INFO:teuthology.orchestra.run.smithi107.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T02:24:13.188 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T02:24:13.234 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T02:24:13.261 INFO:teuthology.orchestra.run.smithi107.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T02:24:13.594 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T02:24:13.657 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-09T02:24:14.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-09T02:24:19.787 INFO:teuthology.orchestra.run.smithi107.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.1.41829.log.gz 2024-05-09T02:24:19.789 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-05-09T02:24:19.789 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m7.585s 2024-05-09T02:24:19.789 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m11.777s 2024-05-09T02:24:19.789 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.501s 2024-05-09T02:24:20.228 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.0.44816.log.gz 2024-05-09T02:24:20.230 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-09T02:24:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m8.062s 2024-05-09T02:24:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m12.656s 2024-05-09T02:24:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.599s 2024-05-09T02:24:20.231 INFO:tasks.ceph:Archiving logs... 2024-05-09T02:24:20.231 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/remote/smithi046/log 2024-05-09T02:24:20.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T02:24:20.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T02:24:20.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:24:20.982 INFO:teuthology.orchestra.run.smithi046.stderr:Error initializing cluster client: ObjectNotFound('RADOS object not found (error calling conf_read_file)') 2024-05-09T02:24:20.982 ERROR:tasks.mds_thrash.fs.[a]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 121, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 239, in do_thrash status = self.fs.status() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/cephfs/filesystem.py", line 413, in status return FSStatus(self.mon_manager, epoch) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/cephfs/filesystem.py", line 88, in __init__ self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout return self.run_ceph_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd return self.mon_manager.run_cluster_cmd(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2024-05-09T02:24:21.734 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/remote/smithi107/log 2024-05-09T02:24:21.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T02:24:23.080 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T02:24:23.089 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T02:24:23.089 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T02:24:23.092 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T02:24:23.195 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T02:24:23.204 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T02:24:23.204 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T02:24:23.207 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T02:24:23.222 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-05-09T02:24:23.225 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-05-09T02:24:23.227 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T02:24:23.227 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-05-09T02:24:23.228 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 33 +3105us[+3081us] +/- 49ms 2024-05-09T02:24:23.228 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -2424us[-2449us] +/- 65ms 2024-05-09T02:24:23.228 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -1938us[-1962us] +/- 82ms 2024-05-09T02:24:23.228 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:24:23.230 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T02:24:23.230 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-05-09T02:24:23.230 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 33 +3104us[+3114us] +/- 48ms 2024-05-09T02:24:23.230 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -2417us[-2407us] +/- 65ms 2024-05-09T02:24:23.230 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -1942us[-1933us] +/- 82ms 2024-05-09T02:24:23.230 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T02:24:23.231 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T02:24:23.240 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T02:24:23.241 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T02:24:23.253 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T02:24:23.343 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T02:24:23.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T02:24:23.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:24:23.442 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T02:24:23.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:24:23.472 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T02:24:23.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T02:24:23.491 INFO:teuthology.task.internal:Duration was 799.279772 seconds 2024-05-09T02:24:23.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T02:24:23.500 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T02:24:23.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T02:24:23.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T02:24:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T02:24:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T02:24:23.869 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T02:24:23.869 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:24:23.869 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T02:24:23.933 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:24:23.933 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T02:24:23.956 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T02:24:23.957 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T02:24:23.976 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T02:24:24.024 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T02:24:24.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T02:24:24.045 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T02:24:24.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T02:24:24.175 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T02:24:24.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T02:24:24.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T02:24:24.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T02:24:24.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T02:24:24.243 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T02:24:24.264 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-05-09T02:24:24.289 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-05-09T02:24:24.302 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T02:24:24.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:24:24.333 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T02:24:24.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:24:24.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T02:24:24.367 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T02:24:24.368 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/remote/smithi046 2024-05-09T02:24:24.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T02:24:24.408 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698997/remote/smithi107 2024-05-09T02:24:24.408 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T02:24:24.441 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T02:24:24.441 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T02:24:24.445 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T02:24:24.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T02:24:24.503 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T02:24:24.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T02:24:24.513 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T02:24:24.513 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T02:24:24.514 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.fs.[a] failed 2024-05-09T02:24:24.514 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-05-09T02:24:24.514 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T02:24:24.514 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:24:24.516 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T02:24:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 02:24 /home/ubuntu/cephtest 2024-05-09T02:24:24.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19604 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 2024-05-09T02:24:24.531 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi046.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2024-05-09T02:24:24.531 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T02:24:24.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:24:24.532 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T02:24:24.547 INFO:teuthology.orchestra.run.smithi107.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 02:24 /home/ubuntu/cephtest 2024-05-09T02:24:24.548 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T02:24:24.558 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T02:24:24.581 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} duration: 799.2797722816467 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T02:24:24.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T02:24:24.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T02:24:24.599 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: cd: /home/ubuntu/cephtest: No such file or directory 2024-05-09T02:24:24.599 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-09T02:24:24.599 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T02:24:24.615 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056292,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3416 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 2024-05-09T02:24:24.615 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi107.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2024-05-09T02:24:24.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-09T02:24:24.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T02:24:24.616 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T02:24:24.664 INFO:teuthology.run:pass